Way to remove playback lag when using larger soundfonts in 3.x and later versions of 2?

It's pretty weird. Whenever I use a soundfont that isn't just the basic general font the drums start panning at random times, guitars and drums either skip notes or end up behind by 16th notes or more. Is there any way to fix this? Or any programs I can import the score to so that it will play back properly?

Edit: The soundfont I use mainly is Compifont. The older version of Compifont isn't as bad about this but it's still present. Only got worse in the newer version.

Here's an example: https://youtu.be/nRYXMnv0VAM
There's a LOT of outright missing notes in there that are definitely on the score...