DriftySquid

I am currently having issues with my Forge and Optifine setup. I am using Sildurs shader pack, and when I launch from purely Optifine, I have no issues. Perfectly running, 60 fps, no lag, no stutter, low CPU and GPU temps. However, whenever I launch from Forge, it takes about 7 minutes to simply load the title screen, and my longest world load to date is 37 minutes. All versions of everything are compatible, 1.14.4 on everything, and everything says OptiFine and Forge compatible. Am I doing something wrong?