Modded Server keeps having all sorts of bugs and problems

[Spare]

So, basically my modded server I have with a group of friends keeps having problems such as:
-Randomly dropping freezing, dropping to 0 tps and then crashing after running completely fine after a while (It also freezes sometimes when someone connects to the server)
-Players sometimes ending up in COMPLETELY random spots after coming back from a dimension (We're talking like thousands of blocks away)
Minecraft version 1.20.1
Forge 47.3.0

Mod list: https://imgur.com/a/ekt6kMq

[TileEntity]

Add such a crash-report with sites like

https://mclo.gs/

 

[Spare]

This is what I got from the latest crash: https://mclo.gs/07FBY2q

[TileEntity]

Make a test without chisels-and-bits-forge

[Spare]

It seems like that worked so far! Thanks