Is there anyway that my connection with the server, even though it is in my house, could be limiting the client? When monitoring hardware performance there is nothing that seems like it could be causing the issue. Slowing down to .8 definitely helped but I would still like to understand the cause a ...

So does that mean the server is too slow or that my computer is too slow? I have nearly the same specs as my friends so I have a hard time understanding why it is just me. Also is there a way from the debug screen that I could tell how much to slow it down by?

I host a headless server on a separate Linux system. All my friends who connect don't have lag issues and we have very similar hardware. I would expect that with me hosting on my network I would get better performance. It has gotten much worse as the base grows to the point where it is unplayable ...