What secretly eats your local LLMs' speed as your context fills up - Part 2

So, we left in the previous chapter with some data and insights. This time we talk about the story behind this. I was serving my model through llama-server.exe locally. While chatting, I've noticed a sudden drop of performance. My idea was initially that other applications that were open were causing the issue. I closed everything, started the task manager and put it side by side with the browser page. I noticed my VRAM was stable and… so was the RAM . At this point by searching on Google and…