Some chunks loading slow after 1.19.2 update

After updating to Minecraft 1.19.2 I noticed that a set of chunks near my server spawn location are frequently loading much slower than other chunks. I have tested this with multiple different accounts. Occasionally the chunks load normally, but most of the time it takes a few seconds for them to load. Sometimes it takes up to 10 seconds for the chunks to load. Moving towards the chunks causes them to load faster. I have configured Paper to keep the spawn chunks loaded, so the chunks are loaded on the server, but load very slowly for players when teleporting to spawn. I have also tried disabling the "keep spawn chunks loaded" config but that did not fix the issue. It happens even when I teleport to spawn, teleport away, and then teleport back a few seconds later.
 
I have attached a screenshot of what it looks like when waiting for the chunks to load. It's always this same corner that loads slow. All 4 corners of the building are identical.
 
After more testing, I realized that this is not specific to the server spawn location. One corner of chunks relative to the players location often loads much slower than all other corners of chunks when teleporting to a different location.
 
The issue is not caused by insufficient server resources. Quite the opposite, the server has way more CPU and RAM than it needs and I have tested this with 1 and 2 players online so the server is not overloaded.
 
Here are the server specs:
Ryzen 9 5900X 4.8 GHz (US & EU) | Ryzen 7 5800x 4.7 GHz (APAC) 4 Dedicated vCores | NVMe SSDs | 16GB DDR4 RAM