A lot of frame stuttering when using Vulkan

[hidrostix]

I tried using a performance modpack while replacing every Vulcan incompatibility, however it likes to stutter
So, I added bobby, to be able to store chunk data permanently, not caches
However I seem to be running into the same issue, I tried removing some mods to troubleshoot, but I still can't find a mod that seems to be causing the issue, so right now I assume there's something wrong with my modlist or Vulkan.
There are no crashes, the game just seems so stutters during gameplay and becomes annoying, I also noticed this happens when loading chunks, and I can't find a chunk loader mod that is compatible with Vulkan
Turns out iris solves this problem, s sadly it's incompatible

All of my mod loading is done with modrinth
The game version is 1.21.5
I'm using fabric

This is my modlist:
BadOptimizations
Cloth Config API
Continuity
Entity Culling
Fabric API
Fabric Language Kotlin
FerriteCore
Lithium
ModernFix Fabric
More Culling
Noisium
Resourcify
Thread Tweak
Very Many Players Fabric
VulkanMod
YetAnotherConfigLib
Zoomify

[dupontinquiries]

Not a fix but try these:

Try playing with Thread Tweak config.

Try using C2ME.

Try playing with the culling algorithm.

I believe Distant Horizons chunk generation also works. Chunky should work too.

Try playing with chunk generation thread count.