VRAM keeps rising up until a freeze

Checking F1 charts, the game keeps using more and more VRAM till it reaches 6GB (my gpu's max is 8GB. I'm quite sure it shown 6GB as a fully filled bar, as it were the max), then it freezes for like 10s, recovers into a black screen with GGG's logo (most of the time, else it shows Deadlock error). During the black screen VRAM goes to 0 and rises till 4GB, after a while I can play again.

This is like every 6 maps or so, and it's so bothersome having to forcebly stop playing for like 1-2min (also if I were to do an endgame boss I would lose the encounter ofc). This didn't happen 2 leagues ago, started last league, but I'd say it happened way less.


edit: This was in DirectX12. With vulkan it doesn't happen.