Getting driver timeouts exclusively when casting Comet

I cast it manually, not as a trigger.

I use several skills as a frost sorceress, but Comet is the only one causing this. It's not guaranteed, but whenever I cast it, there is always a chance for driver timeout.

There is no hard crash. I get driver crash only.

CPU: 9800XD, no overclock
GPU: 7900 XTX, undervolted (tried no undervolting too, no change)
RAM: 32 GB at 6000 30CL (EXPO profile, no other changes, also tried EXPO off)