Cannot summon minions despite having no spirit reserved (Related to The Unborn Lich somehow)

I don't know what it is about The Unborn Lich but ever since I've equipped one I've been having lots of issues. For example, several of my Cast on Crit gems became bricked, I would have to either create or purchase a new one, or use the staff in my second weapon set in order to be able to use Cast on Crit again.

Now, after playing around with the Feast of Flesh spell, I have somehow made it so this character and this character only cannot summon spectres, skeletons, wolves, basically any spirit reservation minion, even with no spirit reserved.

I've checked to make sure I can support said spirits on both weapon sets, I've tried specifically allocating the spirit for said minions per set, and I've tried relogging and restarting the game but nothing has fixed this issue for me.

I've also tried just not using this staff to see if my problem persists and it does. At this point getting new skill gems for minions has not fixed my problem either.

Quick update:

I noticed that even though my other meta gems were not enabled and they were not actively reserving spirit, by removing them I could suddenly allocate minions again.

I've not experience this before, don't know if I am just lucky or if it is related to this buggy ass staff after all.