Reduced attributes not working when loading into new areas

https://youtu.be/kPMtPXWUhBE

There is a video of me documenting exactly what happens but I will explain in detail

I wanted to use Elemental weakness, Didn't meet reqs for a level 14 gem so I could only use a level 9 gem as I didnt have enough INT until I discovered the nodes on very bottom of tree that reduce attribute requirements for gear/skills and increase attributes by 7%

So I specced into it, 12% of 103 = 12.3 round down to 12, 103-12 = 91

I only need 91 int to use Elemental weakness now sweet, So I test it out in my hideout its working as intended, then I load into a map and notice Elemental weakness disappeared from my hot bar and was greyed out in skill screen

I unequipped and it immediatley allowed me to re-equip, and it worked again, ok I mean thats a bug but I can live with it just re-equip when loading into new area

Well mid mapping it disabled it again... ( I swap between 2 sets frequently)

I respecced to meet reqs, and loading doesn't disable, so whats the point of reduced attribute nodes when I still have to meet reqs....

I show in the video after removing 7% attributes, and having 92 int, it was working in hideout, then I immediatley load into map and its greyed out...