crossbow weapon swap problem

on my ps5 if i switch my skill one set to my skill two set before it reload i cant use my skill one set anymore, my bolt count say 0 and i cant reload it. The only way i can fix that for now is to unequip my crossbow and reset my skills. Really annoying when you fight a boss or hard rare