Problem with weapon swap with bows and crossbows.

When using the proper weapon swap style when pressing G for skills, and allocating skills for a certain weapon, for me at least, when I use Stormcaller Arrow, it swaps to the bow, and the skill works fine. When I then try to follow up with a crossbow skill of any kind it does not work. It loads the crossbow but my character simply stands there. If I press X to swap to bow, it swaps but again just stands there. I need to use Stormcaller Arrow when a crossbow is equipped then press X to swap to crossbow, then the skill, any crossbow skill works as intended.

It is VERY frustrating in the heat of the moment to remember to press X rather then simply hitting the crossbow button, thus nothing happens and you are running for your life from a boss, or you die cause you had a brain fart and nothing worked.