Halls of the dead clicking totems does nothing

been trying this for days, clicking the totems does nothing.
A small blue line appears and disappears between me and the totem for 1 second.

You can't attack them or do any damage, how does this mechanic work??

there is zero indication of how to actual play this on xbox

what am I supposed to do?

I’ve had to take any ability off my a button to do anything in there.