Can't rejoin map

On PS5:

I was running maps with a friend when I portal'd out to do a trade. When I warped back to him, it took me to our guild hideout, but in a different instance. I zoned out to a few different locations and back with no success. I visited his hideout and saw his portals up, but I could not interact with them. Friend was inside the map the entire time.

Happened to us in Multiplayer (PC) as well.
The bug happened after a visual glitch from old portals never disappearing after completing an Hideout map.

I have the same bug with my friend. We launch a map and start it but if a TP back to the hideout to manage my inventory I can't go back into the map because I can't interact with the portals anymore.