Lost Support Gems socketed on ascendancy skill

So, I was playing invoker monk using the unbound avatar from the ascendancy tree, it had 3 supports gems on it (fire, lighting and cold mastery), but later on I tried to use other skills, so I respect it, the unbound avatar skill was gone of course, but, so was my gems, I couldn't find them anywhere on my inventory or stashs.

I tried to put points on unbound avatar again, but the gems were no where to be seen.

I know that's not a major problem, since uncut sups are easy to find and cheap to buy anyway, but it's still something I belive shold not happen, or at least I guess we should receive a message saying that if we don't remove the gems, we gonna lose them.