Behead Support Gem Doesn't work properly

When using the behead 1 or behead 2 support gem you will gain the modifiers of the slain rare. However, immediately after using the skill that activated the support gem the modifiers you gain disappear. This is consistent and reproduceable.