Local Co-Op cannot join another Co-Op team

I and my wife plays together on a PC and my friend and his wife plays together on a PC as well. However, we can team up for a 4 players team.

The message showed like below:

You joined a team.
You left a team.

We will join and leave the team together.