Cant dismiss rally flag via interface in multiplayer

When playing in multiplayer rally flag can't be dismissed by clicking on small red flag above minimap, the red flag is simply not there. Its kind of big annoynace because minions are usually all over your flag so I have to move flag somewhere else first and then right click to dismiss it.

I'm pretty sure its only related to clients and not host but I'm going to verify it later today.