The major council is moving to remove the Union flags which appeared all over areas of Birmingham in recent weeks.