Kick should be only allowed for those who have ping over some limit. Host should be able to set this limit under game options. Then thing like in DOTA should appear, noticing that a player's ping exceeds the set limit. When some time passes, like 45 seconds, it should allow all players to click DROP button, and if majority does, player gets booted.
If you just allow Kick, this will lead to situations like "someone owns me, i will try to convince others to kick him". Or "he is a noob kick him"... Hey, you all were pros from the start, yes? From your first game...
Although kick should be probably allowed, but only the team of the one being kicked should vote, and 100% of votes (except person being kicked) must be required for it to allow kicking.