Perhaps there should be an unintrusive box that asks the remaining players whether to vote the leaver down? Sometimes people are disconnected by accident, and people can generally spot a leaver from a crappy-internet-connection victim.
Adding to this, what should be done about leavers? Give them a loss and a leave? That would take all the motivation to leave away, and let victims of bad internet not be punished unduly.