Yeah, don't see why it isn't like this already TBH.
The whole "player leaves, replaced with AI" thing has good intentions behind it, I'm sure, but in practice is not really worthwhile. I'd much prefer if you would simply gain control of your allies' Demigods when they leave instead of having the AI control them, but I don't know if that's really an option with the UI the way it is.