Meh, who needs to be fast? Nothing wrong with playing a rook build and trying to get him up to the same speed as everyone else, you're just gonna suffer some penalties. I played rook for my first couple of games and had no trouble at all winning.
It does come down to temperment somewhat. I have a friend whose favorite unit is the queen, and he is incredible with her, because he has the temperment to micro the idols and shamblers (especially moving half-health shamblers in close and mulching). I don't have that, so I tend to play rook, because I have the patience to not care that I can't move fast so long as nothing in the world can hurt me (and trust me, a well played health rook is pretty much invulnerable to anything 2 demigods can dish out, 3 is where he starts dying, but 3v1 should never happen, or never happen without the other team suffering, if you have decent teammates).
Sounds to me like the OP just didn't have the temperment to play rook and had the required temperment to play queen. Sure you can play whatever demigod you like (I've played them all multiple times) but everyone has a certain playstyle, and some demigods conforms to yours better than others.
In case you're interested I play a very high HP, low burst, siege rook whose job is to demolish enemy towers, then run back to a tower farm for safety. It works great for me, I get few DG kills, but I tend to be in the enemy base pushing hard long before they've even thought about taking down more than the outlying towers. I'm of the opinion that if you try and play rook as a demigod killer, you'll never be satisfied, because he's not good at that. If, on the other hand, you play rook as a siege/countersiege (extra towers at a location can prevent/push back an attack on that location) you'll find he's one of, if not the best in the game at this.