If I teleport to the Stronghold, then I have to walk around it to get to the shops and crystals. My APM may be low, but I still have the concept of time being valuable. I would save a lot of time if I could just press a key and go to the crystal.
I know that I can run away, but that doesn't always solve the problem. If its a Regulus snipes me half a second before I get a healing tick that would save me, then running wouldn't have helped in the first place. This seems to be the most common situation. Plus, if I'm playing Rook, then its really hard to make tracks in the opposite direction.
I know that there are ways around it, and I know that it doesn't have to be a problem. I'm saying that its something that would be useful. The game will function fine without it, it will just help.