I had the same problem. Sometimes it worked on the 2nd attempt but I died more than once because of this.
[Suggestion]
Would it be possible to make the target of the teleport spell snap to your buildings (like mexes in SupCom). The teleport is often used to get out of harms way and back to your base to heal and buy stuff. Time is of the essence and this would shave off the split second that usually leads to my 
On a second thought, a shortkey that autoteleports you back to your base would be even better (if you have a teleport scroll left of course).