Very Worth it, as Kitkun said keeping the nemy behind in war score is a priority, also if the nemy does not get hp for towers you creeps might slowly puch into his base, although this is highly unlikely as hp upgrade costs only 600 gold and in the end you might be giving your oponent aditional places to farm, but considering where must neutral portal are Dgs dont usually farm there.
So in the end, i will always get them is a great way to leave the enemy behind in war score and while they might try to farm faster they will have to move from lane to lane, and as you are supposed to be in one of those you might be able to criple his whole farming operation if he gets to greedy.