I don't let it annoy me at all, it's out of your control. Everyone has the same amount of time to make a decision, so IMO it's just something that you shouldn't let get to you. Why create a distraction for yourself this way, just let it go and focus on your game.