depends how often they are doing it, when people start doing it every hand near the bubble it can be real annoying.
The absolute worst is when you've got a player who is "waiting out the clock" as I call it- when hand-for-hand play is in effect. Then not only 1 table must wait, but every table, and it doesn't even help a small stack person get closer to bubble survival.
edit : also its real annoying when every other player at the table is sitting out, and the one person not sitting out is running the clock down, instead of stealing blinds