A set is the most dangerous hand to meet the villain, so you can't just play with what you have in hand.
Do you have to pay attention to how the villain is playing, is he being aggressive? Is he a passive player? The position he is in, how much was bet preflop ...
So, in my opinion, sometimes it's worth holding a few hands to analyze how people play.
A check / raise / made by the villain may indicate that the villain is setting a trap, evaluate well and try to hold on.
Looking closely at the board, the chances of you taking a bad one are high against a set, especially if you're a player who doesn't usually fold high pair or two pair.
I'd rather be safe, and think, "That's not good, but at least there will be the next pot."
Good luck against the sets.