I would fold in this spot most times. You are OOP with small pocket pair. While you could set mine, are you sure you would get paid off if you hit the set? What is the range of the smaller stack tight players (I'm guessing aces or bigger pairs). You also have a potential set over set situation on a low board (i.e. McKeehan v. Schwartz WSOP
style). If you fold flop when you miss, you lose 3 BB (leaving you with 17), which could end up in the shorter stacks, giving them a that much larger stack than yours.
I would play if first in in later position for a raise, but not against three callers of an early, tight raiser. Against (representative) hands like 55(UTG2), QJo(chip leader), and A8s(SB), your hand has 14% equity (calculated on cardplayer odds
calculator). I doubt you have the 25% equity in this pot PF, and tournament survival is more important in the "middle" stage, as you describe you are.