Assuming no antes, you had to call 80k with your 32s into a pot holding 180, so the pot odds
were 2.25:1. Based just on the math, you should call unless you think the shover's range is pretty nitty. In practice, it's hard to assume anyone's shove range with 3bb is narrow enough so you don't have enough pot odds
I might fold anyway, but the main reason wouldn't be the 32s. It would be the relative probability / utility of increasing to a 720k stack vs dropping to 480k, which is hard to assess without knowing the rest of the stacks.