IMO, it depends how much it would have broken you. It is possible he had the flush, or he could have been bluffing
. I've been in the same spot as you except i hadn't paid attn. to the board , called and the villian did in fact have the flush. Since he didn't show, we'll never know but i think it was a good play. Most books will tell you to raise or push. I disagree, if in fact he did have the flush and didn't buy that you had the higher one..you'd be out of more money.