True, but it's not always the correct decision. If it's "costly" to lose, then the flip side if you win is very profitable. I like to consider the merits of each decision as it comes, and go with whatever seems to me to be correct. I also try not to get myself in to too many situations that I regret getting into.
Making decisions is what poker is all about.