People very much have beliefs akin to this. "Wear and tear" of joints, for example, is just not that simple. And avoidance of exercise or any movement in persistent back pain is common.
What I should have included is the idea that just like with physical exercise, moderation is necessary. You don't see doctors recommending sitting all day to avoid wear and tear, because then you'll get blood clots and all sorts of other problems.
It's up to you to decide whether each situation is closer to "training for a marathon", or "too tired to do stuff".