Historically, fitness was discussed in terms of the capacity to carry out the day's activities without undue fatigue. If you think about the word, this makes perfect sense. The term address how "fit" you are to do a day's labor.