The latter sounds much better.
Because depending on your goals, the gym can have more tools to get you there.
Endurance athletes probably would not benefit much from traditional gyms like a American football player. So it really depends on your goals and what you define as fit.