It's time you exercised more
It's about time you exercised more
It's high time you exercised more
After these expressions you use the past simple, even if you are talking about the present or the future.
When speaking in general terms: It's time to go. You use an infinitive.