The noun “time” is a bit trickier because it can be both countable and uncountable. When you’re talking about a specific amount of time, such as “five minutes,” use “many.”
How many minutes before we can leave? (The answer would have a number.) But when referring to time as a general or loose concept, use “much.”
How much time has passed? (The answer could be a little or a lot.)