Simple, make the whole counter system SYNCHRONOUS.What should we use for counters? I'm thinking in particular about ripple delays if you cascade binary counters.
Although, that does increase the peripheral IC count somewhat.
Always a trade-off, isn't there!