No, they don't. They use it with "hours", but not necessarily.
It is five past nine.
It is nine o'clock.
It is nine.