I have the same reaction as you do, Taka. "earlier" has the implicit comparison "earlier than you actually did"; "before" does not. "before" leaves me asking "before what?"
Changing to "later /"after":
I have no time to do it now; I'll do it later. (later than now)
I have no time to do it...