I have the exact same problem, except I do eat my breakfast!!! :(
I don't know why, but my eyes start to droop at around 5-6 and I can no longer concentrate. However after 30mins-1hr of sleeping, I feel refreshed and ready to work.
The way I see it, it's not so much WASTING TIME, but...