The units are based on history. The first three eons of Earth's history were long because in all three eons over 3.5 billion years, there is little history happening. Most of our known history is in the fourth eon, which takes place over a short period of 500 million years.
Hope this helps!