Ancient Babylonians first celebrated the new year over 4,000 years ago.