"Every" was originally a compound of two words in Old English: æfre (ever) + ælc (each), the former added for emphasis. You'll find "euerich" and the like in Chaucer.
@stancarey And then we started saying "each and every" for emphasis.
@mansr and "every single" and "every last". It seems to solicit support