Lumley was born in Dublin, Ireland and came to the United States around 1840 where he lived in Brooklyn. In the 1850s, he studied art at the National Academy of Design. In 1860 he started working for the newly founded illustrated newspapers New York Illustrated, Harper’s Weekly, and Frank Leslie’s Illustrated Newspaper. In April 1861, Frank Leslie sent Lumley to Washington D.C. as a “special artist” to accompany General Irwin McDowell’s army as it traveled south into Virginia.