Henry Oliver was born in 1839 in New York state as the son of Simon, Sr. and Mary (Wright) Oliver.

He was married to Emily M. Wright and was listed as living in Britton, Lenawee County, Michigan in 1892. Emily was born in 1849 in New York.