Joseph married Lydia Ann "Lettie" Gough on 15 Apr 1861 in Union County, Kentucky. Lydia (daughter of George Silas Gough and Letitia Bell Davis) was born on 3 Nov 1839 in Union County, Kentucky; was christened on 20 Nov 1839 in St. Vincents, Union County KY; and died; was buried after 1882. [Group Sheet] [Family Chart]

1. Silas Waller
2. Mary Emma Waller was born on 8 May 1864 in Union County, Kentucky; died in 1948 in Morganfield, Union County, Kentucky.
3. Catherine "Kate" Waller was born on 16 Sep 1864 in Union County, Kentucky; and died.
4. Prudence Waller was born on 17 May 1866 in Union County, Kentucky; and died.
5. Joseph Reaves Waller was born on 11 Feb 1868 in Union County, Kentucky; died on 4 Jan 1913 in Harrisburg, IL; was buried in St. Agnes Catholic Church, Union County, KY.
6. James Martin Waller was born in 1873; and died.
7. Letitia Bell "Lula" Waller was born on 10 Jan 1862; died in 1909.
8. William Victor Waller was born in 1874 in Kentucky; died on 3 Aug 1913; was buried in Saint Agnes Catholic Cemetery, Uniontown, Union County, KY.
9. Mary Lillie Waller was born on 21 Feb 1874 in Union County, Kentucky; died on 22 May 1941 in Union County, Kentucky; was buried in St. Agnes RCC, Union County, KY.
10. Thomas Waller was born on 10 Nov 1875 in Union County, Kentucky; and died.
11. Henry Clay Waller was born in 1876 in Kentucky; died in 1904.
12. Joseph Mary Waller was born on 9 Feb 1878 in Morganfield, Union County, Kentucky; died in 1942 in Evansville, Vanderburgh County, Indiana, USA; was buried in Saint Agnes Catholic Cemetery, Uniontown, Union County, KY.
13. Mary Ella Waller was born on 14 Jul 1880 in Union County, Kentucky; and died.
14. Lloyd Waller was born in 1882; died in 1902.