By 1842 Joseph Fossett and his family had settled in Cincinnati, where he pursued his trade as a blacksmith with his sons. His daughter Ann-Elizabeth Isaacs and her family soon returned to Charlottesville, which they left forever in 1850, moving first to the town of Chillicothe and then to a farm six miles east.