Robert and Caroline Owen had eight children, the first of whom died in infancy. Their seven surviving children included four sons and three daughters: Robert Dale (1801–77), william (1802–42), Ann (or Anne) Caroline (1805–31), Jane Dale (1805–61), David Dale (1807–60), Richard Dale (1809–90) and Mary (1810–32). Owen's four sons, Robert Dale, william, David Dale, and Richard, as well as his daughter, Jane Dale, followed their Father to the United States, becoming U.S. citizens and permanent residents of New Harmony, Indiana. Owen's wife, Caroline, and two of their daughters, Anne Caroline and Mary, remained in Britain, where they died in the 1830s.