I found eight children for Daniel Daugherty and wife Jane Kaighin in the IGI. In the 1881 census there is no record of John born 1856 either on the Isle of in Britain. Robert may have been a border as follows:
FHL Film 1342344 PRO ref RG11 Piece 5597 Folio 58 page 9
Census Place (German) Peel
2 Factory Lane
Elizabeth Tasker W 42 German
Elizabeth Tasker U 21 German
Catherine Tasker U 14 Peel
William Tasker U 16 Peel
Eleanor Jane Tasker 12 Peel
Hannah Tasker 5 Peel
Thomas Clague W 36 Castletown Border
Robert Daugherty U 21 Santon Border

The rest of the family Daniel, Jane and 4 children are in German let me know if you want details and I'll provide.