Hello Stephen,
So far all you say fits with what I know.
Nathaniel Caine 1843 (I had 1844) -1926 married Jessie Olivia Bell (born 1851 Liverpool) in 1870. They had 7 children that I know of:
Nathaniel 1872
Margaret Ethel 1873
Douglas 1874
Thomas 1876
Muriel 1878
Howard Mackenzie 1880
Ella Mary 1882
If you can send me your email I can send you a GEDCOM file which will make more sense of all this. I can also send you the portrait I have of Nathaniel, which will be interesting to compare with the one you have. Most of all, I would LOVE to see the portraits of Hannah, Thomas Caine and Ann Sproston. Is it possible for you to photograph them and email them to oliver@nares.net ?
Just to put you in the picture - I descend from Adah Caine who was Nathaniel and Hannah's second youngest daughter. She married William Barrow Turner who was (among other things) a managing partner in Nathaniel Caine's mining company. Their son, Charles 1875-1915, married Louie Blasson. They had one daughter, Phyllis 1899-1996, who married Joseph McCance. Their daughter, Nathalie, is my mother.....
I think it would be best if we could communicate directly by email and summarise the findings on the forum when the jigsaw puzzle has been assembled?
Best wishes,
Oliver
oliver@nares.net