Following the lead given by others in this thread I have looked at the original image of the 1861 census, thanks to Ancestry. Do you think this is the right family?

RG9/4419 f.49 p.8 sch.33
Onchan District 10
Buck's Road, Douglas
James Moore, head, m, 44, Brass founder, K Lonan Isle of Man
Fran. Moore, wife, m, 35, (born) England
Thos. do., son, un, 11, scholar, Douglas Isle of Man
John James do., son, un, 10, do. (i.e. scholar), do. (i.e. Douglas)
Frances Jane do., daughter, un, 6, (scholar), Douglas Isle of Man
Mary Ann do., do. (i.e.daughter), un, 4, (scholar), (Douglas)
Margt do., (daughter), un, 2, (scholar), Douglas Isle of Man
Catherine Quirk, servt, un, 20, House servant, Marown Isle of Man
Mary Anne ~~?, lodger, un 77 Proprietor of Houses, England
Sarah ---?, widow, 67, Proprietor do., England