Just because it is in a census dosn't mean 'twas so!!!
Your reading of the entry is correct.
This appears to be the family of John Joughin & Margaret Kayll, 19 Feb 1842 at Braddan.
According to the IGI the daughters were all baptized in Douglas.
John's age was given as 20-24 in 1841 when he was with William King, shoemaker, so 35 seems about right in '51.
I can't positively identify the family in '61 but Margaret (46), Margaret (17) and William (9) appear to be lodging with Joseh Rayle in Strand Street