James Scarffe md Margaret Lewin 29 MAY 1830 Braddan
1851 Census
Douglas
Drumgold Street
James SCARFF head married 44 labourer b Lonan
Margaret wife married 41 b Onchan
Margaret daughter unmar 18 book binder b Douglas
Joseph son 10 scholar b Douglas
Sophia daughter 8 scholar b Douglas
Mary Ann daughter 4 scholar b Douglas
Elizabeth daughter 1 b Douglas

MARGT ESTHER SCARFF Christening: 08 MAY 1831 Braddan
JANE SCARFF Christening: 29 MAR 1834 Braddan
JAMES SCARFF Christening: 08 JAN 1837 Braddan
JOSEPH SCARFF Christening: 18 NOV 1838 Braddan
SOPHIA ANNA JANE SCARFF Christening: 15 JUL 1841 Saint Barnabas, Douglas
ELIZABETH ELLEN SCARFF Christening: 14 APR 1844 Saint Barnabas, Douglas

As you can see by the christening dates of the children, whoever gave the family's ages for the census was really involved in math! Each person is off 2-3 yrs except Elizabeth who is off by 7 yrs.
Presumably the ages given for the parents are also off.
1841 census of course doesn't help us as adults' ages are rounded but the reporter did a better job with the children

1841 Index
Douglas 4 24 126
SCARFF
James 35
Joseph 2
Margaret 30
Margaret 10
Sarah 7 (Sophia?)

Are these your people?