I've just found Mary & Thomas in the censuses.

1861 Douglas, Onchan par Dist 12 f.107 p.8
Castle Mona Ter,
Thomas Collins, head, 65, Publican, Yorkshire
Ann Collins, wife, 46, Yorkshire
Thomas Handley, stepson, 22. Publican & cabinet maker, Lancashire
Mary Handley, stepson's wife, 20, Castletown

1871 (Ancestry index = Hansley) Douglas, Onchan par Dist 15, 5775, f.172
Broadway
Thomas Handley, 32, Inn Keeper, England
Mary Handley, wife, 30, Castletown
Walter P., son, 9, Douglas
Thomas P., son, 8, Douglas
Eleanor Sayle, 19, servant

1881 Douglas, Onchan par Dist 15, f.34, p.18
"Handley's Bowling Green Hotel", Derby Rd
Thomas Handley, 42, Licenced victualler, England
Mary Handlye, wife, 40, Douglas
Walter P. Handley, son, 19, Douglas
Thomas H. Handley, son, 18, Douglas
2 visitors
3 servants

Brian's burial index:
Mary Theresa Handley (?), 46, Bra, 29 April 1886
Thomas Handley, 50, Bra, 14 May 1888

The 'Theresa' was a surprise but at least it means the Mary who went to Australia wasn't Mary Handley. But then, did anyone ever think it was?!