Hi David ,
Are you thinking he married before he came to Australia ? There is no sign of any Children born IOM to James & Anne Quillam , no sign of her death. But he was in Sydney less than 9 months after the Quillam marriage in 1853. No sign of a second marriage for Anne Quillam Radcliffe
David Dwyer