there is only a 12 year old Mary Saddler in the 1881 census (a 'student' in a multiple occupier house in Lord street Douglas) - the personal name sadler or saddler does not appear in my victorian directories except for a late 19th C (1897+) Rev Sadler (Primitive Methodist) - thus if he had any connection with the Island it must have been slight - are you sure they met on Island, she could have been in service off-Island