1881 census shows:-
George A Tidman Head Gardener age 31 born Chawton Hampshire
Sarah J Tidman Wife age 34 born Heworth Durham
George D Tidman son age 5 born Douglas Isle of Man
Sarah A Tidman Daugh. age 3 born Beckermont Cumberland
Mary J Tidman Daugh. age 6M born Middlesbro York.

On the face of it they had left the island but they did move around.