Kay, is this the correct family for your Kellys in 1871? (I know Jo has already posted these, but I'm a bit confused by all the different Kelly families posted as to which ones are correct, and some don't have the census year included.)

1871 8 Mill Street, Castletown, Malew
John Kelly Hd Mar 48 Journeyman Painter b.Castletown
Jane Kelly wife Mar 44 Journeyman Painter's wife b.Marown
Joseph Kelly son 15 Apprentice painter b.Castletown
Margaret Kelly daur 12 Scholar b. Castletown
Philip Kelly son 10 Scholar b. Castletown
Anne Kelly daur 8 Scholar b. Castletown
Thomas Kelly son 5 Scholar b. Castletown
Evan Kelly son 2 b. Castletown
Henry Kelly son 2 Mo[nths] b. Castletown.

And in 1881 (from Familysearch):
John KELLY Head M Male 57 Castletown, Isle of Man, England Painter
Jane KELLY Wife M Female 55 Marown, Isle of Man, England
Thomas KELLY Son Male 15 Castletown, Isle of Man, England Painter
Evan KELLY Son Male 11 Castletown, Isle of Man, England Scholar
Dwelling 47 Queen Street
Census Place Malew, Isle of Man, Family History Library Film 1342347, PRO RG11 Piece / Folio 5607 / 52 p.7

KELLY, Henry Charles 1 [buried] Malew 6 Feb 1872 [BL's index]. Bapt 29 Mar 1871 Saint Marys, Castletown [IGI].
Jane Ritson bapt 27 Aug.1827 Marown, daur of John RITSON & Margt KELLY

If the correct ones, where did they go to after that?

Sue