no fishers in Peel in 1841 or 1851 (nor any record I have) - there was a patrick fitzsimmons(various spellings) s/o of irish born Terence in big street (now castle street) in 1851 + an illeg d/o of thomas fitzsimmons - Cath living in kk michael st

are you confused with 1881 when Patrick Fisher (age 37 born Co. down Ireland) + wife Catharine (born Ramsey) were running the Royal oak in Castle street - judging from children's birth place they only moved here a little befor 1881 and stayed for a rew years