Extract from the 1881 Census:
The Father is not there, however Martha is, James shows as son - Likely he was named after his father. This my not be your lot but worth following up just in case.
T
Martha CALLISTER Head W Female 44 Isle of Man, England Dressmaker
James CALLISTER Son U Male 21 Isle of Man, England Collier
William CALLISTER Son U Male 15 Isle of Man, England Engine Stoker (Stationary)
Martha E. CALLISTER Grand Dau U Female 3 m Cleator Moor, Cumberland, England