Beryl - I've drawn a blank with John James Ruler Snr but you may find the following of interest.

1851 English census, High Row, Hensingham, Cumberland
Philip Skimmins Head 60 Borer b. Isle of Man
Margaret do. wife 65 b. Isle of Man
Mary do. daur 20 straw bonnet maker b. Cumberland
Margaret do. daur 17 dressmaker b. Hensingham
Sarah do. daur 14 b. Hensingham
William Ruler cousin 19 cabinet maker b. Whitehaven
William Skimmins Son 25 gen. labourer b. Cleator
Mary do. daur in law 22 b. Cumberland, Gosforth
Elizabeth do. daur 3 b. Whitehaven
Ann do. daur 1 b. Cumberland, Eskdale

1861 English census 2 Shepherds Court New Cross Manchester
William Ruler head 29 Cabinet maker b. Whitehaven
Esther do. wife 31 b. Whiitehaven
Elizabeth do. daur 4 b. Isle of Man
John James do. son 2 b. Isle of Man

1871 English census St Peter Lancashire
William Ruler head 38 cabinet maker b. Whitehaven
Esther do. wife 39 b. Whitehaven
Elizabeth do. daur 15 b. Isle of Man
John James do. son 13 b. Isle of Man
Joseph do. 11 b. Manchester
Hannah do. daur 11 b. Manchester
Thomas do. son 2 b. Manchester
Esther do. daur 5 months b. Manchester

Regards

Mike