In my initial trawl through the birth index, I missed this brother of Joseph---he was a 5 year old with his sisters and mother Eleanor in 1901. I can't see him on Brian Lawson's burial index, so did he perhaps go and join his father and elder brothers in Canada ?
MOORE, Fred Stephen 8 Mar 1896 Arb 255 MOORE, William LEECE, Eleanor