James Harris and Esther Morrison had 6 children according to IGI two of which were born in Australia.

In 1853 they took the ship Africa to Australia with 4 of their children, details can be found in manx notebook.

By 1861 Esther and 3 of her children are in Cornah Harbour Maughold Isle of Man, Esther 10, Mary Ann 6 and George Samuel 4. The last 2 were born abroad but christened in Dhoon. Esther is listed as a widow so it appears as though James died in Australia.

I don't know where William Henry, Ann Elizabeth and John James are at this point.

The 1880 USA Census shows a William Henry Harris from the Isle of Man married to Nellie from Canada with 2 children born in Michigan, 2 children born in Indiana and all living in Nebraska.

The 1881 British Census has:-

at 6 Spring Gardens Douglas.

Thomas Morrison 61 Maughold Shoemaker
Esther Harris sister 59 Lodging House Keeper
Evelina Harris Niece
William James Jelly Nephew.

It is probable that Esther married a John Galbraith in 1865 and she and Evelina should listed as Galbraith. William James is the son of William Henry Jelly and Esther Harris (the daughter). The rest of their family can be seen in the census living on the promenade.

I believe the mother Esther died a Galbraith in 1896. The daughter Esther went on to marry an Edward Russell after William Henry died in 1882.

Spring Gardens is near to the Manx Museum the usual place people go to start researching.
Cornah Harbour is off the Laxey/Ramsey Road, a long single track down a valley to a pebbled beach (worth a visit)

If you enquire on manx notebook and Brian Lawson's indexes it will help your preparation before travelling.

Len Faragher