yes some found it difficult to settle and returned back to Island - not clear on absolute figures but I've come across several accounts of such.

There were also quite a number who returned briefly to the Island to obtain wives!