I offer this as a possible line of investigation - your known ancestor would appear to be part of an Afrikaans community rather than an English group - one link with South Africa in early 19th C was the military - in 1881 there is a Staff Sergt Worc Militia Chelsea Pensioner John Gorry (living with family at """Norton Barracks"" Worcester Pershore" - he from age would appear to be son of James Gorry + Margt Callister bapt Kk Patrick with James I think youngest son of John Orree[gorry in other bapts] + Elinor Taylor in Rushen - this John may well be the son John mentioned in Wm Gorry (ancestor of Peel based Gorrys) but born off Island before Wm arrived in Kk Pat (see his will)
If this military John had children in SA (possibly illeg ) then this may give the link