I cannot help with Taylor's House. It was probably a descriptive term because the Taylors lived there - perhaps for more tham one generation. If so, the other Taylors were probanly related.
The Smelt is a small group of houses on the northern edge of Port St. Mary. Port St. Mary is located on Port. St. Mary Bay.
The northern part of the bay is formed by Gansey Point. The Smelt is just north of Gansey Point., at the start of the next bay to the east, Bay Ny Carrickey, on the way to Kentraugh. To put this in perspective, The Smelt is probably only a mile from the center of Port St Mary