Is this the man you're looking for?

Baptism:- familysearch.org/ark:/61903/1:1:XZYX-XMV

1851, 71 Malew Street, Castletown, IOM, Samuel Stewart, visitor, married, 22, Rag man, Ireland
- Wife, Margaret, 20, Ireland
- Son, James, 6 mths, Ramsey IOM

1861, 52 Maughold Street, Ramsey, IOM, Samuel Stewart, Head, married, 35, car driver, Ireland
- Wife, Margaret, 35, Dealer in ?, Ireland
- Son, James, 10, Ramsey IOM
- Son, John, 5, Douglas IOM
- Daughter, Margaret, 5 mths, Ballaugh IOM

Marriage:- familysearch.org/ark:/61903/1:1:XZY1-TF3

1871, Market Street, Douglas, IOM, James Stewart, Head, married, 19, labourer, Ramsey IOM
- Wife, Elizabeth, 17, house keeper, Liverpool

1881, Wellington Square, Douglas, IOM, James Stewart, Head, married, 28, car driver no occupation, Ramsey IOM
- Wife, Elizabeth, 26, Liverpool
- Daughter, Margaret, 10,
- Son, John, 8, Douglas IOM
- Son, James, 6, Douglas IOM
- Son, Samuel, 4, Douglas IOM
- Son, Douglas, 1, Douglas IOM

1891, Village Road, Onchan, IOM, James Stuart, Head, married, 45, labourer, Onchan
- Wife, Elizabeth, 41, Liverpool
- Son, James, 15, labourer, Liverpool
- Son, Samuel, 13, Liverpool
- Son, Douglas, 11, Liverpool
- Son, Charles, 9, Liverpool
- Son, Robert, 6, Liverpool
- Son, Gilbert, 3, Onchan
- Daughter, Mary, 2, Onchan