The 1881 census has:-

at 73 Stitt St. Everton Liverpool,

James Williams, 25 Cab Drver from Gloucester.
Henrietta 26 Scarisbrick Lancashire.
Ellen 3 Everton
Mary 1 Everton ( listed as son, male )
James Gibson Brother, W. 23 seaman RN Everton
James Gibson Nephew 3m Toxteth Park

There is a James Alfred Williams ch.1856 in Newent Gloucester to James Williams and Eliza ( possibly Daniels).

Len Faragher