Your 4xgrandfather was probably in receipt of an army pension.He was an "out pensioner"meaning he was not resident in the Royal Hospital Chelsea.
If you know his possible date of retirement from the army or his regiment you may be able to find out more about him in the National Archives (formerly the Public Record Office)at Kew in London.