Not unusual for a family to have a different address in each census. Most of them were renters and accomodation was often tied to a job.

Ages don't seem out of line.
1841 was taken in June rather than March/April so it could easily agree 100% with 1851.

In the same way, if his birthday was at the end of March, the '61 and '71 ages could also agree 100%.

It looks as if he was born in the period 1808-12.