large mills required significant capital to equip and to maintain thus I suspect the owners became rentier landlords (eg as in the big Nunnery mill though this dates from somewhat later)
Smaller mills might well have descended in the same family who trained a son to operate - the ownership or shares therein, are often mentioned in wills but should be traceable via lib assed + lib vast