I agree that David Jason was too old.
He was perfect for Albert in Hogfather and it seemed to me that they wanted to keep such a big named actor for CoM. They therefore gave him the role of Rincewind because no other big role in that book suited him.