According to this o obituary, his maternal grandfather wasn't rich. He retired in 1980 and spent most of his time in the South of Portugal (the Algarve) where he had a house. I think Tom mentioned in some interviews the happy memories of his summer holidays in Portugal with his sisters. He died in January 1999. So if there's an inheritance, it should be in 1999.