As he gears up for the annual Grand Designs Live event, the Channel 4 stalwart speaks to Adam White about Margaret Thatcher, Rachel Reeves and Britain’s ‘shameful and appalling’ housing standards, his eagerness to keep his private life private, and how he wishes people didn’t fancy him