"I was the toast of the town until I became the punching bag of the press," said the old man sitting next to me at the bar that catered to day drinkers.