It was your use of the past tense "Used to like him" which suggested that he had already gone down in your estimation.
When I had to return to the UK from my first retirement in Greece, I did a stint with HMRC, and I could tell you a tale or two about people and their taxes and I have no time for people who evade paying tax, but before I throw the first stone let me run something else by you. Evading tax is breaking the law, so is speeding. How many people out there have broken the speed limit and not been caught ? Aren't they also evading paying their dues ? Sorry, this has gone way off topic.