When Matt Joyal left home as a young man, he could have taken years of unpleasant memories from his childhood with him.