All the stories you hear he was so temperamental but in that moment he really lost his head.

Are you working? If yes, he is an asshole. If no, and you are not actively searching for employment or assistance then you are the asshole.

Imagine the roles switched and the optics of coming home after your second job and he is sitting on the couch.