I don't listen to his show, and I only know him through an occasional TV appearance on a late-night talk-show, or that "Private Parts" movie.
He might come across as a jerk in public, but then, he's in show biz, and it's part of his "shtick". But I suspect he's probably a much nicer guy in his private life.