As mentioned in this biography. maybe it was his "truculent demeanor and raspy voice" that turned you off, Mike.
But he did turn in some great performances in various roles. I really liked his acting in "Anatomy of a Murder", "Patton", "The Hustler" and "The New Centurions", even though he didn't play a very likable character in any of 'em.
On screen I could accept him in his roles it was more his off screen persona I didnt like.