Part of your answer lies in your question. "ALL" means everyone. I say that to point out that, roughly 75% of paying customers aren't true boxing fans. They're people who have the money to attend an "event". Most true fans don't have enough money to buy ringside seats and most people who can afford ringside seats aren't true fans.
Marvin Hagler once put it best. He said "people aren't interesting in skills. All they want to see is blood and knockouts". This is very true. Ever hear the occasional cry from the crowd, "Hit him!" Most people can't even see a true boxer set up punches. They can't see why a boxer would punch a certain way or target a certain area of his opponent's body. They can't see that the boxer has detected a weakness in his opponent's defense. Most don't even begin to understand the concept of defense.
It makes me sick when I'm having a conversation about boxing and some schmekel chimes in with Rocky Balboa. It's drama and the movies were "entertainment" but I can never view a Rocky movie and think of real boxing. But it's sensationalism and people eat it up. I wish all my opponents fought like Balboa, with the dramatically telegraphed punches. I'd have been undefeated too.
With Andre Ward, I think time will win over a bigger percentage of fans. It's hard to not like him and he's a breath of fresh air to the sport. He's an excellent boxer but, like Hagler, he will mature to the fans at a slower, but more certain pace.
I'm sure you've seen most of Floyd Mayweather's fights. The best example I can think of is Arturo Gatti. Take one of Gatti's action packed fights. You can even pick one he lost and you will still see that he provided the fans with a lot of action. Now, take his fight with Mayweather, which is not long after some of his best fights. Gatti certainly didn't decline much in the few years preceding his fight with Mayweather. Naturally, the Ward triolgy would take something out of any fighter but, for the most part, Gatti was still active and, against certain types, still effective.
Mayweather declared that Gatti is a "C+" fighter. It might sound mean but he was only stating a fact. By comparison, it's a mismatch. The difference wasn't the condition of the fighters. It was the skill level. Mayweather was able to hit Gatti at will and made him look like the C+ fighter he mentioned before the fight.
To be honest, I don't think it's Floyd's skill that people don't appreciate because, if you look at the Gatti fight, the Hatton fight and some of his other fights, he didn't do a lot of running. He just couldn't be hit by the opponent. I think even "casuals" can appreciate that. I think the problem with Mayweather, as far as the appreciation of fans goes, is his behavior outside the ring.
As a die-hard fan, I can appreciate the art and skill of a boxer. I can admit that there are some fighters who aren't very pleasing to watch. I'd rather gauge my eyes out than watch a John Ruiz fight. But that's me. I think most can appreciate Mayweather's skills and, in time, they will appreciate Ward as well. It's Floyd's behavior outside the ring, and the whole debacle with Pacquiao, that people are turned off by.
Still, people want to see blood and knockouts. That's just nature. Humans do have a barbaric side. But, I'd bet if you could give Mayweather's talents to a different fighter, people would appreciate that fighter as much as anyone. Mayweather has a right to make his own path. But there will always be those who aren't happy with it.