I had the pleasant surprise that on my system it runs a lot smoother than 3.2, most notably when flying in cloudy weather. Then the hotfix cured the texture flickering and I'm happy now.
In my opinion, the only reason not to change is when you need a third party addon that has not been brought up to 3.3 or there are know issues with an addon that you prefer to use.
Cheers,
Mark