I did not notice right away, but since version 8 of acrobat there is GPU hardware acceleration. For now only 2d and no CUDA or AVIVO, but still a step in right direction.
Unfortunately Adobe did not enable it by default so you need to do it.
Here are the steps to follow:
Go to Edit -> Preferences -> Page Display
If your video card is supported in the rendering section you will find “Use 2D GPU Acceleration”. Just check it as shown below and enjoy.