I agree with Dezz..
If you're hearing the turbo spinning up, that's not unusual. They spin up to 30,000rpms at full boost, so you can imagine that when you are just normally driving "off boost", the turbo is spinning around 2000-5000rpms... it's going to be audible.
If you push the accelerator in halfway, you are likely to hear the turbo building up speed before it actually spins so fast that it's putting more air in the engine than the intake would normally suck in.
Totally normal, basically =-]
(mine does it. Especially first thing on a cold morning... I can't go over 1500-2000rpms without it spooling up on its own... in granny mode)