E46 320d Turbo boost problems

So i have a 2004 320d e46 and my turbo works. I can be driving and all of a sudden it stops boosting. When i switch the car off and then on again it will then work fine for like 5mins.

Any takers??