Well, a sudden drop in boost is probably one of two things - boost leak or lack of fuel. Given that your clamps/boots were tight, you don't have a wastegate, and this doesn't happen all the time; I'd guess it was a momentary lack of fuel. It could be the lift pump, the injection pump, or the EZ. I mention the EZ because it might be failing in such a way that the ECM is seeing an overboost situation and momentarily cutting back the fuel. You might check for codes. Also check all of your electrical connections to the above mentioned items.
When I'm in a high boost situation and have to let off the accelerator quickly and fully, I'll occasionally experience a turbo surge or bark. The turbo is actually spinning backwards when this sound is made.
So based on your comments, I'd say you are experiencing some sort of momentary defueling situation.
Steve