Well, considering the butterfly valve in the exhaust brake has pretty well closed the exhaust off, the exhaust gas leaking around the butterfly is certainly going to generate some racket. Yep, the hiss will draw some looks when idling at a traffic light, and it's perfectly normal.
Rusty