There should be no loss of power/Tq on a turbo diesel engine by upsizing the exhaust. You want the exhaut gasses to be able to have the least amount of restriction leaving the turbo, expext lower EGT's as a result. A 4" on you rig will do the job very well, a 5" would be over kill unless you are looking for a deeper sound.
SR