Stepping up to a 3.5" catback would definitely help, but the biggest benefit would be to transition up to 3.5" directly off of the turbo and run a full 3.5". Having a large downpipe right off the v-band will make the biggest improvement performance, and help it spool faster as well.
A full 3" on a turbo 6.0L is just too IMO. I have a very quiet 3.5" exhaust on my turbo FC and had no issues making over 700whp.
Here's a good video showing the differences in downpipe size on a turbo LS on the dyno. The 3.5" had most of the benefits of the 4".