With a 6" Vortex fan or similar.
Edit: sorry, I see that you already have a 4" fan. I have run into the same problem. Just
go to Home Depot or Lowe's and buy some ducting, and a couple of 6"-4" reducers. They
have two ends, one is 6" and of course the other is 4".