A polarization-diversity loop with a silicon waveguide with a lateral p-i-n diode as a nonlinear medium is used to realize polarization insensitive four-wave mixing. Wavelength conversion of seven dual-polarization 16-quadrature amplitude modulation (QAM) signals at 16 GBd is demonstrated with an op