DACNN-aided nonlinear equalizer for a probabilistic shaping coherent optical communication system

The probabilistic shaping (PS) technique is a key technology for fiber optic communication systems to further approach the Shannon limit. To solve the problem that nonlinear equalizers are ineffective for probabilistic shaping optical communication systems with non-uniform distribution, a distribution alignment convolutional neural network (DACNN)-aided nonlinear equalizer is proposed. The approach calibrates the equalizer using the probabilistic shaping prior distribution, which reduces the training complexity and improves the performance of the equalizer simultaneously. Experimental results show nonlinear equalization of 120 Gb/s PS 64QAM signals in a 375 km transmission scenario. The proposed DACNN equalizer improves the receiver sensitivity by 2.6 dB and 1.1 dB over the Volterra equalizer and convolutional neural network (CNN) equalizer, respectively. Meanwhile, DACNN converges with fewer training epochs than CNN, which provides great potential for mitigating the nonlinear distortion of PS signals in fiber optic communication systems.