A Novel Deep Learning Architecture for Wireless Image Transmission

Abstract

In this paper, the problem of neural compression based image transmission over wireless channels is studied. Since all procedures are considered over wireless links, the quality of training is affected by wireless factors such as packet errors. In the considered model, compressed data given by the neural source encoder (NSE) are fed into an error-control channel encoder and modulated as discrete symbols sent over a memoryless channel. In the receiving end, the channel decoder and the neural source decoder (NSD) forms an iterative structure to reconstruct the original image. Since all neural compressed data are transmitted over wireless channels, the training of NSD is affected by wireless channel factors such as residual bit errors given by the channel decoder. Meanwhile, during outer-loop iterations, the NSD needs to match the variant of information reliability output by the channel decoder so as to build a global optimal receiver. To this end, a refiner neural network is first attached after the NSD to adjust its output as the format of a priori information sent into the channel decoder. Then, the extrinsic information transfer (EXIT) functions of channel decoder and NSD are derived. At each iteration, the reliability of messages sent into the NSD is explicitly predicted by using the EXIT chart. By this means, the NSD can be trained in a residual bit error aware manner, and we realize a joint learning and iterative decoding framework to ensure the quality of neural image transmission over realistic wireless channels.

Publication
IEEE Global Communications Conference (GLOBECOM), 2021
Sixian Wang
Sixian Wang
Ph.D Student

My research focuse on semantic communications, source and channel cod- ing, and computer vision.

Jincheng Dai
Jincheng Dai
Supervisor
Shengshi Yao
Shengshi Yao
Ph.D Student

My research focuse on semantic communications, source and channel cod- ing, and computer vision.

Kai Niu
Kai Niu
Professor

Related