Design optimization of low latency transmission based on Hi3559 video platform

In accordance to the problem of high latency in H.264/H.265 video transmission schemes, research was conducted on the design optimization scheme for H.264/H.265 low latency transmission based on the analysis of video data flow and encoding and decoding processes. Image acquisition and encoding time was optimized by reducing the number of reading and writing operations in the video cache pool, increasing the input image frame rate, using multi-encoder encoding in parallel, etc. Image encoding and display time was optimized by methods such as network data transmission delay optimization, multi-encoder parallel decoding, decoding and display delay optimization, decoding data path optimization, and display output optimization. The experimental results show that the optimal solution is to use VI (Video Input), VPSS (Video Processing Sub-System), VENC (Video Encoder) binding and online mode at the encoding end, and use VDEC (Video Decoder), VPSS, VO (Video Output) binding and direct mode, with an end-to-end display delay of 2-4 frames, which greatly reduces the delay of H.264/H.265 video transmission.