Overview of JPEG Pleno

JPEG Pleno provides a standard framework for representing new imaging modalities, such as texture-plus-depth, light field, point cloud, and holographic imaging. Such imaging should be understood as light representations inspired by the plenoptic function, regardless of which model captured or created all or part of the content.

The different parts of the JPEG Pleno standard are jointly designed considering their synergies and dependencies for the whole to be effectively greater than the sum of its parts. To fully exploit this holistic approach, JPEG Pleno is not just a set of efficient coding tools addressing compression efficiency. It is a representation framework understood as a fully integrated system for providing advanced functionality support for plenoptic data manipulation, metadata, random access and interaction, and various file formats. In addition, it should offer privacy protection, ownership rights, and security.

The JPEG Pleno framework is end-to-end-from the real or synthetized world to the replicated world-in its focus on harmoniously integrating all necessary tools into a single system to represent the same visual reality while considering different modalities, requirements, and functionalities.

Below the current parts of the framework are listed. The JPEG committee is still working on extensions of these parts as well as new parts focusing on objective and subjective quality assessment procedures for plenoptic modalities.

Part 1: Framework

Specifies the JPEG Pleno framework and the interrelationsships between the different components of the standard, i.e. representation of light-field, point-cloud and holographic modalities and system related aspects.

Part 2: Light Field Coding

Specifies the coding technology for light field modalities

Part 3: Conformance testing

Defines conformance testing for the standardized technologies covered by the JPEG Pleno framework.

Part 4: Reference software

Provides reference implementations for the standardized technologies within the JPEG Pleno framework for purpose of reference for prospective implementers of the standard and compliance testing.

Part 5: Holography

Specifies the coding technology for holography modalities.

Part 6: Learning-based point cloud coding

Specifies the coding technology for learning-based point cloud modalities.