Page 61 - ITU Journal, ICT Discoveries, Volume 3, No. 1, June 2020 Special issue: The future of video and immersive media

ITU Journal: ICT Discoveries, Vol. 3(1), June 2020

used for the exhibition, Kirari! for Arena can also be that consists of four displays and four half-mirrors,
constructed with it to reconstruct the direction of compared with existing presentation devices
sound. containing many projectors and special optical
devices. Kirari! for Arena is realized by combining
Table 3 – List of ILE requirements and conformance status of
Kirari! for Arena functions for real-time image extraction, object
tracking, synchronous media transport, and depth
Kirari!
No. Requirements Manda for Arena expression. Item-wise evaluation shows that it

-tory
conforms to ITU-T H.430. Further standardization
1 Life-size display work on ILE and collaboration with related
2 Direction of sound ✔ ✔ standardization bodies are required.
3 Atmosphere reconstruction ✔ (5.1) REFERENCES
4 Spatial reconstruction ✔ ✔ (4.6) [1] J. Nagao, H. Miyashita, T. Sano, K. Hasegawa, T.
5 Synchronous representation ✔ ✔ (4.5) Isaka (2019), “Kirari! for Arena : Real-Time
6 Augmented information Remote Reproduction of 4-Directional Views
7 Real-time object extraction ✔ ✔ (4.3) with Depth Perception,” Journal of the
8 Spatial object information ✔ (4.4) Imaging Society of Japan, Vol. 58, Issue 3.
9 Synchronous transmission ✔ ✔ (4.5) [2] Recommendation ITU-T H.430.1 (2018),
10 Data storage Requirements for immersive live experience
11 Reconstruction processing ✔ ✔ (4.6) (ILE) services.
12 Auditory lateralization
13 Video stitching [3] Recommendation ITU-T H.430.2 (2018),
Architectural framework for immersive live
5.2 Discussion on further study experience (ILE) services.

Although Kirari! for Arena conforms to ITU-T H.430, [4] Recommendation ITU-T H.430.3 (2018),
it has several aspects to be improved because it was Service scenario of immersive live experience
an experimental development. First, it was not life- (ILE).
size. Second, auditory lateralization should be
integrated for a stronger sense of reality. Past [5] Recommendation ITU-T H.430.4 (2019),
Kirari! events proved their feasibility and Service configuration, media transport
effectiveness [20]. Augmented information may protocols and signalling information of MMT
also enhance the audience experience. These issues for Immersive Live Experience (ILE) systems.
would require further research and development to [6] Dolby 3D. 2018. Retrieved from
determine the appropriate methods for real-time http://www.dolby.com/us/en/technologies
transport and processing. Data storage and video /dolby-3d.html.
stitching may also be integrated wherever such
functions are necessary. [7] RealD. 2019. Retrieved from
http://reald.com/.
On the standards side, it may be worth considering TM
standardizing issues such as reference models of [8] XPANDVISION 3D Cinema. 2019. Retrieved
presentation environments. Further collaborations from http://xpandvision.com/cinema/.
with immersive service-related standardization [9] 4DX. 2019. Retrieved from
bodies, such as ISO/IEC JTC1, especially MPEG, http://www.cj4dx.com/.
3GPP, and DVB, also need to be continued.
[10] Media Mation MX4D. 2019. Retrieved from
6. CONCLUSION http://mx-4d.com/.

ILE services can bring people unprecedented [11] Y. Mizushina, W. Fujiwara, T. Sudou, C. L.
experiences. This article introduced Kirari! for Fernando, K. Minamizawa, S. Tachi (2015),
Arena as one implementation of ILE, which “Interactive instant replay: sharing sports
reconstructs the atmosphere of sports or experience using 360-degrees spherical
entertainment events using a four-sided display and images and haptic sensation based on the
depth expression to provide audiences anywhere in coupled body motion,” AH ’15.
the world with a highly realistic sensation. The
display device has a relatively simple configuration

© International Telecommunication Union, 2020 39