Page 39 - Kaleidoscope Academic Conference Proceedings 2021

object but receives motion information from the projected REFERENCES
pattern. Since the color and form components are stationary,
they are physically inconsistent with the motion component. [1] M. Nakano, A. Kimura, T. Yamada, and N. Ueda,
However, when the brain integrates color, form, and motion “Baxter Permutation Process,” Proc. of the 34th
into a coherent scene representation, it automatically Conference on Neural Information Processing
resolves such inconsistency across attributes. Thanks to this Systems (NeurIPS 2020), Dec. 2020.
correction process, human observers perceive the pattern
produced by Hengento as if the color and form components [2] Y. Ohishi, A. Kimura, T. Kawanishi, K. Kashino,
of the static object were moving along with the projected D. Harwath, and J. Glass, “Pair Expansion for
grayscale movements. Unlike typical projection mapping, Learning Multilingual Semantic Embeddings using
Hengento works well with a wide range of projection Disjoint Visually-grounded Speech Audio
conditions under natural ambient illumination. With this Datasets,” in Proc. Interspeech 2020.
technology, a hanging portrait may suddenly smile back at
you. [3] Wearable Acoustic Sensor Array System Featuring
Remote Transmission of Body Sounds:
More recently, another illusion-based technique named http://www.brl.ntt.co.jp/E/2020/11/latest_topics_2
Danswing Papers (Danswing is a combined word of dance 02011171924.html.
and swing) was proposed [14]. Here, by adding particular
patterns of luminance contours to a printed object and by [4] Y. Okumura, Y. Kanakogi, T. Kobayashi, and S.
placing it on a display with dynamic luminance changes, the Itakura, “Ostension Affects Infant Learning More
printed object appears to move. While the illusion of motion Than Attention,” Cognition, Vol. 195, 104082, Feb.
in the previous approach was restricted to rectangles, the new 2020.
technique is applied to objects with complex shapes.
Moreover, it can give the impression of an object having not [5] T. Hattori, T. Kobayashi, S. Fujita, Y. Okumura,
only horizontal translations but also rotations and expansion. and K. Aoyama, “Pitarie: Picture Book Search with
Danswing Papers were nominated as one of the top 10 Interdisciplinary Approach,” NTT Technical
finalists at the Best Illusion of the Year Contest in 2018. For Review, Vol. 14, No. 7, 2016.
those interested in illusions, the “Illusion Forum” website
provides information on a variety of illusions that can make [6] Press release issued by NTT, “AI Achieved a Score
people doubt their own eyes and ears [15]. of 185 on the English Written Exam of the National
Center Test for University Admissions in 2019,”
Nov. 18, 2019:
https://www.ntt.co.jp/news2019/1911e/191118a.ht
ml.

[7] R. Higashinaka, M. Mizukami, H. Kawabata, E.
Yamaguchi, N. Adachi, and J. Tomita, “Role play-
based question-answering by real users for building
chatbots with consistent personalities,” in Proc. 19th
Figure 10 – Danswing Papers Annual SIGdial Meeting on Discourse and
Dialogue, 2018.
7. CONCLUSION
[8] Press release issued by NTT, “Starting a Joint
In this article, I introduced key activities at NTT CS Labs in Experiment with Seika Town on a Conversational
pursuit of the essence of communication with the aim of AI System,” July 3, 2020 (in Japanese):
achieving communication that reaches the heart, or more https://www.ntt.co.jp/news2020/2007/200703a.ht
exactly, that reaches out and touches someone’s heart. The ml.
way we interact with other people is changing due to
countermeasures and restrictions related to the COVID-19 [9] Mega-Futuristic Experiential Public Telephone
pandemic. It is especially necessary at this time to pursue the (versions 3 and 4) @ Niconico Chokaigi 2015:
possibilities of new media that leverage the five senses while https://youtu.be/O7VZ7TMWmPs.
identifying and solving any problem that may arise in this
pursuit. We should challenge the so-called technical limits [10] Tactile TV:
toward approaching human intelligence and, at the same time, https://www.ntticc.or.jp/en/archive/works/tactile-tv/.
strive to obtain a new understanding of what it means to be
human by incorporating diverse points of view from the
social sciences, philosophy, and other fields.

– xxxv –