Page 700 - AI for Good Innovate for Impact

AI for Good Innovate for Impact

also breaks the limitations of time and space, enabling the efficient dissemination of culture
both inside and outside the museums and scenic spots.

Yi Jiang Jie is constructed and implemented based on the architecture of "Large Language
Model(LLM) + Retrieval-Augmented Generation (RAG) + Multimodal Agent". Driven by
technological innovation, the platform creates a multimodal intelligent service application.

Relying on the deeply integrated architecture of "Semantic Vector Model + Large Model
+ Knowledge Base + RAG", we've innovatively developed an intelligent Q&A system. The
cross-venue semantic vector model enables precise analysis of visitors' question intents and
generation of contextualized responses. Combined with the DeepSeek-R1 large model, it
generates professional interpretive content. Leveraging the pre-built dynamic knowledge
base and RAG, we ensure a dual improvement in the authority and naturalness of answers. It
also supports continuous multi-round in-depth interactive Q&A and personalized expression
adjustments. Moreover, by integrating visitors' behavior data to build profiles, it can achieve
intelligent adaptation for exhibit recommendations and the depth of explanations.

We've innovatively created a "voice + text + photo + location" multimodal interaction system,
integrating multimodal capabilities such as Automatic Speech Recognition (ASR), Text-to-
Speech (TTS), visual recognition, and semantic understanding. Through the RAG framework,
we achieve the coordinated operation of knowledge retrieval and response generation.

Use Case Status: The use case is in progress and part of a larger product development.

Partners

China Telecom Museum, Gansu Provincial Museum, Zunyi Conference

2�2 Benefits of the use case

1. Elevating Visitor Experience: Intelligent, Immersive Exploration

Yi Jiang Jie delivers an interactive AI-guided experience that mimics a personal tour guide,
adapting to real-time visitor needs:
Contextual, Real-Time Engagement: Leveraging real-time positioning technology, the platform
automatically triggers exhibit explanations as visitors approach, enabling seamless, on-demand
knowledge access.

Innovative Cultural Interaction: Features like AI Cultural Pass (gamified heritage exploration)
and Heritage Cosplay Experience (virtual role-playing with historical figures) blend education
with entertainment, deepening emotional connections to cultural stories.

Tailored to Curiosity: Supports natural-language Q&A, multi-turn dialogues, and personalized
route recommendations, ensuring every visitor—from casual sightseers to history enthusiasts—
finds relevance in their journey.

2. Empowering Cultural Institutions: Digital Transformation Partner

For museums and heritage sites, Yi Jiang Jie serves as a strategic technology ally:

664