Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mutltimodal AI Companion for Interactive Fairytale Co-creation   AI fairy tale companions play an important role in early childhood education
as an augmentation for parents' efforts to close the participation gap and
boost kids' mental and language development. Existing systems are generally
designed to provide vivid materials as unidirectional entertaining reading
environments, e.g, visualizing inputting texts. However, due to the limited
vocabulary of kids, these systems failed to afford effective interaction to
motivate kids to write their own fairy tales. In this work, we propose AI.R
Taletorium, an illustrative, immersive, and inclusive multimodal AI companion,
for interactive fairy tale co-creation that actively involves kids to create
fairy tales with both the AI agent and their normal peers. AI.R Taletorium
consists a neural story generator and a doodler-based fairy tale visualizer. We
design a character-centric bidirectional connection mechanism between the story
generator and visualizer equipped with Contrastive Language Image Pretraining
(CLIP), thus enabling kids to participant in the story generation process by
simple sketching. Extensive experiments and user studies show that our system
was able to generate and visualize meaningful and vivid fairy tales with
limited training data and complete the full interaction cycle under various
inputs (text, doodler) through the bidirectional connection.

10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
37
The categories of this paper are: supr-con