Institutional-Repository, University of Moratuwa.  

Development of digital storytelling platform for children based on emotions

Show simple item record

dc.contributor.author Vijayakumaran, T
dc.contributor.author Thavachelvam, T
dc.contributor.author Gnaeswaran, A
dc.contributor.author Sandanayake, TC
dc.contributor.author Sumathipala, K
dc.contributor.author Bandara, S
dc.contributor.editor Ganegoda, GU
dc.contributor.editor Mahadewa, KT
dc.date.accessioned 2022-11-09T06:18:05Z
dc.date.available 2022-11-09T06:18:05Z
dc.date.issued 2021-12
dc.identifier.citation T. Vijayakumaran, T. Thavachelvam, A. Gnaeswaran, T. Sandanayake, K. Sumathipala and S. Bandara, "Development of Digital Storytelling Platform for Children based on Emotions," 2021 6th International Conference on Information Technology Research (ICITR), 2021, pp. 1-6, doi: 10.1109/ICITR54349.2021.9657431. en_US
dc.identifier.uri http://dl.lib.uom.lk/handle/123/19434
dc.description.abstract Storytelling is one of the means to make Gen Alpha children attractive to books. This is becoming a challenging task for parents, as they have to spend time telling stories to children. This research proposed a system that can emotionally tell stories as a human storyteller tells stories with twists and suspense. This research involves the implementation of technologies related to Natural Language Processing and Deep Learning, especially the inclusion of Convolutional Neural Networks, Transformers. Camera images of the storybook are the input for optical character recognition (OCR) of the Storybook. Here, various complex algorithms are used throughout the processes of optical character recognition (OCR), sentence-level contextual emotion recognition(CER), and emotional text to speech(TTS) synthesis to implement the Emotional digital storyteller. In addition, immense testing is carried out to explore the effectiveness and characteristics of the implemented model. We achieve 75% and 72.09% accuracy in OCR and CER respectively and MOS values of 3.85 and 1.65 in neutral and emotional TTS respectively. The experiment results show that each model performs well in the children's domain, specifically storytelling books. en_US
dc.language.iso en en_US
dc.publisher Faculty of Information Technology, University of Moratuwa. en_US
dc.relation.uri https://ieeexplore.ieee.org/document/9657431 en_US
dc.subject Children emotion recognition en_US
dc.subject Storytelling en_US
dc.subject Text detection en_US
dc.subject Text to speech en_US
dc.title Development of digital storytelling platform for children based on emotions en_US
dc.type Conference-Full-text en_US
dc.identifier.faculty IT en_US
dc.identifier.department Information Technology Research Unit, Faculty of Information Technology, University of Moratuwa. en_US
dc.identifier.year 2021 en_US
dc.identifier.conference 6th International Conference in Information Technology Research 2021 en_US
dc.identifier.place Moratuwa, Sri Lanka en_US
dc.identifier.proceeding Proceedings of the 6th International Conference in Information Technology Research 2021 en_US
dc.identifier.email *** en_US
dc.identifier.doi 10.1109/ICITR54349.2021.9657431 en_US


Files in this item

This item appears in the following Collection(s)

  • ICITR - 2021 [39]
    International Conference on Information Technology Research (ICITR)

Show simple item record