dc.contributor.author |
Vijayakumaran, T |
|
dc.contributor.author |
Thavachelvam, T |
|
dc.contributor.author |
Gnaeswaran, A |
|
dc.contributor.author |
Sandanayake, TC |
|
dc.contributor.author |
Sumathipala, K |
|
dc.contributor.author |
Bandara, S |
|
dc.contributor.editor |
Ganegoda, GU |
|
dc.contributor.editor |
Mahadewa, KT |
|
dc.date.accessioned |
2022-11-09T06:18:05Z |
|
dc.date.available |
2022-11-09T06:18:05Z |
|
dc.date.issued |
2021-12 |
|
dc.identifier.citation |
T. Vijayakumaran, T. Thavachelvam, A. Gnaeswaran, T. Sandanayake, K. Sumathipala and S. Bandara, "Development of Digital Storytelling Platform for Children based on Emotions," 2021 6th International Conference on Information Technology Research (ICITR), 2021, pp. 1-6, doi: 10.1109/ICITR54349.2021.9657431. |
en_US |
dc.identifier.uri |
http://dl.lib.uom.lk/handle/123/19434 |
|
dc.description.abstract |
Storytelling is one of the means to make Gen Alpha children attractive to books. This is becoming a challenging task for parents, as they have to spend time telling stories to children. This research proposed a system that can emotionally tell stories as a human storyteller tells stories with twists and suspense. This research involves the implementation of technologies related to Natural Language Processing and Deep Learning, especially the inclusion of Convolutional Neural Networks, Transformers. Camera images of the storybook are the input for optical character recognition (OCR) of the Storybook. Here, various complex algorithms are used throughout the processes of optical character recognition (OCR), sentence-level contextual emotion recognition(CER), and emotional text to speech(TTS) synthesis to implement the Emotional digital storyteller. In addition, immense testing is carried out to explore the effectiveness and characteristics of the implemented model. We achieve 75% and 72.09% accuracy in OCR and CER respectively and MOS values of 3.85 and 1.65 in neutral and emotional TTS respectively. The experiment results show that each model performs well in the children's domain, specifically storytelling books. |
en_US |
dc.language.iso |
en |
en_US |
dc.publisher |
Faculty of Information Technology, University of Moratuwa. |
en_US |
dc.relation.uri |
https://ieeexplore.ieee.org/document/9657431 |
en_US |
dc.subject |
Children emotion recognition |
en_US |
dc.subject |
Storytelling |
en_US |
dc.subject |
Text detection |
en_US |
dc.subject |
Text to speech |
en_US |
dc.title |
Development of digital storytelling platform for children based on emotions |
en_US |
dc.type |
Conference-Full-text |
en_US |
dc.identifier.faculty |
IT |
en_US |
dc.identifier.department |
Information Technology Research Unit, Faculty of Information Technology, University of Moratuwa. |
en_US |
dc.identifier.year |
2021 |
en_US |
dc.identifier.conference |
6th International Conference in Information Technology Research 2021 |
en_US |
dc.identifier.place |
Moratuwa, Sri Lanka |
en_US |
dc.identifier.proceeding |
Proceedings of the 6th International Conference in Information Technology Research 2021 |
en_US |
dc.identifier.email |
*** |
en_US |
dc.identifier.doi |
10.1109/ICITR54349.2021.9657431 |
en_US |