Real Time Captioning and Notes Making of Online Classes - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2022

Real Time Captioning and Notes Making of Online Classes

Résumé

Due to the COVID-19 pandemic, all activities have turned online. The people who are hard of hearing are facing high difficulty to continue their education. So, the presented system supports them in attending the online classes by providing the real time captions. Additionally, it provides summarized notes for all the students so that they can refer to them before the next class. Google Speech to Text API is used to convert the speech to text, for providing real time captions. Three text summarization models were explored, namely BART, Seq2Seq model and the TextRank algorithm. The BART and the Seq2Seq models require a labelled dataset for training, whereas the TextRank algorithm is an unsupervised learning algorithm. For BART, the dataset is built using semi supervised methods. We evaluated all these models with rouge score evaluation metrics, among these BART proves to be best for our dataset with the following scores of 0.47, 0.30, 0.48 for rouge-1, rouge-2 and rouge-l respectively.
Fichier sous embargo
Fichier sous embargo
0 3 5
Année Mois Jours
Avant la publication
mercredi 1 janvier 2025
Fichier sous embargo
mercredi 1 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04381299 , version 1 (09-01-2024)

Licence

Identifiants

Citer

A. Vasantha Raman, V. Sanjay Thiruvengadam, J. Santhosh, Thenmozhi Durairaj. Real Time Captioning and Notes Making of Online Classes. 5th International Conference on Computational Intelligence in Data Science (ICCIDS), Mar 2022, Virtual, India. pp.207-220, ⟨10.1007/978-3-031-16364-7_16⟩. ⟨hal-04381299⟩
26 Consultations
3 Téléchargements

Altmetric

Partager

More