A Neural Machine Translation Approach to Translate Text to Pictographs in a Medical Speech Translation System - The BabelDr Use Case

Mutal, Jonathan;Bouillon, Pierrette;Norré, Magali;Gerlach, Johanna;Ormaechea Grijalba, Lucia
(2022) 15th Biennial Conference of the Association for Machine Translation in the Americas — Location: Orlando, USA (12.September.2022)

Files

AMTA2022_Mutal_Bouillon_Norre_Gerlach_Ormaechea.pdf
  • Open Access
  • Adobe PDF
  • 1.19 MB
Download

Details

Authors
  • Mutal, JonathanUNIGE
    Author
  • Bouillon, PierretteUNIGE
    Author
  • Norré, MagaliUCLouvain
    Author
  • Gerlach, JohannaUNIGE
    Author
  • Ormaechea Grijalba, LuciaUNIGE
    Author
Abstract
The use of images has been shown to positively affect patient comprehension in medical settings, in particular to deliver specific medical instructions. However, tools that automatically translate sentences into pictographs are still scarce due to the lack of resources. Previous studies have focused on the translation of sentences into pictographs by using WordNet combined with rule-based approaches and deep learning methods. In this work, we showed how we leveraged the BabelDr system, a speech to speech translator for medical triage, to build a speech to pictograph translator using UMLS and neural machine translation approaches. We showed that the translation from French sentences to a UMLS gloss can be viewed as a machine translation task and that a Multilingual Neural Machine Translation system achieved the best results.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Mutal, J., Bouillon, P., Norré, M., Gerlach, J., & Ormaechea Grijalba, L. (2022). A Neural Machine Translation Approach to Translate Text to Pictographs in a Medical Speech Translation System - The BabelDr Use Case. Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas, 1, 252-263. https://hdl.handle.net/2078.5/213945 (Original work published 2022)