S. Schwantler, S. Klikovits, H. Metin, P. Langer, D. Bork: Talk to me! Toward Speech-based UML Modeling, In: Fill, HG., Wautelet, Y., Ralyté, J., Zdravkovic, J. (eds) The Practice of Enterprise Modeling, 18th IFIP WG 8.1 Working Conference on the Practice of Enterprise Modeling (PoEM 2025), Switzerland, Geneva, December 3-5, 2025, Lecture Notes in Business Information Processing, vol 570. Springer, Cham., pages 83-101 Doi: 10.1007/978-3-032-12063-2_6
Modelling is a core task in enterprise systems engineering. The use of graphical modelling editors, however, remains cumbersome in general and poses a significant challenge for users with disabilities. Natural language processing (NLP) and intent recognition are at the forefront of making many technologies more accessible and intuitive by allowing users to engage using natural language. This paper presents a natural language interface (NLI) for speech-based UML model interaction that leverages state-of-the-art NLP technologies to enable speech-based modelling. We provide a workflow for the creation of NLIs for modelling editors, a proof-of-concept integration of this approach into the bigUML open-source modelling editor, and an empirical evaluation that shows promising results in intent recognition, the effectiveness of model creation, and usability. Thereby, this paper makes significant contributions towards more natural, inclusive, and accessible modelling.
