Infrastructure for Deploying Large Language Models in Chatbots with Retrieval-augmented Generation

Jordan Kralev 1,2), Svetla Koeva 2)

1) Faculty of Automatics, Department of Systems and Control,
Technical university – Sofia
2) Institute for Bulgarian Language Prof. Lyubomir Andreychin,
Bulgarian Academy of Sciences (Bulgaria)

https://doi.org/10.53656/math2025-5-4-idl

Abstract. The article presents an infrastructure that integrates freely available tools and large language models into a personalized chatbot. The aim is to show how large language models can be used with affordable graphics processors and what possibilities exist to enrich user queries with additional context depending on the objective and area of application. Working with pre-trained large language models will be demonstrated using RAG (Retrieval-Augmented Generation) technology for Bulgarian to solve a specific task in a particular thematic domain. The chosen task is document summarization, and the domain is science and education. The presented solution can also be used to create other applications for the Bulgarian language.
Keywords: large language models; artificial intelligence; chatbots

Свързани статии:

The Use of Artificial Intelligence in Teaching Bulgarian as a Foreign Language Perception and Evaluation of Text from an Interview with a Real Person and an Interview with an Artificial Intelligence Artificial Intelligence In Scientific Research The Artificial Intellect in the Education of the Future