Thesis/Dissertation: Bc. Matej Babej: Verification of Outputs from Retrieval-Augmented Generation (RAG) Systems in Terms of Factual Accuracy
Master's thesis
Verification of Outputs from Retrieval-Augmented Generation (RAG) Systems in Terms of Factual Accuracy
Abstract
Táto diplomová práca sa zameriava na problém overovania faktickej správnosti výstupov generovaných systémami Retrieval-Augmented Generation (RAG). RAG kombinuje silné stránky veľkých jazykových modelov (LLM) a externých zdrojov znalostí, aj napriek tomu môžu výstupy obsahovať faktické chyby, známe ako halucinácie. Teoretická časť práce sa venuje architektúre RAG systémov, príčinám vzniku halucinácií …more
Abstract
This thesis focuses on the problem of verifying the factual accuracy of outputs generated by Retrieval-Augmented Generation (RAG) systems. RAG combines the strengths of large language models (LLMs) and external knowledge sources, but the outputs may still contain factual errors, known as hallucinations. The theoretical part of the thesis reviews the architecture of RAG systems, sources of hallucinations …more
Thesis description
The primary objective is to analyze and develop methods for verifying the outputs of RAG systems. The research includes an evaluation of existing fact-checking algorithms, knowledge graphs, statistical and heuristic techniques, and explores the potential of semantic analysis and other LLMs in the verification process. It contrasts manual and automated verification methods, assesses hybrid approaches that combine human oversight with machine-based techniques, and discusses their effectiveness, scalability, and robustness. The thesis also involves implementing proposed verification methods, detailing the underlying technologies and algorithms, and evaluating their performance against predefined objectives.
Expected outcomes include a practical implementation of the developed verification methods and a thorough analysis of the results. The thesis will conclude with recommendations for improving RAG system reliability and propose potential avenues for future research in the verification of AI-generated outputs.
29/5/2025 09:08, RNDr. Marek Kumpošt, Ph.D., UČO 44545
ČSN ISO 690-compliant citation record
Theses on a related topic
List of theses with an identical keyword.
-
Civil control of politicians in the Visegrad countries: A contribution to research of new transactional activism in digital era.
Mgr. David Kopecký, UČO 363936 -
Knowledge Graphs and Explainable Predictive Models for Drug Repurposing
Mgr. Klára Petrovičová -
Text-Enhanced Relational Learning for Drug Repurposing
Mgr. Marek Toma, UČO 485275 -
Dezinformation as a part of Civics Curiculum
Mgr. Lucie Šikutová -
Private LLM for querying internal documentation and knowledge base
Bc. Jakub Medovič -
Fact-checking of the Election Debates of Donald Trump and Joe Biden in the 2020 Presidential Election
Bc. Zuzana Králová -
Disinformation as a fashionable topic – domain analysis of platforms fighting disinformation
Mgr. Ondřej Beran -
Information Behavior of Fact-Checkers
Mgr. Barbora Šambergerová




