Závěrečná práce: Bc. Matej Babej: Verification of Outputs from Retrieval-Augmented Generation (RAG) Systems in Terms of Factual Accuracy
Diplomová práce
Verification of Outputs from Retrieval-Augmented Generation (RAG) Systems in Terms of Factual Accuracy
Anotace
Táto diplomová práca sa zameriava na problém overovania faktickej správnosti výstupov generovaných systémami Retrieval-Augmented Generation (RAG). RAG kombinuje silné stránky veľkých jazykových modelov (LLM) a externých zdrojov znalostí, aj napriek tomu môžu výstupy obsahovať faktické chyby, známe ako halucinácie. Teoretická časť práce sa venuje architektúre RAG systémov, príčinám vzniku halucinácií …více
Abstract
This thesis focuses on the problem of verifying the factual accuracy of outputs generated by Retrieval-Augmented Generation (RAG) systems. RAG combines the strengths of large language models (LLMs) and external knowledge sources, but the outputs may still contain factual errors, known as hallucinations. The theoretical part of the thesis reviews the architecture of RAG systems, sources of hallucinations …více
Zadání práce
The primary objective is to analyze and develop methods for verifying the outputs of RAG systems. The research includes an evaluation of existing fact-checking algorithms, knowledge graphs, statistical and heuristic techniques, and explores the potential of semantic analysis and other LLMs in the verification process. It contrasts manual and automated verification methods, assesses hybrid approaches that combine human oversight with machine-based techniques, and discusses their effectiveness, scalability, and robustness. The thesis also involves implementing proposed verification methods, detailing the underlying technologies and algorithms, and evaluating their performance against predefined objectives.
Expected outcomes include a practical implementation of the developed verification methods and a thorough analysis of the results. The thesis will conclude with recommendations for improving RAG system reliability and propose potential avenues for future research in the verification of AI-generated outputs.
29. 5. 2025 09:08, RNDr. Marek Kumpošt, Ph.D., učo 44545
Citace dle normy ČSN ISO 690
Práce na příbuzné téma
Seznam prací, které mají shodná klíčová slova.
-
Text-Enhanced Relational Learning for Drug Repurposing
Mgr. Marek Toma, učo 485275 -
Knowledge Graphs and Explainable Predictive Models for Drug Repurposing
Mgr. Klára Petrovičová -
Epistemologie fact-checkingu
Bc. Eliška Míšková -
Dezinformace jako součást VkO
Mgr. Lucie Šikutová -
Private LLM for querying internal documentation and knowledge base
Bc. Jakub Medovič -
Ověřování interaktivních vlastností komponentových systémů
RNDr. Nikola Beneš, Ph.D., učo 72525 -
Disinformation as a fashionable topic – domain analysis of platforms fighting disinformation
Mgr. Ondřej Beran -
Using knowledge graphs for predicting food supplement interactions with drugs
Mgr. Markéta Křenková




