Official Repo of the "Language Models and Structured Knowledge in AI" Talk at the 4th Inria-DFKI European Summer School on AI (IDESSAI 2024).

Content

 

Solution notebook can be found here.

Theoretical Part:

• 🦜 Overview of integrating LLMs with structured knowledge (graphs)
• 🧩 Knowledge graphs as both input and output for LLMs
• 🚀 Utilizing knowledge graphs during training and inference phases
• 🏅 Enhancing knowledge graphs with LLMs and improving LLMs through knowledge graphs

Hands-on Part:

• 📚 PART I: Retrieval-Augmented Generation (RAG) RAG System
• 🕸️ PART II: RAG with Knowledge Graphs & Cypher Query Language
• 🤖 PART III: LLM-Derived Cypher Queries (Text2Cypher RAG)
• 🧠 PART IV: LLM-Derived Knowledge Graphs (GraphRAG)

You can give anonymous feedback at tellonym.me/llmsummerschool

References

Surveys

• Unifying Large Language Models and Knowledge Graphs: A Roadmap (Pan et al., 2023)
• Graph Machine Learning in the Era of Large Language Models (Fan et al., 2024)

Tutorials

• KDD'24 Tutorial - Tutorial on Graph Reasoning with LLMs (GReaL)
• ArangoDB - LLMs With Knowledge Graph (YouTube)
• AI Engineer World's Fair 2024 - Talk by Emil Eifrem (highly recommended)
• Neo4j Graphacademy
• ACL 2023 Tutorial: Complex Reasoning in Natural Language (Wenting Zhao)

All

• Exploring Large Language Models for Knowledge Graph Completion (Yao et al., 2024)
• Iterative Zero-Shot LLM Prompting for Knowledge Graph Construction (Carta et al., 2023)
• KGLens: Towards Efficient and Effective Knowledge Probing of Large Language Models with Knowledge Graphs (Zheng et al., 2023)
• Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning (Luo et al., 2024)
• Graph Language Models (Plenz et al., 2024)
• Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofitting (Guan et al., 2023)
• SKILL: Structured Knowledge Infusion for Large Language Models (Moiseev, 2022)
• Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering (Baek et al., 2023)
• From Local to Global: A Graph RAG Approach to Query-Focused Summarization (Edge et al., 2024)
• HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extraction (Sarmah et al., 2024)