18. A Perfect Match
Artificial Intelligence
Machine Learning
Information Architecture
Data Architecture
18
Neo4j Inc. All rights reserved 2024
LLM
Knowledge
Graph
Linguistic
Pattern
Matching
Hierarchical
Emergent
Features
19. Could this be vector search?
Artificial Intelligence
Machine Learning
Information Architecture
Data Architecture
19
Neo4j Inc. All rights reserved 2024
LLM
Knowledge
Graph
Linguistic
Pattern
Matching
Hierarchical
Emergent
Features
20. Why RAG With Vector Databases Fall Short
1
3
2
4
Similarity is insufficient for rich enterprise reasoning
Only leverage a fraction of
your data: Beyond simple
“metadata”, vector databases
alone fail to capture relationships
from structured data
Miss critical context: Struggle to
capture connections across
nuanced facts, making it
challenging to answer multi-step,
domain-specific, questions
Vector Similarity ≠ Relevance:
Vector search uses an incomplete
measure of similarity. Relying on it
solely can result in irrelevant and
duplicative results
Lack explainability:
The black-box nature of
vectors lacks transparency
and explainability
20 Neo4j Inc. All rights reserved 2024
Neo4j Inc. All rights reserved 2024
20
21. What is a Knowledge Graph?
An information architecture with layered connections.
21 Neo4j Inc. All rights reserved 2024
Neo4j Inc. All rights reserved 2024
21
DATA INFORMATION KNOWLEDGE INSIGHT MEANING
records sets relationships patterns layers
22. Neo4j Inc. All rights reserved 2024
22
RAG with Neo4j
Find similar documents,
content and data
Expanded context for
related information and
ranking results
Improve GenAI inferences
and insights. Discover new
relationships and entities
Unified search, knowledge graph and data science
capabilities to improve RAG quality and effectiveness
Vector Search,
Full-text Search,
Geospatial,
Pattern match
Data Science
Knowledge
Graph
23. Knowledge Graph
Complementary
Benefits
Neo4j Inc. All rights reserved 2024
23
LLM
Human
Application
Knowledge
Graph
Extend LLM
knowledge
through RAG
Invite human
exploration &
curation
Advanced application
features & analysis
29. Neo4j Inc. All rights reserved 2024
29
Natural Language
assistants and co-
pilots,
rooted in business
policy
29
Prompt +
Relevant
Information
Embedding API LLM API
User
Database
Search
Prompt Response
Relevant Results
Knowledge
Graph
Application
30. Integrate with the
GenAI Ecosystem
30 Neo4j Inc. All rights reserved 2023
GenAI Stack
Application
Generative AI & Embedding Models
Orchestration
Grounding Knowledge Graph
Neo4jGraph
Neo4jVector
GraphCypherQAChain
Neo4jGraphStore
Neo4jVectorStore
KnowledgeGraphIndex
Neo4j GenAI Integrations
Text | Chat | Embedding
NL Query | Image Gen
Neo4j Drivers
Java
Python JavaScript
Call LLM APIs natively via
Cypher using our open-
source APOC library
Integrate Neo4j with leading LLM
open-source frameworks such as
LangChain and LlamaIndex
Agnostic LLM orchestration
connecting graphs to OpenAI,
AWS Bedrock, GCP Vertex AI,
Azure, Anthropic, Hugging Face,
and other proprietary and open
source foundation models