Knowledge
Why Ontology Matters for AI Systems
7 min read · AI Platform Architecture Studio
Ontology is the structure of your domain's knowledge. Not the data you have — the concepts, relationships, and claims that are true in your domain and the structure that connects them. AI agents need this structure to reason reliably. Without it, they reason from noise.
The difference between data and knowledge
You have data. Every organization does. Databases, documents, emails, spreadsheets, CRM records. Data is raw — it records what happened without necessarily encoding why it matters or how it connects to anything else.
Knowledge is structured data — data organized around concepts, with relationships defined, with claims sourced and validated. An ontology defines what concepts exist, how they relate, and what claims are made about them. It's the difference between a pile of facts and a navigable understanding of a domain.
Why agents need ontology
Language models can reason, but they reason from what's in context. If you give an agent unstructured text, it reasons from unstructured text — and produces output that reflects the ambiguity of the input. Hallucination isn't primarily a model quality problem; it's a context quality problem.
A well-designed ontology gives agents structured context. Instead of "here is a pile of documents about our products," an ontology gives agents: "here are the products (entities), here are their properties (attributes), here are the relationships between them (edges), here are the claims we make about them (assertions), and here are the sources for those claims." That structure enables reliable reasoning.
What a domain ontology actually includes
Entity types — the classes of things that exist in your domain. For a software company: Product, Feature, Customer, Integration, Incident. For a financial firm: Instrument, Strategy, Position, Signal, Risk Factor.
Relationships — how entities connect. A Product has many Features. A Customer subscribes to a Product. An Incident affects a Feature. These aren't database foreign keys — they're semantic relationships that carry meaning.
Attributes — the properties of each entity type. What can be said about a Product? Name, status, pricing model, supported integrations, known limitations. These attributes become the retrieval targets for agents.
Claims and sources — the assertions made about entities, with provenance. "This product supports SSO" is a claim. The source might be the product documentation. Claims can be contested, deprecated, or conditioned on version.
How to start
Don't start with data. Start with the questions an agent in your domain needs to answer reliably. What does a customer service agent need to know? What does a research agent need to retrieve? What does an analysis agent need to compare?
Work backwards from those questions to the concepts and relationships required to answer them. That's your initial ontology. Build the data structure around it — not the other way around.
Related
Knowledge graph design.
We design domain ontologies and knowledge graphs as fixed-scope engagements.
See services →