All resources

Point of view

Why generic AI isn’t built for high-stakes knowledge work

Public chatbots are tuned for plausibility, not defensibility. That gap is fatal in any setting where every claim has to trace to a source.

Geoff Jackson6 min read

Every organisation with a serious knowledge base eventually asks the same question: can we use AI to make it usable? The corpus runs to thousands of pages. It sweeps in reports, contracts, research, policies, technical material and correspondence. The team needs answers from it under time pressure that wasn’t built into how the material was originally produced.

The temptation to reach for a public AI chatbot is obvious. Upload the documents, ask the question, get the answer. But generic models are tuned for plausibility — for sounding right across an enormous span of topics. That is a different objective from being defensible on a single complex knowledge base. The two look similar until you actually verify the output, and then they look very different.

Where the gap shows up

There are three failure modes we see repeatedly when teams try to use public AI tools on their own corpus. Each is small in isolation. Together they make the system unusable for the work that matters most.

1. Confident answers without sources

A generic model will tell you the policy is set out on page 47. It might. It might also be page 74, or page 47 of a superseded draft. When a specialist has to verify before relying on the claim — and they always do, because the answer goes into a board paper, a client memo, or a regulator response — the time saving evaporates. Worse: the team’s appetite to verify quietly erodes the more the model sounds right.

2. Lost context across the corpus

Real questions rarely live in one document. A clause in a contract connects to a policy, which traces back to a technical report, which was revised after an internal review. A generic chatbot stitched into a single prompt window cannot reason across that web reliably. It can summarise a document. It can’t connect the document to the rest of the knowledge base.

3. Your knowledge in someone else’s model

Uploading a corpus to a public AI tool exposes commercially sensitive, legally privileged, and reputationally significant material to infrastructure that is not yours. For some organisations this is a hard stop. For others it is a quiet liability that nobody quite owns until it becomes a problem.

What "decision-grade" looks like

The bar for serious AI is not "smarter than a free chatbot." It is "good enough that a specialist will rely on the answer without re-doing the work, and a board will accept the output without re-doing the verification."

That bar implies a different system: one that refuses to answer without a source, that reasons across the full knowledge base rather than a single document, that operates inside the organisation’s own environment, and that surfaces what it doesn’t know rather than papering over the gap. That is the system Dash is.

Generic AI optimises for plausibility. Serious knowledge work needs defensibility. They are not the same problem.

Geoff Jackson

What to look for in your stack

If you are evaluating AI for your own knowledge base — or your client’s — three properties separate the systems built for the work from the ones repurposed for it. Every answer should be traceable to a specific paragraph in a specific document. The model should run in infrastructure you control. And the system should make its own gaps legible: where it can’t answer is as valuable as where it can.

Generic AI is not a small step short of those properties. It is built for a different objective. That doesn’t make it bad — it just makes it the wrong tool for serious knowledge work. Use it where plausibility is the goal. For everything that has to survive scrutiny, build for defensibility from the first prompt.

Take the next step

Get the Dash Info Pack

A short guide on surfacing what matters in a large knowledge base — with examples of how Dash works and what a deployment looks like.