The BourneForgeAI Principles for Reliable AI Practice
By Mark Bourne
“The objective is not to make AI sound intelligent. The objective is to build systems in which intelligence produces dependable results.”
We began this article with a simple question:
What actually improves AI results?
At first, the obvious answer appears to be prompts.
Better instructions certainly help.
Providing context helps.
Defining the audience helps.
Specifying the required output helps.
Examples help.
But as soon as AI is used for serious work, the limits of prompt-centric thinking become apparent.
The most substantial improvements rarely come from discovering a particular phrase or clever instruction.
They come from improving the system around the model.
- Planning before generating.
- Providing better context.
- Breaking complex work into stages.
- Generating alternatives.
- Challenging assumptions.
- Introducing independent review.
- Verifying important claims.
- Keeping humans responsible for consequential decisions.
- Recording what worked.
- Improving the workflow.
The lesson is straightforward:
Reliable AI is primarily a systems problem, not a prompting problem.
That conclusion leads to a set of principles that summarise the BourneForgeAI approach to practical AI.
Start with the Objective, Not the Prompt
Before asking how to prompt the AI, determine what successful completion actually means.
This sounds simple. It is not.
Poorly defined objectives are responsible for a surprising amount of disappointing AI output.
Consider:
Research artificial intelligence.
There is almost no meaningful definition of success.
Compare that with:
Explain the operational risks of introducing generative AI into a small software development team, concentrating on code quality, security, privacy, and maintainability.
The second objective establishes boundaries.
The AI now has a destination.
This leads to the first principle:
Define success before designing the interaction.
If the objective is ambiguous, prompt optimisation merely produces more sophisticated ambiguity.
Give the AI the Context It Needs — and No More
AI cannot reliably reason about information it does not have.
When important context is missing, models attempt to bridge the gap. Sometimes they infer correctly. Sometimes they do not.
Providing relevant context therefore improves performance.
But more context is not automatically better.
Large amounts of irrelevant information can obscure the important material and make evaluation more difficult.
The goal is not maximum context. It is appropriate context.
Ask:
- What does the AI need to know?
- Which documents are authoritative?
- Is any information outdated?
- Are important constraints missing?
- Does conflicting information exist?
Context should be treated as an engineered input rather than miscellaneous background material.
Decompose Complex Work
Complex tasks become more reliable when divided into stages.
Instead of:
Research, design, implement, test, document and review this application.
Use a process:
- 1Requirements.
- 2Architecture.
- 3Implementation.
- 4Testing.
- 5Review.
- 6Documentation.
Each stage has a narrower objective. Each can be inspected independently. Each can fail without necessarily invalidating everything else.
This is decomposition—a principle used throughout computing and engineering. AI benefits from it for exactly the same reason.
Complexity becomes manageable when systems are divided into understandable components.
Separate Creation from Evaluation
Generation and criticism are different activities.
Trying to perform both simultaneously often weakens each.
A better workflow creates first and evaluates second.
For example:
- 1Draft the architecture.
- 2Review the architecture for scalability problems.
- 3Review it independently for security weaknesses.
- 4Identify unnecessary complexity.
Each review approaches the same artefact from a different perspective.
This resembles professional engineering review.
The person—or model—creating something is not assumed to have identified every weakness while creating it.
Generation produces candidates. Evaluation determines whether they are good enough.
Compare Alternatives Before Committing
The first plausible solution is rarely guaranteed to be the best solution.
AI makes generating alternatives inexpensive.
Use that capability.
Instead of asking:
What architecture should I use?
consider:
Produce three materially different architectures optimised respectively for simplicity, resilience, and cost.
Now trade-offs become visible.
Perhaps the simplest architecture is sufficient.
Perhaps additional resilience justifies the complexity.
Perhaps the lowest-cost design introduces unacceptable operational risk.
Alternatives expose choices. Choices expose trade-offs. Trade-offs improve decisions.
Design for Failure
AI will make mistakes.
This should not be controversial.
Humans make mistakes.
Software contains defects.
Networks fail.
Hardware fails.
Databases fail.
Distributed systems fail in extraordinarily imaginative ways.
Professional engineering does not respond by assuming failures can somehow be eliminated completely.
It designs systems capable of detecting and recovering from them.
AI deserves the same treatment.
Ask:
- What happens if the answer is wrong?
- How would we detect that?
- Can the action be reversed?
- Should the workflow stop?
- Should another model review it?
- Should a human intervene?
The objective is not perfect AI.
The objective is resilient AI-assisted systems.
Match Oversight to Consequence
Not every AI action deserves the same level of supervision.
Generating alternative headings for an article is low risk. Deleting production data is not.
A sensible workflow therefore scales oversight according to consequence.
Low-risk tasks may be automated extensively. Medium-risk tasks may require verification. High-risk or irreversible actions should require explicit human authority.
This prevents two opposite mistakes.
The first is excessive automation.
The second is excessive supervision that removes the productivity benefits of AI altogether.
The correct level lies between them.
Human involvement should concentrate where judgement and accountability matter most.
Measure the Process, Not Just the Answer
An impressive answer does not necessarily indicate a good system.
Suppose Workflow A produces an excellent result but requires:
- fifteen prompts,
- repeated corrections,
- extensive manual editing,
- several factual repairs.
Workflow B produces an equally useful result with:
- a clear objective,
- three structured stages,
- one review,
- minimal editing.
The outputs may appear similar. The workflows are not.
Professional evaluation therefore includes:
- quality,
- time,
- effort,
- repeatability,
- error rate,
- cost,
- maintainability.
The final answer is only one metric.
Record What Actually Changed the Result
This principle returns directly to the title of this article.
When an experiment improves performance, identify why.
- Did adding context improve accuracy?
- Did defining the audience improve clarity?
- Did generating an outline improve structure?
- Did independent review identify errors?
- Did switching models improve anything?
- Did dividing the task reduce corrections?
Without recording these observations, valuable lessons disappear.
With documentation, individual experiments accumulate into knowledge.
This is the difference between:
“That seemed to work.”
and:
“We have repeatedly observed that this workflow produces better results under these conditions.”
The second statement is vastly more useful.
Treat AI Workflows as Living Systems
No workflow should be considered permanently finished.
Models change.
Tools improve.
Requirements evolve.
New failure modes appear.
Processes that were necessary with one generation of AI may become redundant with another.
Other controls may become more important as autonomy increases.
Workflows therefore need maintenance.
- Review them.
- Measure them.
- Simplify them.
- Strengthen weak stages.
- Remove unnecessary stages.
- Add safeguards where experience demonstrates they are required.
A mature AI workflow is not a static collection of prompts.
It is a living system.
The BourneForgeAI Workflow Checklist
The principles above can be converted into a practical checklist.
Before beginning an important AI-assisted task, ask:
Objective
- What exactly are we trying to achieve?
- Who is the intended audience or user?
- What would a successful result look like?
- What constraints must be respected?
Context
- What information does the AI require?
- Which sources are authoritative?
- Is the information current?
- Is anything important missing?
- Is unnecessary context being included?
Workflow
- Can the task be divided into stages?
- Should planning occur before generation?
- Where should alternatives be explored?
- Which stages require separate review?
Model and Tools
- Which model is appropriate for this stage?
- Would another model provide useful independent review?
- Does the AI require external tools or retrieval?
- Does it have more access than necessary?
Verification
- Which claims require checking?
- What assumptions should be challenged?
- What are the likely failure modes?
- How will errors be detected?
Human Oversight
- Which decisions require human judgement?
- Which actions have significant consequences?
- Which actions are irreversible?
- Where should approval gates exist?
Evaluation
- Was the result accurate?
- Was it complete?
- Was it useful?
- How much human correction was required?
- Was the process efficient?
- Could the result be reproduced?
Improvement
Finally ask:
What actually changed the result?
Record the answer. Then incorporate that lesson into the next workflow.
That final step turns experimentation into engineering.
About This Book
This page is part of Prompt and Workflow Experiments: What Actually Improves AI Results?, an eight-chapter deep dive on reliable AI engineering.
More from the Notes
Short technical notes and observations, written up as experiments produce something worth documenting.
Was this useful?
Published