Skip to main content
Kainotomia Innovation Technologies Contact us

Know how good the system is before your users do

We build a test set from your real cases and score the system against it. Before launch, and after every change.

It covers test sets from your cases, scoring, permission tests and regression checks.

Standard +27001ISO/IEC certified delivery on every build

What you can do

Test sets from your cases

Real questions with agreed right answers.

Scoring

Accuracy, source use and refusals, measured the same way each time.

Permission tests

Checks that nobody sees what their role does not allow.

Regression checks

The same tests after every model or data change.

The flow, end to end

01Collect real cases02Agree right answers03Run the system04Score the results05Fix and re-run06Sign the report
  1. Collect real cases
  2. Agree right answers
  3. Run the system
  4. Score the results
  5. Fix and re-run
  6. Sign the report

What you receive

Named outputs. Each one is yours to keep.

01Test set you own
02Scoring method
03Baseline report
04Permission test results
05Re-test schedule
06Release checklist

What you decide, and what we need

You decide

  • What must never be wrong
  • The pass mark
  • Who signs off
  • How often to re-test

We need from you

  • Real questions and documents
  • Experts to mark answers
  • A release owner

How we measure it

Agreed before the build. Reported after every change.

01Correct answers
02Answers backed by a source
03Correct refusals
04Access leaks found

What buyers ask us

Banks, operators and public bodies ask the same six questions.

"Can we test your AI with our own data?"

Yes. Every system ships with a test set built from your cases, and the report is yours.

"Where does our data go?"

Nowhere. Models run on your servers, a private cloud or a national cloud that you choose.

"Who is accountable for a decision?"

A person on your side. The system prepares the work. People approve what affects rights or money.

"Will we see when the model changes?"

Yes. Updates are tested on your cases first, and recorded.

"What if it fails?"

A fallback procedure is agreed before launch, and rehearsed.

"Are you certified?"

Our delivery is certified to ISO/IEC 27001 and ISO 9001:2015. We do not hold ISO/IEC 42001.

What we will not promise

A vendor who promises these has not run a model in production.

  • An AI system that never makes a mistake
  • A system nobody can attack
  • Delivery in a fixed number of weeks before we have seen your data
  • A saving we have not measured
  • Bangla results equal to English without testing them
  • AI that needs no human oversight

How it works

  1. Collect casesReal questions and documents from your work.
  2. Agree the answersYour experts confirm what is right.
  3. ScoreThe system is run against the set and scored.
  4. RepeatThe same run after every change.

What can go wrong, and what we do about it

The test set is too easy

Hard and unusual cases are added on purpose.

Scores look good but users complain

Live samples are reviewed and added to the set.

Nobody owns the result

Each release has a named person who signs the report.

How we run the project

Working software every two weeksIn your environment, not on a slide.
One delivery leadA certified lead who owns scope, time and quality.
Written scopeWhat is in, what is out and what it costs.
Security from the first sprintISO/IEC 27001 controls on every build.

Where it fits

We tell you before the project starts, not after.

Where it works well

Any AI system that answers staff, customers or regulators.

Where it works badly

Throwaway prototypes that will never reach users.

What you'll get

  • A working system on your own data
  • An accuracy report on your own cases
  • Access rules and a full audit log
  • Training for the people who will use it
  • Documents your auditors can read

How it starts

Find out if it is worth building

A short, fixed-scope review of your data, systems and rules.

  • Interviews with the people who do the work
  • Review of data and systems
  • A ranked list of use cases with effort and cost
  • A written recommendation
About this stage

See it working on your own data

A working system for one use case, built on your real data.

  • One agreed use case
  • A working system, not slides
  • An accuracy or performance report
  • A costed plan for production
About this stage

Go live in your environment

The full build: integration, security testing, training and go-live.

  • Integration with your systems
  • Security testing before launch
  • Training and handover documents
  • Go-live support
About this stage

Keep it running and keep it safe

Monitoring, patches, model updates and reports for as long as the system runs.

  • Monitoring and alerting
  • Patches and updates
  • Model and data updates
  • Regular reports for audit
About this stage

Where we have done it

What you should know

Does our data leave our network?

No. The model runs on your servers, a private cloud or a national cloud. We agree the location in writing before work starts.

Which models do you use?

Open models and commercial ones. We pick per workload and explain the choice, the hardware and the running cost in writing.

How do you know the answers are right?

We test the system on your own cases before launch. You get the accuracy report. Unclear cases go to a person.

Who makes the final decision?

A person. The system prepares the work and shows its source. People approve anything that affects rights or money.

Tell us what the system has to do

A first call takes 30 minutes. You speak to an engineer, not a salesperson. We reply within one working day.

Book a consultationinfo@kainotomia.tech