Journal 028

The Day Giving 100% Became Possible

We discovered our own assessment could never award a perfect score. The problem wasn't the methodology. It was our implementation.

4 min

Written by

The Day Giving 100% Became Possible

Today our own assessment engine marked our homework.

It found something we hadn't.

While reviewing the methodology behind AI Readiness, we realised something surprising.

A perfect score wasn't possible.

Not because no website deserved one.

Because our implementation accidentally made 100 mathematically unreachable.

The engine was behaving exactly as we had programmed it.

It just wasn't behaving exactly as we had intended.

That distinction matters.

The audit showed that our Offer assessment could only ever contribute 80 points, even though the scoring model expected it to contribute 100.

Every website was being judged consistently.

Just against the wrong ceiling.

That raised an uncomfortable question.

Should we leave it?

After all, every website was affected equally.

Or should we change a methodology that was already producing consistent, repeatable results?

The answer became clear once we reminded ourselves what Wayli exists to do.

Understanding starts with asking the right question.

The right question wasn't:

Can we make Wayli score 100?

It was:

Is the score telling the truth?

Those are very different questions.

We traced the implementation back through the evidence pipeline.

The methodology hadn't failed.

The implementation had.

The engine already knew how to recognise five independent pieces of Offer evidence.

The scoring logic already expected five.

Somewhere between those two, only three were ever being returned.

A small oversight.

A four-point consequence.

We corrected the implementation.

Then we reran the benchmark.

Ninety-nine historical assessments.

Twenty-nine live benchmark websites.

Every change behaved exactly as expected.

No other assessment area moved.

No hidden side effects appeared.

For the first time, a website that genuinely met every published criterion could achieve 100.

That wasn't about making the numbers look better.

It was about making them honest.

One lesson keeps repeating itself as we build Wayli.

Deterministic systems still need auditing.

Transparency doesn't guarantee correctness.

It makes correctness easier to verify.

That's why we publish our thinking as we go.

Not because we expect every implementation to be perfect.

Because we think people should be able to see how it's improving.