ENGINE QUALITY

Measure the mistakes, not just the output

Timory samples three layers every week: whether strong evidence is truly strong, whether ordinary signals hide payment evidence, and whether no-signal content was missed entirely. Only conclusive human verdicts enter these rates — each n below is that rate's own denominator, and reviews marked unsure are listed separately instead of being counted either way.

STRONG EVIDENCE

Precision

Of conclusively judged current-spend and explicit-WTP labels, how many were accurate. Unsure reviews sit outside the denominator.

ORDINARY SIGNALS

Strong-label miss rate

How often a conclusively judged ordinary signal should have been labelled as payment evidence.

NO-SIGNAL CONTENT

Signal miss rate

How often conclusively judged content with no extracted signal actually contained one.

Last 12 audit weeks

Higher precision is better · lower miss rates are better

2026-08-24

5 / 30 reviewed

Precision · 80%
n=5 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-08-17

4 / 30 reviewed

Precision · 0%
n=1 judged
Strong-label miss · 0%
n=3 judged
Signal miss · pending
n=0 judged

2026-08-10

5 / 30 reviewed

Precision · 100%
n=2 judged
Strong-label miss · 0%
n=3 judged
Signal miss · pending
n=0 judged

2026-08-03

7 / 30 reviewed

Precision · 75%
n=4 judged
Strong-label miss · 0%
n=3 judged
Signal miss · pending
n=0 judged

2026-07-27

30 / 30 reviewed

Precision · 100%
n=10 judged
Strong-label miss · 10%
n=10 judged
Signal miss · 0%
n=10 judged

2026-07-20

30 / 30 reviewed

Precision · 67%
n=9 judged · 1 unsure, excluded
Strong-label miss · 20%
n=10 judged
Signal miss · 0%
n=10 judged

2026-07-13

34 / 34 reviewed

Precision · 71%
n=14 judged
Strong-label miss · 0%
n=9 judged · 1 unsure, excluded
Signal miss · 20%
n=10 judged

Anonymized corrections

These summaries disclose only source family and provenance changes. Reviewer notes, authors, excerpts and internal identifiers never appear here.

RedditHuman review changed Current spendUnclassified.2026-08-27
RedditHuman review changed First-hand painExpert opinion.2026-08-27
Hacker NewsHuman review changed Unmet needProduct gap.2026-08-27
Hacker NewsHuman review changed Unmet needPromotional.2026-08-27
RedditHuman review changed Feature requestUnclassified.2026-08-27
YouTubeHuman review changed Current spendFirst-hand pain.2026-08-27

Follow evidence changes, including corrections

Weekly movement · source-linked dossiers · explicit limitations

Get the weekly brief