ENGINE QUALITY

Measure the mistakes, not just the output

Timory samples three layers every week: whether strong evidence is truly strong, whether ordinary signals hide payment evidence, and whether no-signal content was missed entirely. Only conclusive human verdicts enter these rates — each n below is that rate's own denominator, and reviews marked unsure are listed separately instead of being counted either way.

STRONG EVIDENCE

Precision

Of conclusively judged current-spend and explicit-WTP labels, how many were accurate. Unsure reviews sit outside the denominator.

ORDINARY SIGNALS

Strong-label miss rate

How often a conclusively judged ordinary signal should have been labelled as payment evidence.

NO-SIGNAL CONTENT

Signal miss rate

How often conclusively judged content with no extracted signal actually contained one.

Last 12 audit weeks

Higher precision is better · lower miss rates are better

A rate is published only once that rate's own denominator reaches 5 conclusive verdicts. Below that the week still shows its count, because one or two verdicts move a percentage further than the underlying quality does.

2026-10-12

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-10-05

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-09-28

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-09-21

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-09-14

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-09-07

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-08-31

0 / 30 reviewed

Precision · pending
n=0 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-08-24

5 / 30 reviewed

Precision · 80%
n=5 judged
Strong-label miss · pending
n=0 judged
Signal miss · pending
n=0 judged

2026-08-17

4 / 30 reviewed

Precision · too few to state
n=1 judged
Strong-label miss · too few to state
n=3 judged
Signal miss · pending
n=0 judged

2026-08-10

5 / 30 reviewed

Precision · too few to state
n=2 judged
Strong-label miss · too few to state
n=3 judged
Signal miss · pending
n=0 judged

2026-08-03

7 / 30 reviewed

Precision · too few to state
n=4 judged
Strong-label miss · too few to state
n=3 judged
Signal miss · pending
n=0 judged

2026-07-27

30 / 30 reviewed

Precision · 100%
n=10 judged
Strong-label miss · 10%
n=10 judged
Signal miss · 0%
n=10 judged

Anonymized corrections

These summaries disclose only source family and provenance changes. Reviewer notes, authors, excerpts and internal identifiers never appear here.

RedditHuman review changed Current spend → Unclassified.2026-08-27
RedditHuman review changed First-hand pain → Expert opinion.2026-08-27
Hacker NewsHuman review changed Unmet need → Product gap.2026-08-27
Hacker NewsHuman review changed Unmet need → Promotional.2026-08-27
RedditHuman review changed Feature request → Unclassified.2026-08-27
YouTubeHuman review changed Current spend → First-hand pain.2026-08-27

Follow evidence changes, including corrections

Weekly movement · source-linked dossiers · explicit limitations

Get the weekly brief