5,000 distinct rule levels
Deep reasoning in milliseconds.
Rae reasons over a knowledge model and does not make a statistical guess. We tested how the Rae Reasoner handles deeper inference, larger models and more data, then validated the answers against known truths, their repeatability and the evidence behind them.
An answer 32 levels deep, across 1.9 quadrillion derivation paths
In 450,205 answers checked against independent ground truth
Answers, in the same order, across 181,896 repeated runs
Answers whose evidence passed every independent proof check
Large models are highly performant.
We ran three separate experiments with varying inference depth, the number of rules and the number of facts. Timings cover the query itself, after facts have been injected into a fresh session.
More paths do not equal exponential work
Each level branches to three items at the next level. At 32 levels, the workload has 1.9 × 1015 derivation paths. The query completes in 224 μs, with the expected answer at every measured depth.
From 1 to 32 levels, derivation paths grow by a factor of 6.2 × 1014. Median query time grows by a factor of 12.
left-recursive closure of a 10,000-link chain
compile 15,001 rules
We benchmarked all answers and proofs.
A fast answer is only useful if it is right. We compared results with independently computed ground truths and checked each evidence tree (proof tree), against the source model.
All answers correct.
A mismatch means a missing fact, an extra fact or a fact returned with the wrong certainty. Expected answers come from a separate evaluator, breadth-first search or independently computed certainty arithmetic.
Same inputs. Same answer.
Answers matched in all 181,896 comparisons. Evidence was identical in all 138,489 comparisons. When input or query order changed, the proof could differ, but all 6,574,218 proof checks still passed.
All reasoning evidence verified.
All 8,845 tested answers passed every evidence check. The checker shares the expression evaluator with the reasoner, but otherwise walks the public evidence format independently against the source model.
deliberately corrupted evidence trees rejected
answers re-derived with the same certainty from their stated premises alone
A checker must catch bad evidence.
The benchmark injected eight kinds of fault, including changed facts, bindings, weights, missing aggregate facts and altered expression results. Every corrupted tree was successfully rejected.
Throughput that holds under load.
Each HTTP client started a session, injected 620 facts, ran two queries and fetched one evidence tree. The server runs as a separate process over loopback, with the load generator on the same machine. Throughput peaks at 8,408 queries per second with 32 clients and measures 7,959 queries per second with 256 clients. No request fails at any tested load level. As the cores fill, session latency rises with queueing but does not degrade when full.
throughput from 1 to 16 server cores, with the load generator sharing those cores
median complete HTTP session at 16 clients, and 12.5 ms at p99
failed requests across every tested client level and core count
Read the complete benchmark report.
All measured points, proof checks, operations tests and reproduction notes.