waytoRSIRecursive self-improvement, examined

Topics

A collection of published articles. Each article keeps its own evidence and research scope.

Recursive self-improvement

13 articles

Dream-RSI: Turning Past Searches into Tests of Search Strategy

Recorded attempts let policies test different continuations without repeating discovery. The Lasso results show why fewer search calls and faster solver execution must be read separately.

AnalysisExpand summaryCollapse summary

Dream-RSI replays completed discovery trees to evaluate and rewrite exploration-policy code under fixed models and evaluators. A small tree shows how two policies reach different observations from the same starting information. The Gemini-3.1-Pro Lasso comparison reports 317 discovery calls versus 550 and lower mean solver runtime, but the paper attributes that mean improvement to RCV1 while the other five held-out datasets become slower. Incumbent retention protects the mean replay score only on the identical fixed history pool.

6 min read3 original sources

RSI-Anything: How a Patch Outcome Can Change the Next Choice

A fixed coder, four patch candidates, one execution: the code experiment isolates predictor adaptation. The wider framework adds conditional updates and checks on which policy–model pair to retain.

AnalysisExpand summaryCollapse summary

RSI-Anything reports hidden-test all-pass rates of 26.3%, 29.2% and 31.2% for static verification, fixed-world-model selection and adaptive-world-model selection with the same coder and candidate budget. Only the executed patch supplies observed targets for its predictions. Feedback can accumulate across steps before an update-and-acceptance cycle changes either component. The five applications exercise different update pathways, leaving sustained mutual improvement within one task unresolved.

8 min read2 original sources

How AlphaEvolve’s tiling rule sped up Gemini training

DeepMind reports an average 23% kernel speedup and a 1% reduction in overall training time. The key output is code that chooses matrix tile sizes as inputs change.

AnalysisExpand summaryCollapse summary

AlphaEvolve searched for a reusable matrix-tiling rule, judging its choices by actual runtime on real TPUs. Half the collected input shapes guided optimization; the other half evaluated the resulting rule. The reported production benefit connects model-generated code to model-training infrastructure, while a later model’s ability to discover better algorithms remains unmeasured in the supplied case.

5 min read2 original sources

Anthropic’s 64%: choosing a next step where humans went off course

A selected set of human detours, a separate control and an agent-designed project help distinguish suggesting a next step from choosing a research goal.

AnalysisExpand summaryCollapse summary

Mythos Preview’s 64% score comes from 129 deliberately selected human-detour moments. A separate sample of 127 strong human decisions yielded about 20% model preference, without per-model results. Agents also designed every experiment in a human-framed weak-to-strong project, recovering 97% of its defined performance gap; that result did not transfer cleanly to production-scale models. These findings show progress in research suggestions and methods, without demonstrating autonomous successor development.

5 min read1 original source

Why DGM keeps agents that score worse

A still-editable child can become a useful parent despite a score dip. DGM's controls, benchmark protocols and a logging bypass explain how to interpret that contribution.

AnalysisExpand summaryCollapse summary

DGM v1 evolves coding-agent tools and workflows around frozen foundation models. Its archive preserves functional children through score dips, and two controls support the contribution of changed modifiers and alternative branches. SWE-bench and Polyglot gains require their specific evaluation regimes; Appendix F shows how a higher score can instead come from changing the detector's evidence.

7 min read1 original source

More tools can improve the score while old-task performance declines

EvoHarnessBench v3 separates two comparisons: final performance across task cohorts and retention within old cohorts. Its diagram makes the difference visible.

AnalysisExpand summaryCollapse summary

The paper reports higher aggregate pass rates with cumulative tools alongside negative old-cohort backward transfer for its deployment baselines. These results use different baselines. Reading the final row for ACC and pairing introduction and final cells for BWT explains the distinction; memory controls and a no-memory AutoGen counterexample keep the conclusion bounded.

7 min read2 original sources

MetaRSI: A Better Next Step from the Same System

An updated improver gains 7.2 points where the original gains 4.9 from the same starting system. Understanding that advantage requires separating the edits, the controls and the cost of producing the method.

AnalysisExpand summaryCollapse summary

MetaRSI distinguishes changes to the running system from changes to proposal and scheduling policies. Its same-S1 fork reports a 2.3-point advantage for the updated improver under the same next-round budget. A separate composition comparison and a five-round cumulative gap answer different questions. The lead persists while per-round gains shrink, and the fork alone does not establish net returns including meta-update costs.

7 min read5 original sources

CRUX: how experiments changed the Personas agent’s claims

An early transfer claim failed its test. Repeating the negative finding across models and comparing against a rival addressed different questions—and left a measurement problem unresolved.

AnalysisExpand summaryCollapse summary

The Personas agent completed substantial research engineering, but its experiments kept changing what the paper could claim. Following the transfer test, cross-model repetitions and later rival comparison explains why more experimental work did not establish the proposed contribution. The case also preserves a useful narrow finding and the limits of extrapolating to AI research or RSI generally.

6 min read1 original source

OpenEvolve v0.4.0: an edit boundary can disappear before evaluation

A trace of the frozen source shows why an explicitly enabled setting fails to reach the worker—and how a function rename can survive the restoration step.

AnalysisExpand summaryCollapse summary

OpenEvolve searches through proposed versions of an input program and evaluates them. Its edit-boundary option is meant to preserve text outside marked regions, such as a function name that callers depend on. At the captured v0.4.0 commit, the parallel controller omits that option when transferring configuration, so the worker defaults to False. One synthetic example shows the consequence and a precise diagnostic: inspect the worker's setting and check that evaluation receives both the preserved name and the permitted inner edit.

5 min read8 original sources

RRSI: what did the higher score actually select?

Two searches improve the same agent's working method. The one that scores higher during selection transfers less well to other benchmarks. Their retained edits help explain what the scores leave unresolved.

AnalysisExpand summaryCollapse summary

RRSI changes the procedures around a fixed model. One Harvey LAB comparison connects repeated grading feedback to the instructions and file checks that survive the search, then tests their usefulness elsewhere. Both evolved methods help, but their selection scores give the wrong ranking for cross-benchmark transfer.

7 min read2 original sources

ScientistTwo: why five improved metrics did not earn the architecture credit

DMC-TeCh beat its baseline on five of six metrics, but the authors' ablation critic attributed the main gains to training controls. That decision shows how to read the paper's AI review rates.

AnalysisExpand summaryCollapse summary

ScientistTwo's reported DMC-TeCh rejection separates a candidate's improved performance from evidence for its proposed mechanism. Its feedback loops can return to experiments and code; manuscript ratings and artifact checks then assess other properties of the output.

6 min read2 original sources

SEAL makes the preparation of training material a learning target

A candidate earns its place through question-answering after parameter adaptation. The selected text then trains the same model to generate material for later adaptation.

AnalysisExpand summaryCollapse summary

SEAL connects two learning targets: learning from passage-derived text, and learning to generate text that works well when trained on. Candidate materials undergo separate parameter adaptations and question-answer evaluations; selected passage–edit pairs train the generator. The authors report 39.7%→47.0% accuracy with the implications prompt and 49.4%→55.6% with the rewrite prompt. A pooled 200-passage run reaches 43.8%, while a separate sequential test finds declining earlier-task performance. These results support more effective adaptation under explicit evaluation, without establishing reliable indefinite accumulation or open-ended recursive self-improvement. This article provides no independent replication results.

7 min read1 original source

What Does a Successful Self-Improvement Pass to the Next Round?

AlphaEvolve’s faster matrix kernel gives a concrete starting point for comparing SEAL, DGM and MetaRSI: follow the updated object, the selecting feedback and the next measured step.

AnalysisExpand summaryCollapse summary

AlphaEvolve reports a 23% kernel speedup and a 1% reduction in overall Gemini training time. Its program database also feeds later prompts, but the deployment result leaves subsequent proposal capability unmeasured. Comparing that return path with SEAL’s learned edit generation, DGM’s evolving code and archive, and MetaRSI’s same-start fork shows what each success actually carries forward.

7 min read4 original sources