We tried replacing LLM calls with a decision model. Most swaps failed, and that was the useful part.
Most of the swaps we tried failed a replay against real stored data. This is what held up, what did not, and what the failures turned up.
Bastyn team · 19 Oct 2026 · 4 min read
