CommitGate
Agent / LLMIn progressDoes progress survive a model switch?
Switching models can change an agent’s next actions without necessarily changing the task outcome. CommitGate investigates which aspects of task state determine this difference, and whether a full rerun is needed to predict it.
Approach & evaluation
Research approach
Study state abstractions beyond raw action logs and compare continuations under controlled model substitutions to characterize outcome equivalence between trajectories.
Evaluation focus
Compare predictions with full reruns across tasks, switching points and model pairs; identify where predicted equivalence holds and where it fails.