Mcts

I Spent $0.48 to Find Out When MCTS Actually Works for LLM Reasoning

Controlled experiments on constraint satisfaction problems. MCTS beats best-of-N only when blind sampling hits a ceiling and the verifier provides a gradient.

Watch an LLM Think

An interactive explorable explanation of Monte Carlo Tree Search for LLM reasoning. Watch reasoning paths branch, dead-end, and backtrack.

MCTS-Reasoning: A Canonical Specification of Monte Carlo Tree Search for LLM Reasoning

MCTS-Reasoning: Tree Search for LLM Reasoning

Applying Monte Carlo Tree Search to large language model reasoning, with a formal specification of the algorithm.