AI / Agentic AI Interview Questions
Explain the internal working of Tree-of-Thoughts reasoning compared to Chain-of-Thought?
flowchart TD
P[Problem] --> C1[Chain-of-Thought: single linear path]
C1 --> A1[Answer]
P --> T1[Tree-of-Thoughts: branch into candidates]
T1 --> T2[Evaluate branches]
T2 --> T3[Prune weak branches]
T3 --> T4[Expand promising branches]
T4 --> A2[Answer]
Chain-of-Thought commits to a single linear sequence of reasoning steps, generating one thought after another until it reaches an answer, with no mechanism to reconsider an earlier step if it turns out to be a dead end.
- Tree-of-Thoughts instead generates multiple candidate next thoughts at each step, treating reasoning as a search over a tree of possibilities rather than one fixed path
- Each candidate branch is evaluated for how promising it looks toward solving the problem
- Weaker branches are pruned, while the model spends more computation expanding the more promising ones
- The model can effectively backtrack, abandoning a branch that led nowhere in favor of a different one explored earlier
The trade-off is straightforward, Tree-of-Thoughts uses substantially more compute than a single Chain-of-Thought pass, but is considerably more robust on problems where a single early misstep would otherwise doom the entire reasoning chain.
Can Chain-of-Thought reconsider an earlier step that turned out to be a dead end?
What does Tree-of-Thoughts do with weaker reasoning branches?
More Related questions...
