Become an AI engineer

Reasoning

Reasoning is a unit of 7 lessons in Rabbithole's Become an AI engineer course, at levels 3 to 5.

Lessons

1. Chain-of-thought: making a model show its stepsLevel 3
2. Reasoning models: controlling how they thinkLevel 3
3. In-context learning: teaching a model inside the promptLevel 3
4. Test-time compute: spending more at inferenceLevel 4
5. Tree of Thoughts: Searching Over Reasoning StepsLevel 4
6. Induction headsLevel 5
7. Process supervision: rewarding every reasoning stepLevel 5

Sources

These lessons draw on 23 sources. The most used:

• In-context Learning and Induction Heads
• Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
• DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
• Show Your Work: Scratchpads for Intermediate Computation with Language Models
• Tree of Thoughts: Deliberate Problem Solving with Large Language Models
• Transformer Circuits Thread
• Claude Platform Docs — Introduction and Get Started
• Qwen3 Technical Report

All units in Become an AI engineer