Become an AI engineer

Open models

Open models is a unit of 6 lessons in Rabbithole's Become an AI engineer course, at levels 3 to 5.

Lessons

1. Gradio: a web interface around a Python functionLevel 3
2. smolagents: build a CodeAgent with your own toolsLevel 3
3. Logits processors and how vLLM keeps its batch tidyLevel 4
4. Pooling Models in vLLMLevel 4
5. vLLM IR: choosing kernels and donating memoryLevel 5
6. Inside vLLM's torch.compile integration: stages, switches and cacheLevel 5

Sources

These lessons draw on 5 sources. The most used:

• vLLM documentation
• Hugging Face Agents Course
• Hugging Face LLM Course
• TensorRT LLM documentation
• Modal Guide

All units in Become an AI engineer