Become an AI engineer

# Open models

Open models is a unit of 6 lessons in Rabbithole's Become an AI engineer course, at levels 3 to 5.

## Lessons

1. Gradio: a web interface around a Python function · Level 3
2. smolagents: build a CodeAgent with your own tools · Level 3
3. Logits processors and how vLLM keeps its batch tidy · Level 4
4. Pooling Models in vLLM · Level 4
5. vLLM IR: choosing kernels and donating memory · Level 5
6. Inside vLLM's torch.compile integration: stages, switches and cache · Level 5

## Sources

These lessons draw on 5 sources. The most used:

- [vLLM documentation](https://docs.vllm.ai/en/latest/)
- [Hugging Face Agents Course](https://github.com/huggingface/agents-course)
- [Hugging Face LLM Course](https://github.com/huggingface/course)
- [TensorRT LLM documentation](https://nvidia.github.io/TensorRT-LLM/)
- [Modal Guide](https://modal.com/docs/guide)

[All units in Become an AI engineer](https://rabbithole.pro/courses/ai-engineer)

Source page: https://rabbithole.pro/courses/ai-engineer/open-models