Become an AI engineer

Safety, plainly

Safety, plainly is a unit of 16 lessons in Rabbithole's Become an AI engineer course, at levels 1 to 2.

Lessons

  1. AI safety: what it is and how people think about itLevel 1
  2. Alignment: an AI that does what we meanLevel 2
  3. Jailbreaks: Getting an AI to Break Its Own RulesLevel 2
  4. Red-teaming: attacking an AI on purpose to find its flawsLevel 2
  5. Safety frameworks: how AI companies decide to launchLevel 2
  6. Testing AI for dangerous abilitiesLevel 2
  7. Model Weight SecurityLevel 2
  8. Model welfare: could an AI have wellbeing?Level 2
  9. Reward hacking: when an AI games its scoreLevel 2
  10. Agentic MisalignmentLevel 2
  11. Alignment faking: when an AI plays alongLevel 2
  12. Corrigibility: not working against human oversightLevel 2
  13. Data Poisoning: Bad Data In, Bad Behavior OutLevel 2
  14. Deliberative alignment: a model that reasons over written safety rulesLevel 2
  15. Sandbagging: when an AI holds back on a testLevel 2
  16. Scalable oversight: keeping AI answers checkableLevel 2

Sources

These lessons draw on 29 sources. The most used:

All units in Become an AI engineer