03. Prompt Changes as Interventions

Draft lecture notebook.

This notebook will estimate the causal effects of prompt templates, system prompts, instructions, few-shot examples, and output format constraints.

Planned Coverage

  • Prompt and system-message changes as treatments.
  • Randomized prompt experiments.
  • Prompt effects on quality, safety, latency, cost, and user behavior.
  • Common pitfalls when evaluating prompt variants.