03. Prompt Changes as Interventions
Draft lecture notebook.
This notebook will estimate the causal effects of prompt templates, system prompts, instructions, few-shot examples, and output format constraints.
Planned Coverage
- Prompt and system-message changes as treatments.
- Randomized prompt experiments.
- Prompt effects on quality, safety, latency, cost, and user behavior.
- Common pitfalls when evaluating prompt variants.