Evaluation

When Your Metric Improves and Your Product Gets Worse

What a QLoRA fine-tune taught me about the difference between optimizing and guaranteeing.