"It feels better" isn't an evaluation.

After a prompt tweak, fine-tune, or model swap, the output usually looks better in a handful of examples. That impression is easy to trust and easy to get wrong.

A fixed test set, run before and after every change, tells you whether the system actually improved, or whether you fixed one case and broke three others.

You can't call it progress if you can't measure the change.