What is weird generalization In Machine learning

Weird generalization usually refers to a surprising behavior of machine learning models where they perform well on data they were never explicitly trained for, but in a way that doesn’t align with human intuition.

In simple terms
A model learns patterns that work, but not necessarily the patterns humans expect.