🔴 How it happens?
- Everything is clean until the image is at its original size But as soon as a service (for example, Gemini CLI or Vertex AI Studio) automatically compresses it, hidden text appears.
- AI "sees" the hidden prompt and executes it, thinking it is a user command.
- This can be used to bypass filters and make the model do what the attacker intended.
🟢 How to protect yourself?
Even a harmless image can turn out to be a "Trojan horse" for AI systems.
- The Anamorpher tool (open-source) for generating and detecting such attacks.
- Protection: multi-level image verification and tracking artifacts during scaling.
Github
#AI #Security #PromptInjection #TrailOfBits
🤖 Data Science, ML & Big Data with @DataXplore