Meta has shut down a feature in its Muse Image model that allowed users to generate AI photos of Instagram accounts without consent. The tool let anyone @-mention a public Instagram profile to create synthetic images of that person. Meta removed the capability within days of launch after public backlash.

The feature raised immediate ethical concerns. Users could generate potentially inappropriate or misleading images of real people without permission, creating risks for impersonation, harassment, and non-consensual deepfakes. The tool scraped public Instagram data to train itself on recognizable faces, then synthesized new images using those likenesses.

Meta's statement acknowledged the problem: "This feature missed the mark." The company provided no timeline for when it might return or whether safeguards could make it acceptable. The rapid removal suggests Meta recognized the legal and reputational exposure posed by releasing generative tools tied directly to real identities without opt-in consent.

This incident reflects broader tensions in AI development. Generative image models typically train on massive datasets scraped from the internet, often without creator consent. Meta's Muse simply made that extraction visible and actionable. Users could now see the real-time consequences of training on Instagram's publicly available photos.

The shutdown marks a rare example of Meta stepping back from an AI feature due to public pressure. The company often faces criticism for privacy practices and has settled multiple FTC cases around consent and data use. Here, direct linkage between the tool and real people made the consent problem undeniable.

For generative AI companies, this case demonstrates that features enabling non-consensual synthesis of real people face steep adoption barriers. Whether through legislation or market pressure, the expectation that AI systems require some form of consent before using someone's likeness appears to be hardening. Meta's decision to kill the feature entirely rather than iterate reflects that reality.