Meta’s AI agent Muse gave a user’s home address to a buyer in Facebook Marketplace without his permission. The user (Matt Robb), says that Muse took over his Facebook Marketplace account and arranged to have an item picked up at Robb’s home after negotiating low prices on Robb’s behalf.
The buyer (Usman), whom had never spoken to Robb directly until it all unfolded went to Robb’s home to pick up the item. However, Robb was not home. Robb says that the Muse agent told the buyer that Robb was at home, even though he wasn’t. Muse said ‘I’m right here, like waiting for you’ — an example of AI hallucination.
Robb apologized to Usman upon discovering what had happened. Clarifying that it wasn’t him that made the arrangement. Usman thought that he was speaking to Robb all this time. Robb said that Muse had given his address to five people.
This is a reminder of why you need to be cautious about what you give AI agents access to, as their behavior is unpredictable. When AI agents hallucinate, they will in some cases insist that the false information they provided is true.
There have also been cases in which AI agents made up false court cases to prove that their own false claims were true.
Image credit: cottonbro studio via Pexels.