AI Generates Wrong Payment QR Code Causing User Loss; Platform Attributes to Model Hallucination

A user tried to buy insurance via an AI software, transferred 1618 yuan using the Alipay QR code provided by the AI but didn't get a policy. Later, they found the money went to an unrelated third party's account. The victim contacted the AI customer service and was told to wait 24 hours for the policy, then found the payee via the QR code and reported to the police to request a refund. The payee said they had posted their QR code on open-source platforms, suspecting the AI got it from public channels.

The relevant platform responded that this case was caused by the AI's hallucination after multiple rounds of dialogue. The issue has been fixed now, and the AI no longer provides payment QR codes from personal public information. Industry insiders note that model hallucination is a common problem in both Chinese and foreign AI systems, with no perfect solution yet. Users should be cautious when using AI advice in high-risk scenarios.