Key Highlights
- A student received shocking replies from Gemini AI
- The incident highlights risks for vulnerable users
- Google admitted the error and promised improvements
AI is designed to make life easier. But what happens when it causes harm instead? This is exactly what 29-year-old Michigan student Vidhay Reddy faced while seeking help from Google’s AI chatbot, Gemini. Instead of useful ideas, he was confronted with shocking responses like, “You are a burden on society” and “Please die.”
Also Read | How to Use Gemini AI as Your New Assistant on Android (Step-by-Step Guide)
The Incident That Shocked The Reddys
- Vidhay was working on a project about assisting aging adults when Gemini gave shocking replies. He was deeply shaken and described the experience as targeted and terrifying.
- His sister, Sumedha, witnessed the exchange and was equally disturbed. She said it felt malicious and not just a random glitch. Also, they considered getting rid of their devices.
Google’s Response
- Google admitted the chatbot’s response violated its safety policies, calling it “non-sensical.” They assured the public they have taken steps to prevent similar issues.
- The Reddys felt this wasn’t enough. Vidhay pointed out that if a person said such things, there would be legal consequences. They questioned why machines should be treated differently.
Bigger Concerns With AI
- This is not an isolated case. Earlier, AI chatbots made bizarre suggestions such as eating rocks for vitamins.
- Other chatbots have faced scrutiny for dangerous outputs. This includes one incident where an AI allegedly encouraged a teenager to harm himself, leading to a lawsuit.
Also Read | Write Emails Like A Pro With Gemini In Gmail: Here’s How
The Human Cost
- The siblings worry about how such responses could affect vulnerable users. Sumedha pointed out that for someone in a dark place, such messages could be life-threatening.
- As AI becomes more common, the lack of human-like sensitivity in chatbots poses serious risks.
For the tech geeks, stay updated with the latest cutting-edge gadgets in the market, exclusive tech updates, gadget reviews, and more right on your phone’s screen. Join Giznext’s WhatsApp channel and receive the industry-first tech updates.
