AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.

Posted on the r/artificial subreddit, the student's brother said that both of them are freaked out over the result of his homework assignment. The user also shared a full transcript of their conversation history with the Gemini AI. It appears the user was testing out Google’s chatbot to assist with homework assignments.

The Gemini app introduces a new feature which is access to Gemini Live, the bot’s interactive and conversational mode, akin to ChatGPT’s voice chat feature.

In an online conversation about aging adults, Google's Gemini AI chatbot responded with a threatening message, telling the user to "please die."

A 29-year-old student using Google's Gemini to do homework was “thoroughly freaked out” reportedly after the AI chatbot’s “erratic behaviour.”

A student who turned to Google’s AI chatbot for some help with his homework wound up being “thoroughly freaked out” when he received a threatening response.

Google has said it's chatbot it designed to filter out potentially harmful responses but this is not the first time the company has come under criticism for it's AI chatbot

Google AI is now no longer limited to Google platforms. While iPhone users could previously access Gemini through the web, the iPhone now has a fully fledged Gemini app, complete with exclusive iOS features not present on Android.