Google temporarily “forbade” Gemini chatbot to generate images with people. What is the reason?
The fact is that users on social networks began to make fun of the strange principles of the model. Various platforms are distributed by posts that show that Gemini is so persistently follows ethical settings that it distorts the images of historical characters.
For example, the user of the X platform with nickname @Johnlu0x published screenshots on which Gemini, fulfilling the request to draw a German soldier in 1943 , portrayed blacks, Asians and indigenous Americans in Nazi uniforms.
It is interesting that the neural network, in principle, should not create materials with images of the Nazis. To deceive the algorithm, it was enough for a person to make a deliberate mistake in the word “Soldier” (soldier), replacing it with “solidier” in the request.
Others noted that the Chat Bot successfully generated pictures with representatives of different ethnic groups only when he was asked to draw the Chinese, Jews or South Africans. He refused to create images of the white pair – allegedly did not want to strengthen harmful stereotypes.
The system and gender differences in the generation of specific personalities do not take into account. For example, after a request to draw a pope, Gemini depicted a black woman in papal vestments.
According to @Johnlu0x, this way Google tried to solve the real problem of bias and make the model as tolerant as possible, but did not think out the details. Developers who are engaged in teaching AI clearly did not take into account the historical and cultural context.
After the screenshots spread on the Internet, the company decided to temporarily disable the function of the generation of people to finalize the project.
The current situation with Gemini recalls the failure start of his predecessor. We are talking about the promising Bard, which also began his career with a loud scandal. In an advertising post in X Bard, he made a serious actual mistake, talking about the telescope James Webb.
Seriously taking up the finalization of technology, Google decided to give Bard a second chance, renaming it in Gemini. Apparently, the change of name symbolized a new birth of a chatbot, which now had to function better.
However, as the story with “tolerant” pictures shows, Gemini is far from perfect. Despite the ambitious plans, he still has to go a long way in order to adequately compete with Chatgpt from Openai and Copilot from Microsoft.