Google introduced the new prototype of the II-Ii-Agent Project Mariner, which can perform actions on the Internet in the same way as a person. Developed by the DeepMind division and working on the basis of Gemini technology, the agent controls the Chrome browser, moving the cursor, pressing the buttons, and filling the forms.
Initially, access to the Project Mariner is provided to a small group of testers. According to Google representatives, the company explores new methods of using Gemini, including reading, summing, and working with sites. The Project Mariner sees a change in the user experience, where interaction with sites is replaced by the use of generative AI.
The concept can affect millions of companies that depend on attracting real users through Google, from publishers to retailers. At the demonstration, the agent successfully completed the task of creating a basket on the website of the grocery store. However, the process was accompanied by a noticeable delay – about 5 seconds between the cursor movements. Sometimes the agent requested clarifications, for example, about the number of goods.
An important feature is that the Project Mariner does not make payment, does not accept cookies, and does not sign user agreements to maintain control over actions in the user’s hands. The agent requires consent to transfer data since the agent makes screenshots of the screen while working, sends them to the cloud for analysis, and then receives instructions for working with a web page.
In addition to shopping, the agent can find tickets, recipes, and other resources but only works in the active Chrome tab. This approach was chosen so that users could observe AI actions. Despite this, Google representatives do not exclude that in the future interaction with sites can become less personalized.
Despite the fact that the agent interacts with web pages, this can reduce the involvement of users and, possibly, over time, eliminate the need to visit sites. Google Labs Head noted that such changes will require adaptation from both users and site owners.
In addition to Project Mariner, Google announced other Jeenets: