meta* a new video generation system using artificial intelligence (AI) called Movie Gen, which is able to create high -resolution video with sound. This announcement followed a few months after Openai announced its model of the text-video called its model. However, while access to Movie Gen is not provided to the general public.
movie gen allows to generate video based on text inputs, as well as edit existing videos and images. Sound accompaniment added to the video is also created using AI and includes surrounding sounds, sound effects and background music. Video can be created in various formats and image proportions.
In addition to creating new video clips, Movie Gen provides an opportunity to change various elements of existing video materials. One of the examples presented by Meta demonstrates the image of a woman sitting on a field with pumpkin, and a video created on the basis of this photo. At the same time, the original image was a simple portrait.
Movie Gen is also able to edit existing videos by changing their style, transitions and adding new elements that were not originally. Meta showed a video with the image of a runner, which was transformed with the help of AI: in one version the runner holds pompons, in the other – The background is replaced by the desert, and in the third – the runner is dressed in a dinosaur costume. All changes are carried out using text commands.
Over the past two years, images and video generation technologies have reached significant progress. Companies such as Google and Openai are actively developing similar tools, and startups also contribute to the development of this technology. Despite significant development, Openai has not yet launched Sora into open access, and one of its leading developers has moved to work in Google.
Meta admit that Movie Gen is not yet ready for a full launch. Chris Cox chief director of the company noted that the creation of a video still takes too much time, and the cost of generation remains high.
Technologies of AI already cause concern in copyright issues and possible negative scenarios of their use. It is reported that some startups to teach their models used YouTube videos, which violates the conditions for using the platform. Meta said that Movie Gen was trained in “combinations of licensed and publicly available data sets”, but specific sources did not reveal.
Creative communities, including directors, photographers, artists and actors, express concern about how the use of AI can affect their professional areas. These issues became key against the backdrop of strikes, such as the historical joint action of Hollywood actors and screenwriters in 2023.
* META and its products are recognized as extremist, their activities are prohibited in the territory of the Russian Federation.