Meta launches “Movie Gen”, which will set a new standard for immersive AI content

Meta has released “Movie Gen”, an advanced artificial intelligence model for creating high-quality video with text prompts. This tool sets a new standard for immersive content using artificial intelligence, allowing users to create unique videos, edit existing footage and turn personal images into their own videos. Below we will consider the main key characteristics.

Creating a video from text

Create unique videos from text to create your own masterpiece. Movie Gen creates long, high-quality videos with a variety of aspect ratios – a unique feature in the industry.

Example:

A red-faced monkey with white fur bathes in a natural hot spring. A monkey is playing in the water, and in front of it is a miniature wooden ship with a white sail and a small rudder. The hot spring is surrounded by lush greenery, rocks and trees.

Video editing with text

Transform existing videos by entering text. Movie Gen provides precise video editing, from styles and transitions to fine tuning.

Example:

We see the runner, who has been edited in different variations: in one image, he is holding pom-poms; another has the background changed to show a desert; and on the third – a runner dressed in a dinosaur costume.

Create personalized videos

By uploading images, users can create personalized videos that reflect human identity and movement.

Example:

Cowgirl girl in jeans riding a white horse in an old western town. A leather belt wraps around her waist. The horse is dignified, its fur glistens in the sun. Rocky mountains can be seen in the background.

Creation of audio effects and soundtracks

Movie Gen can create and enhance video soundtracks using text-based instructions to create sound effects, background music, or full audio tracks.

Example:

Whistling sounds, accompanied by a sharp explosion and a loud crack.

Current limitations and future prospects

Despite its capabilities, Movie Gen is still not available to a wide range of users due to its high cost and long generation time. Meta product manager Chris Cox noted that the tool is still in the research phase.

Ethical issues

The development of video generators based on artificial intelligence has raised questions about ownership and the possibility of abuse. Meta claims that Movie Gen is trained to use licensed and publicly available datasets, although details were not specified. The impact of artificial intelligence on the creative community remains a point of contention, prompting strikes and discussions across the industry.

Meta’s Movie Gen is a revolutionary AI-powered media creation tool that offers everything from video creation to personalized content and audio effects. However, ethical aspects and technical limitations should still be considered before its widespread implementation.

Source – https://ai.meta.com/research/movie-gen/.