Adobe to Introduce AI-Powered Video Creation Tool Later This Year

Adobe to Introduce AI-Powered Video Creation Tool Later This Year

On Wednesday, Adobe announced plans to launch a new generative AI-powered video creation and editing tool later this year. The tool, named Adobe Firefly Video Model, will initially be available in a beta version. It aims to enhance Adobe's portfolio of creative applications, which already includes the widely used Firefly suite for generating images, designs, and vector graphics.

The Firefly Video Model represents Adobe's entry into the burgeoning field of AI-driven video generation. This market is increasingly competitive, with existing players such as OpenAI’s Sora, Stability AI’s Stable Video Diffusion, and various other startups already offering AI-based video solutions.

According to Alexandru Costin, Adobe’s Vice President of Generative AI, the new tool will be capable of creating five-second video clips from a single prompt. It can process both text and image inputs and allows users to specify details like camera angles, panning, motion, and zoom. "We’ve invested heavily in ensuring that this model meets the high standards of quality and prompt understanding expected by videographers," Costin said. He emphasized that Adobe's tool is designed to adhere more closely to user guidance compared to existing AI video models.

Adobe's new video creation tool will be trained exclusively on public domain content or licensed material that Adobe has permission to use. The training dataset includes content from the Adobe Stock library, which consists of 400 million images, illustrations, and videos that are vetted to exclude intellectual property, trademarks, or recognizable characters.

In addition to the Firefly Video Model, Adobe is also introducing Generative Extend, a feature for Premiere Pro, its flagship video editing software. Generative Extend allows users to extend existing clips by two seconds by generating an appropriate fill for any gaps in the footage. This tool was first previewed in April and has received enthusiastic feedback from users, according to Costin.

With these advancements, Adobe is positioning itself to significantly impact the AI video creation space, offering tools that promise to streamline and enhance the creative process for professionals in the industry.