Adobe introduces Firefly Video Model

Adobe launches Firefly Video, a commercially safe AI model for generating videos from text or images. Integrated into Premiere Pro and a web app, it offers 1080p output, subscription plans, and future 4K support.

Adobe introduces Firefly Video Model

Key Highlights:

  • Generative AI Video Creation: Enables users to produce video clips from text prompts or images, offering control over camera angles and motion design elements.
  • Commercial Safety: Trained exclusively on licensed content, ensuring outputs are free from copyright concerns and suitable for professional use.
  • Integration and Accessibility: Available through Adobe Premiere Pro's Generative Extend tool and a new web application, Firefly.Adobe.com.

Building upon the success of its Firefly Image model, Adobe has announced the beta release of the Firefly Video Model, marking a significant advancement in generative AI for video production. This model allows creative professionals to generate video clips from text prompts or images, providing tools to control camera angles, craft atmospheric elements, and develop custom motion design components.

Initially, the model supports video generation at 1080p resolution, with plans to introduce a 4K model tailored for professional production in the near future. A distinguishing feature of Firefly Video is its training methodology; it is trained exclusively on Adobe Stock, licensed materials, and public domain content. This approach ensures that the generated outputs are free from copyright or intellectual property issues, making them safe for commercial applications.

Users can access Firefly Video through Adobe Premiere Pro, utilizing the Generative Extend tool, as well as via a newly launched web application, Firefly.Adobe.com. The platform offers functionalities to generate video clips from text prompts and reference images, add atmospheric effects, and create custom motion design elements. Additionally, it provides the capability to lock the first and last frames of a clip to maintain visual continuity and consistency in colors and character details.

Adobe has introduced two subscription plans alongside Firefly Video. The Firefly Standard plan is priced at $9.99 per month, offering 2,000 video/audio credits, which equates to approximately 20 five-second video generations at 1080p resolution. The Firefly Pro plan, at $29.99 per month, provides 7,000 video/audio credits, allowing for up to 70 five-second clips at 1080p. A Firefly Premium plan is also in development, aimed at professionals requiring higher volumes of video and audio generation, with details on pricing and availability to be announced.

This release positions Adobe competitively in the generative AI video market, where it faces offerings from companies like OpenAI's Sora and Runway's video generation tools. Adobe's emphasis on commercial safety and integration with its Creative Cloud suite offers a compelling proposition for creative professionals seeking reliable and legally compliant AI-driven video solutions.