During the Adobe Max conference on October 14, Adobe introduced a significant update to its Firefly generative AI, which now supports video generation from text commands or still images. This new tool allows users to create animations, visual effects, and even realistic videos with AI. It also integrates with Premiere Pro, enabling users to fill in short scenes using artificial intelligence, making video editing more efficient.
The videos generated with Firefly can be up to five seconds long, with a resolution of 720p and a frame rate of 24 frames per second. Users can employ advanced direction commands when creating prompts, such as adjusting camera angles and movements and adding precision to the generated content. One notable feature is Firefly’s ability to create videos containing text elements, addressing a standard limitation in other AI video editing tools.
This update brings Adobe’s AI capabilities closer to tools like OpenAI’s Sora but with deeper integration into creative workflows, making it a powerful tool for content creators and designers.
See an example created by the tool:
Adobe has introduced a new feature in its Firefly generative AI that allows users to create videos from traditional text commands or add movement to static images. This functionality is currently in Beta and available to a limited audience via a waiting list at firefly.adobe.com.
One of the key highlights is that Firefly is designed to generate “commercially safe” videos, distinguishing it from other AI models. Adobe has ensured that Firefly is trained only on public data and Adobe Stock content without relying on user data. This addresses privacy concerns and positions Adobe as a leader in responsible AI usage for creative tasks.
AI will extend videos in Premiere Pro.
Adobe has integrated Firefly into Premiere Pro, allowing users to extend scenes in video projects with AI-generated frames, similar to how Generative Fill works in Photoshop. This feature can create short segments up to two seconds long, adding movement to extend the duration of scenes while maintaining the original style and content.
Currently available in the Beta phase for Creative Cloud subscribers, this new tool promises to enhance video editing by seamlessly filling gaps or expanding clips without compromising quality, offering more flexibility in audiovisual projects.
