Adobe has previewed upcoming generative AI video tools, including a new feature that creates video clips from still images.
This preview builds on the Firefly video model, which Adobe showcased in April, and will drive AI video and audio editing features in Adobe Creative Cloud applications.
The promotional teaser includes footage generated by Firefly’s text-to-video capabilities, which Adobe announced earlier this year but did not demonstrate.
This tool lets users create video clips from text descriptions and refine the results with various “camera controls” that emulate angles, motion, and shooting distance.
Adobe also demonstrated an image-to-video feature within the Firefly video model, which can generate clips based on specific reference images. This feature could be used to create additional B-roll footage or fill gaps in production timelines.
If the example footage is indicative of the final product, the video quality from Adobe’s upcoming tools seems comparable to what we’ve seen from OpenAI’s Sora model. Adobe is also “exploring” Sora as a third-party integration for its Premiere Pro video software.
However, the duration of videos is limited; Alexandru Costin, Adobe’s VP of generative AI, told The Verge that clips produced by the text-to-video and image-to-video features can be up to five seconds long.
One potential advantage of Adobe’s Firefly over Sora is its promise of being “commercially safe.” Firefly is trained on openly licensed, public domain, and Adobe Stock content, which could help alleviate some concerns about copyright infringement.
The text-to-video and image-to-video features will first be available in beta as a standalone Firefly application later this year. Adobe plans to integrate the new Firefly video model into its Creative Cloud, Experience Cloud, and Adobe Express applications eventually.
Additionally, Adobe showcased clips of the forthcoming “Generative Extend” feature for Premiere Pro, which can extend existing video footage similar to Photoshop’s Generative Expand tool for image backgrounds. Adobe has indicated that this feature will also be released at an unspecified date later this year.
Stories You May Like