Adobe launched an AI video generator to help users create videos from text prompts and images. These features, integrated into Adobe’s popular video-editing software, Premiere Pro, will allow users to extend video clips using generative AI. The announcement was made during Adobe’s annual product conference in Miami on Monday.
One key feature, the Generative Extend tool, can add up to two seconds of video at 720p or 1080p resolution and 24 frames per second (FPS). This is useful for making minor adjustments, such as correcting eye movements or smoothing footage, reducing the need for costly reshoots. The tool can also extend audio, increasing sound effects or ambient noise by up to 10 seconds, although it cannot process spoken dialogue or music.
AI Video from Text and Images
Adobe also introduced tools that generate videos from text prompts or images. This functionality will be available through Adobe’s Firefly Video Model, currently in limited public beta. These tools enable users to create videos simply by typing descriptions or uploading images. Adobe’s new video models are designed for seamless integration into existing workflows, which could give them an edge over competing technologies from companies like OpenAI, Google, and Meta.
The tools aim to meet user demand for AI-powered features within familiar applications, according to Ely Greenfield, Adobe’s Chief Technology Officer for Digital Media.
Safety and Compliance a Priority
During its annual conference, Adobe launched an AI video generator that extends video clips and adjusts audio effortlessly. Adobe’s approach to AI development has focused heavily on content safety. The Firefly Video Model is being promoted as “commercially safe,” a distinction that sets it apart from rivals like Runway and Meta. These competitors have faced criticism for training their models on content scraped from the internet, raising concerns over copyright violations. Adobe’s models, in contrast, are trained primarily on its own stock media library, along with licensed or public domain data.
This cautious approach could help Adobe appeal to professionals worried about the legality and rights issues surrounding generative AI. Adobe has also implemented restrictions to prevent users from generating certain types of videos, such as those featuring specific faces.
Future Plans and Pricing
Although Adobe is not yet charging for these AI features, each user is given a limited number of credits for generating AI content. Currently, the limits are not strictly enforced. However, company executives have indicated that Adobe may introduce different pricing tiers once the Firefly Video Model moves out of its beta phase, especially for the more resource-intensive video-generation tools compared to their image-based counterparts.
The Firefly Video Model is currently available to users who join the waitlist, and Adobe is expected to announce further details on pricing once the beta period ends.
Adobe’s latest AI tools offer an exciting new chapter in creative content production. With a focus on workflow integration, safety, and user-friendly design, Adobe hopes to differentiate itself from competitors in the rapidly growing field of generative AI. As AI technology continues to evolve, Adobe’s strategic approach could make it a leader in this space.
With the new update, Adobe launched an AI video generator integrated into its popular Premiere Pro software. Adobe’s new AI tools, particularly the Generative Extend feature in Premiere Pro, show promise in simplifying minor video edits. Extending clips and adjusting audio can be time-consuming, and these tools could save creators a lot of effort. However, the usefulness of these features is still somewhat limited. Extending video by just two seconds or audio by ten seconds may not always be enough for more complex edits, and the current inability to handle spoken dialogue or music limits its scope for professional use. As AI technology develops, Adobe will need to ensure these tools can handle larger-scale edits and more intricate video tasks to appeal to a broader user base.
Also Read: Microsoft’s VP of GenAI Research Will Join OpenAI in Major AI Shift.
