Adobe announced Plans to add generative AI capabilities to Premiere Pro later this year. The new tools will be based on Adobe’s Firefly AI model and partnerships with several popular AI companies such as OpenAI, Pika Labs and Runway ML.

New Firefly video features will include the ability to add or remove objects in video clips using natural language prompts. Users will also be able to extend the length of the videos by instructing the AI ​​model to generate more semantically consistent content. All videos created by these tools will be automatically tagged with Adobe’s content certifications, providing transparency of AI-generated parts.

• Generative Extend: Add frames seamlessly to make longer clips, so it’s easier to time edits perfectly and add smooth transitions.
• Adding and removing objects: Simply select and track objects, then replace them.
• Text to video: Create brand new clips directly within Premiere Pro. Just type text in the prompt or upload reference images.

One of the most anticipated integrations will be with OpenAI’s Sora. In recent weeks it has gained popularity for creating high-resolution photorealistic images and videos from text commands. By providing direct access to Sora and other third-party models, Adobe will give users a much wider range of generative tools to choose from.

In May, Adobe will also introduce an improved audio workflow in Premiere Pro. The company says users will benefit from more powerful and intuitive tools for controlling every aspect of sound.

While Adobe hasn’t announced a specific release date, it has confirmed that the new video editing tools will debut sometime this year. Pricing details have not been finalized, but the tools will likely use Adobe’s existing Creative Credits system, which renews monthly based on Creative Cloud subscription level.

In case you missed it, Adobe announced the commercial launch of Firefly late last year. The tool is now available for Photoshop, Illustrator and Express users.