Technology

Adobe Premiere Pro: Crafting Visuals Seamlessly with AI

Published October 15, 2024

In the fast-paced world of filmmaking, timing can be everything. While editing a scene, a director and video editor might find that the footage is three or four seconds too short. This can lead to moments where the main character's expression or action needs to linger a little longer to make an impact. However, what if the crew has already moved on to their next project? In the realm that Adobe is developing, this dilemma may soon be a thing of the past.

Adobe has now unveiled a solution with Premiere Pro. Editors can swiftly adjust the length of a scene by dragging it to the right, and with a simple click, the AI within the software will generate the necessary extension for the scene. This innovative approach is part of Adobe’s ongoing efforts showcased during their creativity conference, Adobe Max, where they announced the beta launch of Premiere Pro’s new functionality powered by the Firefly Video Model.

Enhancements and New Features

Adobe is committed to improving the performance and user experience of Premiere Pro. Among the fresh features now available to users is the Generative Extend tool, which addresses a common challenge in video editing. This tool simplifies the process for video professionals to extend clips, fill gaps in footage, create smoother transitions, and maintain the perfect timing in their edits. The improvements in Premiere Pro promise to triple export speeds and introduce a color management system, an enhanced 3D workspace, and powerful metadata and asset workflows across Adobe’s suite of products, including After Effects and Frame.io.

Collaborative Development and Real-World Solutions

According to Ashley Still, Adobe’s Senior Vice President of Digital Media, the company believes that the Firefly Video Model will transform video editing in ways that professionals will appreciate. Throughout the past year, Adobe has worked closely with professional video editors to understand how generative AI could tackle real-life challenges faced during the editing process.

One significant challenge identified was the need to enhance existing clips by adding frames to extend a shot or modify a transition. The Firefly-powered Generative Extend tool is designed specifically for this, allowing users to generate new frames at either the beginning or end of a clip to make clips last just a bit longer. This tool can also be used to extend audio clips, creating ambient ‘room tone’ that aids in smooth audio edits. Adobe has ensured that its new Firefly Video Model is safe for commercial use.

AI Ethics and Content Integrity

Adobe has trained its generative AI models using licensed content, like that available through Adobe Stock, as well as materials from the public domain. The company has instituted an AI Ethics Impact Assessment to guarantee that its features align with principles of accountability, responsibility, and transparency. Additionally, Adobe has incorporated Content Credentials, comparable to a ‘nutrition label’ for digital content, to clarify how the content was created and altered. This labeling applies to selected features powered by Firefly, such as Generative Extend.

Expanded Camera Support and Public Beta

Adobe has also increased its support for various camera brands including Canon, Sony, ARRI, and RED, allowing users to import native files for editing right away. The Firefly Video Model is currently in limited public beta, available at firefly.adobe.com. During this phase, the generation services are offered free of charge. More information regarding pricing and features will be provided as the model transitions out of the public beta stage.

Adobe, Editing, AI