AI Speed Box

AI News and Information Link Collection (Mintbear's ignorant scraps, matured to become Visual AI News)
All
AI Image
AI Video
AI Sound
AI LLM
AI 3D
AI
AR, XR, VR
AI Toons
AI SNS

Adobe Video AI: FIREFLY! Adobe has launched Video AI.

Category
  1. AI Video
Gen
  1. Adobe Firefly
Date
2025/02/12
Summary 🍀🧸
Finally, today, Adobe Firefly: Video AI is released.

A video AI model has finally been introduced to Firefly, an existing image generation AI model, which can create video content based on text or images.

The reason I'm interested is because: Adobe Photoshop, which is used by almost every designer on the planet, and it will also be integrated into Adobe Premiere Pro, a video editing program.

In fact, data linking between tools is possible with Creative Cloud, and various demonstrations were shown in conjunction with Photoshop, Premiere Pro, AfterEffect, and Express.

Adobe Firefly is stable even in copyright issues thanks to internal learning data. Let's check it out.
URL
https://firefly.adobe.com/upload/video-generation
URL
https://projectneo.adobe.com/
Informer
Report: Picassong
2025.02.13 AM 06 Mint Bear 🍀🧸
Finally, today, Adobe Firefly: Video AI is released.
The existing image generation AI model Firefly has finally introduced a video AI model, which can create video content based on text or images. This model was released as a beta version on February 12, 2025, and as expected from Adobe! It provides a commercially safe and IP (intellectual property) friendly video creation tool.

Why it matters: Because it's 'Adobe', which is what all designers use.

The reason I am paying attention is: It is used by almost every designer on the planet. Because of Adobe Photoshop .
And a video editing program
Because it will also integrate with Adobe Premiere Pro .
In fact, data linking between tools is possible with Creative Cloud, and various demonstrations were shown in conjunction with Photoshop, Premiere Pro, AfterEffect, and Express.
Then from image editing tools to video editing tools,
and
Let's check out the Adobe video, Firefly story, which is planning an all-in-one AI platform .
First, I will talk about the basic functions below, and I will continue to update you with attractive use cases through live demonstrations.
Pikachu-nim told me the fastest thing during the night, so I checked it right away. ^^

01. Adobe Firefly

It's a paid model. 😂 The subscription fee is a burden, but I've summarized it below.
Firefly is a multimodal AI platform that can handle images, vectors, video, and audio in a single space.
For example, first create an image with 📝 text → 🎨
🎨 Convert images to 🎥 videos, or 🔊 translate audio to 🌏 multiple languages.
The Firefly Video Model enhances your video creation and editing workflow.
Previously, you could only create images, but now you can also create videos and use them in conjunction with audio.

02. Text & Image Based Video Generation (T2V & I2V)

Users can generate videos by entering text prompts (up to 1,000 words) or reference images. Korean works, but I tested it and found some translation errors. English prompts are the default.
From the left menu, you can choose a camera angle (e.g. aerial, eye level, top down) and shot size (close up, medium, long shot), and even apply motion effects like zooming or panning.
You can create video clips by specifying the desired style and camera angle with a simple text prompt.
You can import images that have already been created and naturally convert them into videos, or specify keyframes at the start/end points for more precise control.
Powerful object and background creation capabilities allow you to quickly create B-roll or specific scene sections, reducing video production time.

03. Scene to Image & Detailed Image Control

A Scene to Image function has been added, which allows you to create a structural scene composition using 3D objects and then generate an image based on it.
You can specify the composition, lighting, style, etc. in more detail, so you can create the image you want as if you were designing it yourself.
The Text to Image interface has been revamped to make it much easier to review, edit, and recreate your creations.
You can create 2D and 3D animations, and even create atmospheric elements such as weather effects and particle effects.
Integrate with existing Adobe tools like Adobe Premiere Pro to streamline your workflow.

04. Extended Creative Cloud Integration

It’s tightly integrated with key Creative Cloud apps like Photoshop and Premiere Pro, so you can immediately import images and videos created in Firefly for further editing.
Your creation history is stored in the cloud, so you can retrieve and edit your previous work at any time.
By linking with the photo editing (Generative Fill) or Lightroom (Generative Remove) function, you can freely edit across boundaries between images and videos.

05. Audio Translation & Lip Sync

New audio features, Translate and Lip Sync, let you quickly translate your video's audio into multiple languages and automatically match mouth shapes.
Useful for video dubbing or overseas marketing, the Lip Sync feature is currently only available to enterprise customers.

06. Commercial Safety and Ethical AI Development

Firefly uses only public domain or licensed content as training data, and the generated content includes metadata (Content Credentials) indicating that it was created by AI.
Learn only with Adobe Stock and public domain content so you can use it for commercial projects without IP issues.

07 Technical Specifications

It currently supports 1080p resolution, with 4K resolution support planned for the future.
The default frame rate is 24fps, and the aspect ratio is set to 16:9 by default. Portrait 9:16 is optional.

FireFly UI

Various convenient functions are provided in the left menu.
1.
Aspect ratio
a.
Widescreen 16:9
b.
Vertical 9:16
2.
Camera
a.
Shooting Size: Extreme Close-up, Close-up Shot, Mid-Up Shot, Long Shot, Extreme Long Shot
b.
Camera angles: aerial, eye level, high angle, low angle, low angle, top down
c.
Movement: zoom in, zoom out, pan left, pan right, tilt up, tilt down, static, handheld camera effect
3.
Advanced Settings
a.
Seed number (for generating similar videos)
🍀
I think the camera control menu provided by Firefly is well organized with the most core keywords.

Starting from the past Gen-3, Luma, Kling and recently Hailuo have added 'camera control' function to video creation and provided more attractive and easy interface.

I think the camera controls provided in Firefly this time are the most cleanly organized in core terms. I'll have to use this structure and keywords in this video basics.

- Mint Bear

Subscription Fee

User 1. Existing paid Creative Cloud user

Existing paid Creative Cloud subscribers are given limited credit to test some of Firefly’s features, but using the core features of the Firefly Video Model (such as text-to-video creation) requires a separate Firefly subscription.
Existing Creative Cloud plans generally use credits only for image and vector creation, while video and audio creation requires an additional Firefly plan subscription.
However, I am a paid subscriber to Creative Cloud Pro and it is not being created properly, so I will check and update.

User 2. Separate subscription

1️⃣ Firefly Standard Plan: $9.99/month (about 13,000 won) / or $99.99/year

Credits provided: 2,000 per month
Videos you can create: Up to 20 5-second 1080p videos / 100 at 540p
(For the time being, I think it will be possible to create 100 1080p as well.)

2️⃣ Firefly Pro Plan: $29.99/month / or $299.99/year

Credits provided: 7,000 per month
Videos you can create: Up to 70 5-second 1080p videos / 700 at 540p

3️⃣ Firefly Premium Plan: Coming soon (pricing and credit information not yet disclosed).

How to spend credit
Video Creation: Costs 20 credits per second (will increase to 100 credits per second in the future).
For example, to create a 5-second video, you will need a total of 100 credits.
The Firefly Standard plan lets you create up to 20 1080p 5-second videos per month.
The Pro plan allows up to 70.
The Premium plan will be launched as an option for high-frequency users.

Adobe Firefly Samples & Demos

Check out the samples and demonstration cases below, which will continue to be updated today.

Reference

👍