Grace Yee, Senior Director of Ethical Innovation AI Ethics and Accessibility at Adobe Interview Series

Adobe’s Claims Next Generative AI Features Will Be Commercially Safe

Speaking of “early access” features, Adobe introduced AI-powered Lens Blur as an early access tool last year. With today’s Lightroom ecosystem update, it is finally available to everyone, no strings attached. For those who want it, it’s available in all versions of Adobe Lightroom beginning today as an “early access” feature. While it’s easy to think about “generative AI” in terms of adding something to a scene, it also makes sense for removal, as to do so convincingly, new pixels must be made to replace what is taken out of the frame.

By being open about our data sources, training methodologies, and the ethical safeguards we have in place, we empower users to make informed decisions about how they interact with our products. This transparency not only aligns with our core AI Ethics principles but also fosters a collaborative relationship with our users. Adobe could improve the user experience dramatically by simply including the reason a generation gets flagged as a guideline violation. They request we use their feedback system when this happens, but don’t give us any feedback in return.

Make sure you’re running the right version

There, a user’s remaining number of generative credits is shown and it reloads in real-time. There is no indication inside any of Adobe’s apps that tells a user a tool requires a Generative Credit and there is also no note showing how many credits remain on an account. Adobe’s FAQ page says that the generative credits available to a user can be seen after logging into their account on the web, but PetaPixel found this isn’t the case, at least not for any of its team members.

The future of content creation and production with generative AI – the Adobe Blog

The future of content creation and production with generative AI.

Posted: Wed, 11 Dec 2024 08:00:00 GMT [source]

The Firefly Video Model (beta) is set to extend Adobe’s family of generative AI models and make Firefly one of the most comprehensive model offerings for creative teams. It is available today through a limited public beta with the goal of garnering feedback from small groups of creative professionals. Adobe is upgrading those existing capabilities to a new AI model called the Firefly Image 3 Model. According to the company, the update will improve both the quality and variety of the content that the features generates.

Adobe’s new AI tools will make your next creative project a breeze

By Jess Weatherbed, a news writer focused on creative industries, computing, and internet culture. To its credit, two of the three options Generative Remove suggested did provide usable alternatives. Unfortunately, the Bitcoin option was the first one, which (whether Adobe intends this or not) tells an editor that it is what the platform feels is the best result. While this kind of makes sense if you don’t think about it too hard, it also is completely counterintuitive to the concept of the name of the tool and the result an editor is expecting. “Select the entire object/person, including its shadow, reflection, and any disconnected parts (such as a hand on someone else’s shoulder). For example, if you select a person and miss their feet, Lightroom tries to rebuild a new person to fit the feet,” the article reads.

«It’s another way to penetrate and radiate the user base,» Gartner analyst Frances Karamouzis said. The new Media Intelligence tool in Premiere Pro follows the introduction of other AI-driven features including Firefly-powered Generative Extend. If I am selecting a body part and asking a tool to fill or remove that space, zero percent of the time would I want it to replace my selection with its eldritch nightmare version of that exact same thing. What I, and any editor doing this, want is for what is selected to be removed as seamlessly as possible. GPU-accelerated, AI-powered video retiming tool can now be used without a host app, for under half the price of a regular plugin license. Internally, IBM is also using Adobe Firefly to streamline workflows, leveraging generative art, Photoshop, Illustrator, and Firefly’s AI capabilities.

Generative Extend is coming to the Adobe Premiere Pro beta

That’s an existing Illustrator feature for creating scalable vector, or easily resizable, versions of an image. According to Adobe, its engineers have enhanced the visual fidelity of the feature’s output. Or perhaps someone likes the look of an image but wishes that the subject were somewhere else in the frame.

• Leading enterprises including the Coca-Cola Company, Dick’s Sporting Goods, Major League Baseball, and Marriott International currently use Adobe Experience Platform (AEP) to power their customer experience initiatives.
• “Dubbing and Lip Sync” can translate and edit lip movement for video audio into 14 different languages, and a new InDesign tool can automatically format text and images for print and digital media using predefined templates.
• One of the biggest announcements for videographers during Adobe Max 2024 is the ability to expand a clip that’s too short.
• Illustrator and Photoshop have received GenAI tools with the goal of improving user experience and allowing more freedom for users to express their creativity and skills.

My advice would be to begin by establishing clear, simple, and practical principles that can guide your efforts. Often, I see companies or organizations focused on what looks good in theory, but their principles aren’t practical. The reason why our principles have stood the test of time is because we designed them to be actionable.

Adobe Firefly Feature Deep Dive

Firefly is featured in numerous Adobe apps, including Photoshop, Express, and Illustrator, and with the introduction of the Firefly Video Model (beta), it is coming to Premiere Pro, Adobe’s venerable video editing software. At the heart of Adobe’s announcements is the expansion of its Firefly family of generative AI models. The company introduced a new Firefly Video Model, currently in beta, which allows users to generate video content from text and image prompts.

While the company was not proactive about alerting users to this change, Adobe does have a detailed FAQ page that includes almost all the information required to understand how Generative Credits work in its apps. As of January 17, Adobe started enforcing generative credit limits “on select plans” and tracking use on all of them. When it comes to generative artificial intelligence (AI), one company that has been at the forefront on the software side is Adobe (ADBE -0.43%). The company has added a number of AI-related features to both its Creative line of products, such as Photoshop, and its Acrobat-led Document Cloud business. Since many mobile devices shoot HDR photos, software has continually expanded its support for HDR image editing, Lightroom among them. With HDR Optimization, Lightroom users can achieve brighter highlights, deeper shadows, and more saturated colors in HDR photos.

For Creative Bloq, Ian combines his experiences to bring the latest news on digital art, VFX and video games and tech, and in his spare time he doodles in Procreate, ArtRage, and Rebelle while finding time to play Xbox and PS5. As some examples above show, it is absolutely possible to get fantastic results using Generative Remove and Generative Fill. But they’re not a panacea, even if that is what photographers want, and more importantly, what Adobe is working toward. There is still need to utilize other non-generative AI tools inside Adobe’s photo software, even though they aren’t always convenient or quick. As its name suggests, Generative Remove generates new pixels using artificial intelligence.

Adobe’s Claims Next Generative AI Features Will Be ’Commercially Safe‘

The new AI features will be available in a stable release of the software “later this year”. Generate Similar, shown above, automatically generates variations of a source image, making it possible to iterate more quickly on design ideas. Users can guide the output by entering a brief text description, with Photoshop automatically matching the lighting and perspective of the foreground objects in the content it generates. In Photoshop 25.9, they are joined by the ability to create entire images from scratch, in the shape of new text-to-image system Generate Image.

«Think of these ‘controls’ as the digital equivalent of the paintbrush in Photoshop,» says Alexandru. If you’re a digital artist fed up with hearing prompt jockeys tell you to get over generative AI art’s impact, then Alexandru Costin, Vice President of Generative AI and Sensei at Adobe, has some good news for you as we begin 2025. Get the latest information about companies, products, careers, and funding in the technology industry across emerging markets globally. I suspect this may be for similar reasons, that Stable Diffusion XL (SDXL) works best in 1024 pixel aspect ratios. I’ve found that limiting the expand or fill areas to 1024 pixels improves results.

The company sees this tool as helpful in creating storyboards, generating B-roll clips, or augmenting live-action footage. Labrecque has authored a number of books and video course publications on design and development technologies, tools, and concepts through publishers which include LinkedIn Learning (Lynda.com), Peachpit Press, and Adobe. He has spoken at large design and technology conferences such as Adobe MAX and for a variety of smaller creative communities.

• Even if the company isn’t enforcing these limits yet, it didn’t tell users that it was tracking usage either.
• «I think Adobe has done such a great job of integrating new tools to make the process easier,» said Angel Acevedo, graphic designer and director of the apparel company God is a designer.
• At Sundance 2025 in Utah, the creative tech giant has announced a new AI-powered Media Intelligence tool that automatically analyses visuals across thousands of clips in seconds.
• In Q4 of last year, the company generated $569 million in new digital media ARR, so this would be a deceleration and could lead to lower revenue growth in the future.

Further, Firefly offers a variety of camera controls, including angle, motion, and zoom, enabling people to finetune the video results. It’s also possible to generate new video using reference images, which may be especially helpful when trying to create B-roll that can seamlessly fit into an existing project. Adobe is one of several technology companies working on AI video generation capabilities. OpenAI’s Sora promises to let users create minute-long video clips, while Meta recently announced its Movie Gen video model and Google unveiled Veo back in May. It is available today through a limited public beta to garner initial feedback from a small group of creative professionals, which will be used to continue to refine and improve the model, according to Adobe.

They utilize AI to significantly speed up and improve image editing without taking control away from the photographer. To address this, Adobe founded the Content Authenticity Initiative (CAI) in 2019 to build a more trustworthy and transparent digital ecosystem for consumers. The CAI implementsour solution to build trust online– called Content Credentials. Content Credentials include “ingredients” or important information such as the creator’s name, the date an image was created, what tools were used to create an image and any edits that were made along the way.

The Generate Similar tool is fairly self-explanatory — it can generate variants of an object in the image until you find one you prefer. Adobe is upgrading its Premiere Pro video editing application with a generative AI model called the Firefly Video Model. It powers a new feature called Generative Extend that can extend a clip by two seconds at beginning or end. These latest advancements mark another significant step in Adobe’s integration of generative AI into its creative suite.

This upcoming tool takes the power of everything seen in Adobe Firefly AI functions and applies it to generative video. It works incredibly well, even tracking objects that move against similarly toned or colored backgrounds. Photoshop’s latest AI features bring in more precise removal tools, allowing you to brush an area for Photoshop to identify the distraction and remove it seamlessly.

Adobe’s CFO: Agentic AI is a ‘natural evolution’ for the company – Fortune

Adobe’s CFO: Agentic AI is a ‘natural evolution’ for the company.

Posted: Fri, 24 Jan 2025 11:58:00 GMT [source]

Its Content Credentials watermarks are applied to whatever the video model outputs. In Firefly Services, a collection of creative and generative APIs for enterprises, Adobe unveiled new offerings to scale production workflows. This includes Dubbing and Lip Sync, now in beta, which uses generative AI for video content to translate spoken dialogue into different languages while maintaining the sound of the original voice with matching lip sync.

In addition, he is the founder of Securities.io, a platform focused on investing in cutting-edge technologies that are redefining the future and reshaping entire sectors. As generative AI continues to scale, it will be even more important to promote widespread adoption of Content Credentials to restore trust in digital content. For those seeking more control, consider exploring tools like Stable Diffusion and ComfyUI. While they have a steeper learning curve and require a GPU with at least 6-8GB of VRAM, they can easily blow Photoshop out of the water.

While a lot of the focus has been on generative AI, Adobe continues to roll out workflow-focused AI features across its Creative Cloud suite too. I’d argue this increase is mostly coming from all the generative AI investments for Adobe Firefly. But speak to serious photographers who use Lightroom and Photoshop for editing their photos, and I’d be willing to wager that most of them don’t need any of the generative tools that Adobe wants to sell to us via this price increase.

Indian consumers lead APAC in Generative AI expectations: Adobe Study

Dear Adobe: Give Us A Photography Plan Without AI

Additionally, the model can produce atmospheric elements like fire, smoke, and water, thereby enhancing video compositing options. While not revolutionary, this capability does add flexibility to Adobe’s video editing suite. Also, just like other existing generative video tools, Firefly supports various camera movements and angles.

Adobe’s AI and the Creative Frontier Study reveals creators’ views on the opportunities and risks of generative AI – the Adobe Blog

Adobe’s AI and the Creative Frontier Study reveals creators’ views on the opportunities and risks of generative AI.

Posted: Tue, 08 Oct 2024 07:00:00 GMT [source]

Don’t get me started on services, doctors, and anyone else who bar access unless you giving up your personal information. Adobe, on two separate occasions in 2013 and 2019, has been breached and lost 38 million and 7.5 million users’ confidential information to hackers. Generative Fill is part of the new Adobe Photoshop hotness coming as a result of Adobe’s Firefly and Sensei artificial intelligence (AI) efforts.

Now you can share images, files, and YouTube videos to Gemini Live

Clicking on the Report option will summon a similar form to that of additional feedback, but the options will, of course, be different. This is always a negative action – meaning that you find the results offensive or inappropriate in some way. Giving a simple thumbs-up or thumbs-down is the most basic level of feedback and is meant to rate the results of your prompt.

• They don’t offer solutions, and instead dismissively point frustrated users towards the Report tool.
• This is always a negative action – meaning that you find the results offensive or inappropriate in some way.
• Have your say on this story by following CG Channel on Facebook, Instagram and X (formerly Twitter).
• Further, like every other Adobe Stock asset, anything created or changed using AI is designed to be commercially safe and backed by IP indemnification (for eligible customers).

Indeed, we follow strict guidelines that ensure our editorial content is never influenced by advertisers. AI isn’t all that it’s cracked up to be, but some AI Photoshop tools are actually helpful. Attackers also use legitimate tools like ChatGPT to attempt to bolster their cybercrime activities, with OpenAI disrupting activity by malware developers and state-sponsored actors last year. Malicious LLMs have been promoted since at least mid-2023, when tools like the malware-focused WormGPT and the phishing-focused FraudGPT gained attention for lowering the bar for less-skilled attackers to conduct more sophisticated attacks.

Adobe

Also, Adobe is rolling out Text to Video and Image to Video, also powered by the Firefly Video Model, in a limited public beta in the Firefly web app. Text to Video lets video editors generate video from text prompts, access camera controls and use images for B-roll footage generation. “Creative Cloud has always had a rich partner and plugin ecosystem, and this evolution expands Premiere Pro as the most flexible, extensible professional video tool that fits any workflow. Adobe also believes Pika Labs’ generative video tools may work alongside Adobe Generative Extend.

“Bulk Create, Powered by Firefly Services” is also now in beta and will let professioonals edit large volumes of images more efficiently, streamlining tasks such as resizing or background removal. Adobe is making some new developer APIs for Firefly Services generally available in the coming weeks that developers can use to speed up video and print production workflows. “Dubbing and Lip Sync” can translate and edit lip movement for video audio into 14 different languages, and a new InDesign tool can automatically format text and images for print and digital media using predefined templates. “Digital avatars” created using text descriptions and voice recordings will also be available in beta this month, which can be used to present videos and product explainers.

You can choose Expand selection in the Contextual Taskbar if you use Select subject or the Quick Selection tool to make your initial selection. Create a new layer and black out areas you don’t want Generative Fill to see by using a Rectangle tool or Brush tool. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.

How Oracle Consultancy Will Enhance IBM’s Cloud Capabilities

It’s being selective about how it integrates AI, using it to solve common editing issues that require a lot of manual editing to fix. By focusing on these quality-of-life updates, Adobe is hoping to endear its creators with generative AI. Other innovations in Illustrator include the Dimension Tool, Mockup, Contextual Taskbar, Retype, plus enhanced selection tools.

Generative AI at Adobe took off in 2023 with the introduction of its Firefly image generator and popular tools like generative fill in Photoshop. Its path here hasn’t been totally error-free — an unclear terms of service update this summer left people worried Adobe could scan every one of their projects, for one. Now, Adobe hopes to introduce a new kind of AI alongside its text-to-image tech, which is most popular in other AI products. Earlier this year, Adobe announced a new set of features coming to the Firefly Video Model and Premiere Pro. This new preview shows off the capabilities and tries to reassure customers that the features are «commercially safe» to use. AI-powered “Object Addition and Removal” will allow users to select and track objects and replace them in their footage.

Adobe’s AI models are only trained on Adobe Stock and other publicly licensed databases, not on users’ content or pulled from the open web. Firefly is commercially safe, meaning creators own the images they generate and can use them in business. Firefly’s upcoming video generation capabilities will make it the first publicly available commercially safe video model.

Lazy AI prompts are dead – we’re on the threshold of the «Controls Era» says Adobe

He writes news, features and buying guides and keeps track of the best equipment and software for creatives, from video editing programs to monitors and accessories. A veteran news writer and photographer, he now works as a project manager at the London and Buenos Aires-based design, production and branding agency Hermana Creatives. There he manages a team of designers, photographers and video editors who specialise in producing visual content and design assets for the hospitality sector. Since Firefly’s first beta in March 2023, users have generated more than 13 billion images, six billion of which were created in the last six months.

The Photoshop and Illustrator enhancements are joined by a new version of the company’s InDesign tool. Designers mainly use it to create visual assets such as brochures that contain a significant amount of text. As part of today’s update, the application is receiving a kind of visual autocomplete tool called Generative Expand that can make an image larger by filling the empty space around it with new content. When the feature is active, the underlying AI model automatically finds a list of objects that the user may wish to remove from an image. Distraction Removal might, for example, highlight overhead wires in a photo of an office building.

Bringing generative AI to video with Adobe Firefly Video Model – the Adobe Blog

Bringing generative AI to video with Adobe Firefly Video Model.

Posted: Wed, 11 Sep 2024 07:00:00 GMT [source]

He is also the founder of Fractured Vision Media, LLC; a digital media production studio and distribution vehicle for a variety of creative works. One of the most highly anticipated features is Generative Extend in Premiere Pro (beta), which uses generative AI to seamlessly add frames to the beginning or end of a clip. Powered by the Firefly Video Model, it’s designed to be commercially safe and only trained on content Adobe has permission to use, so artists can create with confidence.

Adobe scrambled to patch things up, tweaking their terms of service, but the damage was done. Their reputation took a beating, especially given the groundswell of anti-AI sentiment in creative circles. Content creators, from YouTube stars to industry analysts, raised their voices against the company—even recommending ditching the suite in favor of less popular (but more pro-creator, anti-AI) competitors.

New Generate Image feature generates entire images from text prompts The new public beta continues the rollout of features powered by Firefly, Adobe’s generative AI platform, inside Photoshop. Everyone talks about scaling content creation, but what really transforms your business is scaling analytics. Content metadata analytics will be the center of our future content supply chain process. It’s how we’re going to get that feedback loop that continues to improve the content we create so we can deliver more effective and on-brand visuals to better engage with our customers. To accelerate creative workflows, Illustrator now has new tools including an all-new beta Generative Shape Fill so designers can quickly add detailed vectors to shapes by entering text prompts directly in the Contextual Taskbar.

Adobe Defends Data Usage

Check out the latest beta features in the compositing and motion graphics app, including the option to preview HLG and PQ video. It lets users apply non-destructive adjustments to images, including Brightness/Contrast, Exposure, Vibrance and Hue/Saturation, by painting them on directly, as shown above. IBM is experimenting with Adobe Firefly to optimize workflows across its marketing and consulting teams, focusing on developing reliable AI-powered creative and design outputs. Information in Investor’s Business Daily is for informational and educational purposes only and should not be construed as an offer, recommendation, solicitation, or rating to buy or sell securities. The information has been obtained from sources we believe to be reliable, but we make no guarantee as to its accuracy, timeliness, or suitability, including with respect to information that appears in closed captioning.

“We are committed to continually improving our plans to meet the needs of all creative users, from enthusiasts to professionals. The Adobe Creative Cloud Photography plan has embraced the latest advancements in digital imaging and continues to be a powerful solution for editing, organizing, storing, and sharing images for anyone interested in photography. Last year, Adobe updated its Firefly generative AI platform multiple times, the most recent coming in September. Over that time, the Lightroom and Photoshop tools that rely on the technology have gotten steadily worse and the system’s choice to add a Bitcoin logo to a photo of a seagull is a perfect distillation of the problem.

He holds a bachelor’s degree in communication from Worcester State University and a master’s degree in digital media studies from the University of Denver. The alternative set of controls numbers only two – but they are both very powerful. Once you declare a favorite, the heart icon will appear filled and the control will allow you to un-favorite the selected image instead. Note that Content Credentials are applied in this case just the same as they are when downloading an image.

As well as being able to comment on stories, followers of our social media accounts can see videos we don’t post on the site itself, including making-ofs for the latest VFX movies, animations, games cinematics and motion graphics projects. Enhance Detail is a more conventional image-enhancement option, albeit an AI-based one, improving the “sharpness and clarity” of the content generated. The first two Firefly tools – Generative Fill, for replacing part of an image with AI content, and Generative Expand, for extending its borders – were released last year in Photoshop 25.0. They include Generate Image, a complete new text-to-image system, and Generate Background, which automatically replaces the background of an image with AI content. The partnership also aims to incorporate AI into SAP’s business workflows within industry-specific cloud solutions and applications for various business lines.

From there, we developed a robust review process to identify and mitigate potential risks and biases early in the AI development cycle. This multi-part assessment has helped us identify and address features and products that could perpetuate harmful bias and stereotypes. Generative Expand can sometimes provide enough additional context for generative fill in another area to work better. Cropping problematic or unwanted elements out of the image can remove potential guideline violation triggers.

Leave out the Generative Remove AI feature which looks like it was introduced to counter what Samsung and Google introduced in their phones (allowing you to remove your ex from a photograph). And I’m certain later this year, you’ll say that I can add butterflies to the skies in my photos and turn a still photo into a cinemagraph with one click. Alongside just removing the background, users can also set the tool to replace backgrounds with a specific image or color (defined by HEX codes) to get variations of each image that are ready for further editing. The file batches can be saved as either PNG or JPEG for now, with Adobe saying that support for Photoshop PSD files will be added in the future. Adobe Firefly Video Model is available in a limited public beta today through the Firefly web app, including text-to-video and image-to-video capabilities. Adobe continues to roll out more AI tools across its Creative Cloud family of apps with the announcement that Adobe Illustrator and Photoshop now have accelerated creative workflows that give users more control.

«We wouldn’t have all of this AI everything if there weren’t actual artists who were designing and uploading images, or if there weren’t actual copywriters’ writing to feed these models,» said Fong. «It’s really important to acknowledge that where the basis comes from is real people and their real ideas.» «It’s important for images to be explicit in that they are AI-generated,» said Erin Fong, a fine artist who uses Adobe for her marketing. «Information travels so fast these days … some people probably don’t know AI can generate things like that.»

Sometimes, roughly circling the general area that you want to fill works better than tracing the outline of something. Copy and paste something from another area of the image or from a stock image to cover a problem area. For example, in an outdoor photo, cover a subject or part of a subject with a tall shrub from a stock image. Using the Clone Stamp tool to roughly cover potential problem areas can sometimes work better than blacking them out.

On its earnings call, the company highlighted both future AI innovation and ways for it to help drive growth from both a marketing and monetization perspective. Clicking upon the Show similar control will retain the particular, chosen image while regenerating the other three to be more in conformity with the image specified. Clicking the Submit to Firefly gallery option will summon a submission overlay through which you can request that your image is included in the Gallery. Starting at the left-hand side of this group of controls, we begin with an ellipse that represents Options which, when clicked, will summon a small overlay with additional choices.

«Where they become financially competitive is just how much harder they are down the road in understanding what enterprises want when it comes to AI image and video generation,» she said. «If you are a business looking to utilize AI, whether it’s image generation or the new generation, you are going to have to ask yourself some tough questions about what you willing to risk in an age where people like to get litigious.» The study, which analyzed tens of thousands of prompts, revealed that nearly 8.5% of business users may have disclosed sensitive information, with 46% of these incidents involving customer data such as billing and authentication details. Have your say on this story by following CG Channel on Facebook, Instagram and X (formerly Twitter).