Adobe’s New Project Music GenAI Control Prototype Helps Users Craft Music with Ease

With every passing day, continuous new AI tool releases are becoming the norm, as Abode has just unveiled its new Project Music GenAI Control prototype. As a company with a decade-long legacy of AI innovation in Firefly, its family of generative AI models, the company has become the most popular AI image generation model designed for safe commercial use in record time globally.

Explore the future of sonic creativity 🔊 with Project Music GenAI Control! Emerging experimental tech from the Adobe Research team can create audio tracks using text prompts and even transform your music based on reference melodies. Learn more: https://t.co/hy9J4qOXfO pic.twitter.com/6HBBIxsptF

— Adobe (@Adobe) February 28, 2024

Today, at the Hot Pod Summit in Brooklyn, Adobe announced its own spin-off for GenAI-powered music editing and creation tools, codenamed Project Music GenAI Control. According to the company, Project Music GenAI Control is a new prototype tool that allows users to generate music using text prompts and edit said audio without leaving their Adobe app and into some other dedicated editing software.

In the words of Gautham Mysore, Adobe’s head of audio and video AI research: “So this really gets the idea of AI generating music with you in the director’s seat, and there’s a bunch of things you can do with it. Project Music GenAI Control is generating music, but it’s also giving you various forms of control to try things out. You don’t have to be a composer, but you can get your musical ideas out there.”

Also Read: Sora: OpenAI’s New AI Tool Can Instantly Create Videos From Text Prompts

Project Music GenAI Control Is Like a Pixel-Level Control for Music

From their announcement, we know that to begin generating music with Project Music GenAI Control, users must input a text description depicting the genre in a specified style, such as happy dance or sad jazz. After completing the initial stage, the tool will offer other integrated editing controls to allow users to customise their AI creations, like adjusting elements like tempo and intensity and controlling things like patterns and structure.

Moreover, Project Music GenAI Control can extend the track to an arbitrary length, remixing music or creating an endless loop if you want to make it long enough for things like a fixed animation or podcast segments. If their promises hold true, it is a crazy accomplishment, as instead of manually cutting existing music to make intros, outros, and background audio – Project Music GenAI Control could help users create precisely the pieces they need while solving workflow pain points end-to-end.

In a press release, Nicholas Bryan, a senior research scientist at Adobe Research, stated: One of the most exciting things about these new tools is that they aren’t just about generating audio. They’re taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio. It’s a kind of pixel-level control for music.”

Will Project Music GenAI Control Face Copyright Issues? 

While the features are enticing and could prove a game changer, GenAI music tools and GenAI tools broadly are raising ethical and legal concerns as AI-created music, artwork, and text proliferate. For example, a federal judge ruled in August last year that AI-generated art can’t be copyrighted. 

However, since the U.S. Copyright Office hasn’t taken a firm stance yet besides seeking public input on copyright issues, it has not stopped GenAI from conjuring familiar sounds, lyrics and vocals to the original’s dismay. Thus, where does this apply to Adobe’s Project Music GenAI?

If you recall, Adobe has shared that this new Project Music GenAI tool is under development in collaboration with the University of California and the School of Computer Science at Carnegie Mellon University, meaning the training sources are from public domains. 

Despite this, with the latest reports from the Verge, Adobe has not expanded upon where their audio source is from and clarified how this would work exactly, particularly if popular, licensed, and copyright-protected music are part of the training material in this tool. Therefore, it remains a mystery whether Adobe violates copyright law if it tries to commercialise music generated in other artists’ styles.

Related: New York Times Faces Resistance as OpenAI Dismisses Copyright Lawsuit Claims

Adobe’s Response to Copyright Claims

In an article with TechCrunch, Mysore stated that Adobe, as a general rule, develops its GenAI tools against data under licence or in the public domain to avoid potentially running afoul of IP issues. While he did not explicitly follow up on Project Music GenAI Control training data, he stated that the company is working on watermarking technology to help identify audio produced by Project Music GenAI Control as it is still early doors and a long-term process.

As a final parting note, Mysore reinstated: “Adobe takes a particularly responsible approach to these things. There are many great musicians making this content, and I think they and tools like Project Music GenAI Control will coexist. There’s going to be new musical ideas that come out.”

For follow-ups regarding Project Music GenAI Control’s availability or other AI, tech and gaming articles, follow our Facebook social page for the fastest updates and coverage of the trending news on your feed.