Project Music GenAI Control enables creators to generate music from text prompts and provides fine-grained editing control for precise customization. (Source: Image by RR)

Adobe’s Latest AI Tool Revolutionizes Music Creation and Editing

Adobe Research introduces Project Music GenAI Control, a groundbreaking tool revolutionizing audio creation and editing. According to a post in blog.adobe.com, this early-stage generative AI music generation and editing tool empowers creators to generate music from text prompts and then provides fine-grained control for precise editing to meet their unique requirements.

Nicholas Bryan, Senior Research Scientist at Adobe Research, describes Project Music GenAI Control as a collaborative tool where generative AI becomes a co-creator, assisting users in crafting music tailored to their projects’ mood, tone, and length. Adobe’s commitment to AI innovation aligns with its ethics principles of accountability, responsibility, and transparency, exemplified by the widespread adoption of Firefly, the leading AI image generation model.

The process begins with a text prompt inputted into a generative AI model, akin to Adobe’s approach with Firefly. Users can input prompts such as “powerful rock,” “happy dance,” or “sad jazz” to generate music, with integrated fine-grained editing capabilities available directly within the workflow. This user-friendly interface allows for transforming generated audio based on a reference melody, adjusting tempo, structure, and patterns, controlling intensity, extending clip length, remixing sections, and generating seamless loops.

Project Music GenAI Control addresses common workflow challenges by providing users with the ability to create custom pieces of audio, eliminating the need for manual cutting and editing of existing music. This level of control, akin to Photoshop’s pixel-level editing for images, empowers creatives to shape, tweak, and edit their audio with precision. Collaboratively developed with researchers from the University of California, San Diego, and Carnegie Mellon University, this innovative tool promises to redefine audio creation and editing paradigms.

read more at blog.adobe.com