Case Study

Leveraging GenAI in Music Creation

UX/UI DesignUser ResearchProduct Design

Year

2022

Project

SoundWave Inc.

Orbit Overture

Problem

Creating music requires several different skills that are hard to develop simultaneously, even if you are a technically great musician you also need the production chops and artistic vision to execute a great idea.

Solution

An AI tool that allows people to express their musical ideas using a building block keyword system. It helps professionals rapidly create drafts and allows for non-production savvy musicians to implement and tinker with their ideas.

Orbit Logo
Orbit Flowchart
Orbit Help

Current Pain Points

Interviews with people lead to discovering core pain points of the music production process. Less experienced interviewees expressed issues with the amount of information they'd need to take in when using professional tools and a lack of assistance. More experienced users who were already familiar with tools mostly talked about the difficulties they felt when coming up with new ideas or the initial stages of a project.

Cognitive Overload

Digital Audio Workstations are too complex and offer too many options to pick from

A Scary Blank Canvas

Coming up and setting up with new projects can be difficult.

Lack of Onboarding

Figuring out where to start is often the hardest part of learning

User Persona

This is Sara, she loves listening to music and was always curious about creating her own songs. Sadly she does not have the time to learn about production and even when she tried to learn all of the information seemed overwhelming.

User Persona

Features

From the interviews it was also possible to identify what the users would like to accomplish with this tool and come up with core features

Create songs: Users want be able to create a song from zero, with no need for musical production knowledge

Explore new ideas: User want to quickly create a draft that can then be exported to edited

Sharing: Users want to be able to share their creations with their friends

Defining the Input

The way non technical people describe and understand music is very different from how musicians or producers do it. Without expert music theory and production knowledge, we are limited to describe music with terms like bright, chill, heavy, etc. Interestingly that is also how musicians often describe the sound they are looking for, using non-technical terms like chunky.



To adapt to this way of describing music, I opted to follow a keyword based approach to starting and editing tracks.

Orbit Blast Example Orbit Indie Example

Early Prototype and Testing

As a way to validate the concept and get some early user feedback a low-mid fidelity prototype was created. For testing users where given the task of creating a simple song and exporting it

Lo-Fi Prototype 1 Lo-Fi Prototype 2 Lo-Fi Prototype 3 Lo-Fi Prototype 4
User Flow

Insights: User testing revealed the need to add signifiers some portions of the app. For instance it is not immediately obvious that it is possible to remove keywords or mute single tracks.

Design System

Color Palette

Color Palette

Typography

Typography

Components

Screens

High Fidelity Screen 1 High Fidelity Screen 2 High Fidelity Screen 3 High Fidelity Screen 4