What Is Jazz Improvisation?

Most musicians would probably say they know what improvisation is. After all, they've heard thousands of improvised solos, practiced scales over chord changes, and spent hours learning the language of jazz. Yet if you ask them to define improvisation, the answers often focus on the mechanics of playing rather than the act of creating music.

Some describe it as choosing the right notes over the harmony. Others think of it as making up melodies on the spot. Still others see it as applying scales, patterns, or vocabulary they've worked hard to learn. Each explanation contains some truth, but none quite captures what makes improvisation unique.

The distinction matters because the way you define improvisation determines the way you practice it. If you believe improvisation is primarily about selecting the correct notes, you'll naturally spend most of your time accumulating more scales, more patterns, and more theoretical knowledge.

Your definition of improvisation determines your direction. Without that clarity, it's easy to confuse motion with progress—working hard without knowing whether your efforts are leading you toward becoming the musician you want to become.

Before discussing how to become a better improviser, it's worth asking a simpler question.

What are you actually doing when you improvise?

More Than Playing Without a Script

Improvisation is often described as "making music up as you go." While that's true in the broadest sense, the phrase leaves an important impression that isn't quite accurate. It suggests that improvisation is spontaneous invention from nothing, as though every note appears without preparation or influence.

That isn't how experienced improvisers think.

Every musician brings years of listening, practicing, performing, and absorbing musical language to the moment of improvisation. Those experiences shape every phrase they play. An improvised solo isn't created in isolation. It's built from everything the musician has heard, understood, and lived over time.

The remarkable part is not that the music comes from nowhere. It's that those experiences are transformed into a musical expression in real time.

Improvisation Begins Before the First Note

When you listen to a great solo, you're not simply hearing someone navigate chord changes accurately. You're listening to someone think musically.

A phrase suggests another phrase. A rhythmic idea is repeated, then varied. A simple melody develops over several measures before giving way to something entirely different. The solo unfolds much the way a conversation unfolds, with each idea growing naturally from what came before it.

The notes are important, but they are not the point. They are the physical expression of something happening first in the musician's mind.

This is why two musicians can play over exactly the same tune, using much of the same harmonic vocabulary, yet produce solos that sound completely different. Their fingers may have similar technical abilities, but their musical thinking is unique.

Improvisation is not the act of finding notes.
It is the act of developing musical ideas as the music unfolds.

Music Exists Before It Reaches the Instrument

Imagine asking someone to read a paragraph aloud. The words don't come into existence as they leave the speaker's mouth. They already exist as thoughts waiting to be expressed. Speaking is simply the process of giving those thoughts a voice.

Music works in much the same way.

Before a note is played, something gives rise to it. It may be a melody you imagine, a rhythmic idea you hear internally, or simply a musical impulse that has not yet taken complete shape. Whatever form it takes, the note is not the beginning of the creative process. It is the visible, or rather audible, result of it.

This distinction is easy to overlook because the process happens so quickly. An experienced improviser doesn't stop to think before every note. The music unfolds almost as quickly as thought itself. Yet that speed shouldn't fool us into believing the fingers are leading the way. They are responding to an idea that already exists, even if only for a fraction of a second.

That is why improvisation is better understood as a continuous process of musical thinking than as a series of individual note choices. Each phrase influences the next. A rhythmic idea invites development. A melodic fragment suggests a continuation. Rather than asking, "What note comes next?" the improviser is unconsciously exploring a more musical question: "Where does this idea want to go?"

The difference may seem subtle, but it changes everything. If you think of improvisation as choosing notes, you'll spend your practice searching for better note choices through scales, memorized patterns, transcriptions of other's solos, and rehearsed licks.

Every act of expression is guided by something that comes before it. In conversation, our words are guided by our thoughts. In writing, sentences are guided by the ideas we want to communicate. In improvisation, the notes we play are guided by the musical story taking shape within us.

This is why great improvisation isn't simply a matter of knowing more. It begins with having something to express. Technique, theory, vocabulary, and experience all help bring that expression to life, but they cannot replace it. Without an underlying musical direction, they become isolated skills rather than parts of a coherent whole.

Improvisation doesn't begin with the next note. It begins with the next idea.

Why So Many Musicians Struggle to Improvise

Most people begin learning jazz with good intentions. They practice scales, arpeggios, chord voicings, patterns, and transcriptions because those are the things they can see, measure, and improve. That's also the way many players were taught. There is nothing wrong with that. In fact, these are essential parts of becoming a capable musician.

The problem arises when those activities become the destination rather than the preparation.

Imagine giving a novelist a larger vocabulary and a better understanding of grammar. Those skills would help them write with greater technical precision, but they would not produce a compelling story. The story comes first. Language gives it form.

The same is true of improvisation. Technical skills provide the means to express an idea, but they cannot create the idea itself. A musician may know every mode, every altered scale, and every chord substitution, yet still struggle to create a solo that feels purposeful. Another musician with far less theoretical knowledge may captivate an audience because every phrase grows naturally from a clear musical intention.

This is why two players with similar technical abilities can sound so different. One is occupied with finding notes that fit the harmony. The other is allowing the harmony to support a musical thought that is already unfolding. From the listener's perspective, the difference is unmistakable. One solo sounds assembled. The other sounds alive.

Perhaps this explains why so many musicians feel frustrated after years of diligent practice. They have become increasingly skilled at manipulating the language of music without ever being shown that the ultimate goal is not fluency alone, but expression. They've gotten better at using the tools, but they're still thinking primarily about the tools instead of the music they're trying to create.

The irony is that the more attention we devote to the mechanics of improvisation, the easier it is to lose sight of its purpose. We become so concerned with how to play that we stop asking what we are trying to communicate.

Great improvisers certainly possess remarkable technique. They understand harmony, rhythm, and musical vocabulary at a very high level. But those abilities serve a larger purpose. They make it possible for the music taking shape in the mind to emerge with clarity and confidence.

Technique is indispensable.
It simply isn't where improvisation begins.

What Richie Beirach Learned from Stan Getz and Chet Baker

One of the themes of this article is that great improvisation begins with musical thought, not with theoretical knowledge. That doesn't mean theory has no value. It means theory is not the source of musical expression.

Pianist Richie Beirach often spoke to me about two of his greatest mentors, Stan Getz and Chet Baker. Both became legendary improvisers, yet neither approached music through an extensive knowledge of jazz theory. What they possessed was something even more fundamental: an extraordinary ear, a deeply developed musical imagination, and the ability to express what they heard.

In the following video, Richie reflects on what he learned from these remarkable musicians. As you watch, notice how little the discussion centers on theory and how much it centers on hearing, feeling, and expressing music.

Every Great Solo Begins with an Idea

If improvisation is the process of developing musical ideas in real time, the next question is obvious.

What is a musical idea?

Is it a melody? A rhythm? A motif? A feeling? Can an idea be as small as two notes, or must it be a complete phrase? More importantly, how does a simple idea grow into a solo that feels coherent from beginning to end?

These are not academic questions. They lie at the heart of every memorable improvisation. Listen to the musicians whose solos stay with you long after the performance has ended, and you'll rarely find a collection of unrelated phrases. You'll hear ideas introduced, developed, varied, and brought to a satisfying conclusion.

Learning to recognize and develop those ideas is one of the most important skills an improviser can acquire. It is also one of the least discussed. Many musicians spend years learning what notes they can play without ever learning how musical ideas grow.

The next step in becoming an improviser isn't learning another scale. It's learning to recognize, develop, and trust a musical idea. That's where we'll go next.