• Music
  • Blog
  • Games
  • Contact

Audio Reaction Spectrum

Conceptual discussion. Many approximations herein.
 
Basic idea: sound effects and music both react to the game. Typically sound effects react immediately and music reacts a bit slower. Also, sound effects tend to be in the world and music tends to be in the players head. Tendencies only.
 
Let’s extrapolate. Assume at any given moment there are four independent simultaneous layers. A quadrant:
 
 
Fast reacting / In the world.
Fast reacting / In the players head.
Slow reacting / In the world.
Slow reacting / In the players head.
 
Speed of reaction is on a spectrum. (Immediate, fast, medium, slow, nearly constant.) Diagenics is either / or. (Either tied to a game world object or constant position relative to player.)
 
Some emotional reactions are delayed. There’s the immediate reaction, which is slightly after the stimulus. And there’s your reflections on that feeling. And there’s your sense of what’s coming next. There’s a sense that you may be hopeful or weary of the future. There’s such a thing as how long you feel a certain way before the feeling subsides a bit. Or maybe the music is tied to the present moment.
 
Assuming the player wishes to continue playing we can anticipate what he is thinking and his feelings on it. Another way to say it, the mechanics of a game direct the player towards certain thought patterns, and success / failure (deferred success) helps us anticipates his feelings.
 
How do mechanics effects thoughts? Hypothesis: challenge level. When the challenge level is high enough to demand full attention, focus is towards the present moment. When the challenge level eases off, thoughts go towards reflection (how did I do? How can I do this better?) If the challenge level starts to increase again, the player becomes more future oriented (what can I expect now?) These thoughts are what you use to anticipate a player’s feelings. You can employ strategic ambiguity when you can’t be sure how a player will feel. Challenge level increasing but not yet requiring full attention: an anticipatory moment, future oriented. Maybe player is optimistic, maybe pessimistic. So write in both. What matters is future orientation of music, so nothing is totally certain. Chaotic. Conflicting feelings.
 
Having an idea of what the player is likely to think / feel helps us with pacing. Need to match and reflect player’s state to gain trust.
 
Trying to move beyond emotional intensity curves here. A good first step but not always appropriate to the action of a game.
 
How to represent different time orientations?
 
Present: minimal variation. Static state. Directly representative of in-game mechanics / state. No reflection, meaning no variation of material once stated.
 
Reflective: no new material, but endless variations on old material. Slower pace of information. Sense of examining the same thing under many different guises / from different points of view.
 
Future Oriented: New material. Chaotic, meaning information rate is not fixed, but generally faster. Also, musical grammar never completes. No full sentences. Ideas interrupt each other constantly. (Like a classical development section, but cinematic action fits the bill too.)
 
This suggests ways for music to flow. FMOD implementation ideas: future orientation leading to a present state… perhaps the future orientation is cycling through many ideas over loop. (Perhaps the length of the loop, meaning the number of ideas in it, increases as the high score increases). Eventually you reach the point where your full attention is required. We could say this is when you reach the current high score (of the session.) Each moment of the future loop is ready to become a present state. New material suddenly stops being introduced and is repeated with minimal variation tied directly to the game state / mechanics. (Which means its complexity increases directly with the game.)
 
So, a future loop could have sections a, b, c, d, e. And there would be equal number of present-oriented deep examinations of each: A’, B’, C’, etc, ready to transition at the drop of a hat. (I think going to a reflective area is a little easier because the use of space of sound design aided transitions helps a lot.)
 
Extrapolating, where you are in one loop determines where you start in the next. This allows on-a-dime transitions with minimal (still plenty) transition material.
 
So far this has been about short and long time reactions. The short reactions happen the most during present, steady state music. The longer reactions determine which time orientation you are in and are connected to challenge level and high score.
 
Left out of discussion: long scale in-world sounds. (ambiance.) This suggests that changes in challenge level might correspond with a change in level / visual information, to justify a change in ambiance. Otherwise, ambient intensity could be a slow moving thing.

Dynamic Audio Concepts

The music is the soundtrack to the player interacting with the system. (Not always, but this is my personal favorite starting point.)
 
Imagine watching the player playing the game. You are composing the soundtrack to that.
 
Length of a session. Story of a session. Session to session. Story of that.
 
The simple fact of playing a game over a period of time and interacting with it is something the music needs to reflect.
 
Gameplay footage. Now imagine footage of a player interacting with the game to produce that gameplay. What can you expect the player to think and feel?
 
Persuasion technique: pacing and leading. Watch skilled rhetoricians in action. First describe the current situation. Reflect people’s own thoughts and experiences back to them. Nothing more. Gain trust. Show that your mind is like their mind. Then make predictions about what they will be feeling and thinking. Vague if necessary, like astrology. Always a way it can come true. When your predictions come true the crowd trusts you more and more. You go from reflecting to something more. Be patient with this. Eventually you break the barrier between their mind and you mind. They are in your reality now. They expect anything you say to be true now and will perceive reality differently to make your words true. You can persuade anyone of anything with enough time. You must believe this.
 
Now with game music. Imagine footage of a player interacting with the system. At first, reflect what they see back to them with music and sound effects. Reward and encouragements. Establish comfort. Tropes, genre expectations, cliches. Establish trust.
 
Now the music does something which is weird and doesn’t reflect the game. Huh, what’s that? Then the game moves into the next part. It’s a perfect fit! Wow, the music predicted that. Repeat. Sharper contrasts between music and gameplay. More time between prediction and fulfillment. Trust, trust, trust. Break down the barriers between minds.
 
Learn, from deep experience, intuition, testing, where this breakdown occurs.
 
Make sure, along the way, that the music, in addition to matching the game, also follows it’s own internal logic, whatever that may be. Rhythm, theme, harmony, color, etc.
 
Now follow the music to its own place. The player is ready. Barrier between minds dissolved. Go further and further. Make the player invest in your frame. The player will see in the gameplay and the visuals whatever it is the music is suggesting. You have transformed the game with your music.
 
This of course is the ideal. May only ever be partially realized. No formula, only heuristic. Art, not science.
 
Remember, tell the story of of an individual session and also the story that happens from session to session. The game knows when you’re playing a lot. The game knows when you’ve taken a break. Learn, through heuristic, when to shift down from dissolution to prediction or reflection. Remember, heuristic, heuristic, heuristic.

Moving Forward

It’s not how hard it is to get there,
But how you’ll feel when you arrive.
It’s not how many steps you have to take,
But how small each single step can be.
 
It’s not to choose the perfect path,
But to learn from your mistakes.
It’s not to hope there won’t be walls,
But not to block your path by adding more.

« Previous 1 2 3 4 5 6 Next »
Recent blog posts

Composing by Parameter

The Real Story of Mario

Matching the Screen

Symmetry in Deal Making

Composing a System

Latest tweets @jfburrellmusic
Tweets by @jfburrellmusic
Connect with me
Credits

©2025 All music exhibited in this website: Jared Burrell

Web design: Pisto Casero