Audio-reactive AI engine

AMBR

An engine that listens to a track and turns it into moving visuals. The music decides the look, the motion and the timing, so the result is designed rather than random.

Role
Solo: concept, engine, creative direction
Year
2025 – 2026
Status
Working engine; powers Overtone
Runs
One home PC with a 12 GB GPU

The brief

AI video usually looks like random clips laid over a song. I wanted the music to be the director: calm sections that breathe, drops that hit, and loops that repeat exactly on the beat.

What it makes

Concept loops generated from a track's mood and tempo. Each one is a starting point an artist can approve before the final piece is made.

How it works

  1. 1Track
  2. 2Listen: tempo, beats, sections, energy
  3. 3Map each section to a look
  4. 4Generate
  5. 5Lock the motion to the tempo
  6. 6Check, then deliver

Shown at overview level only. The internals stay private.

Decisions and trade-offs

  • Analysis drives the AI, not the other way round: every visual change has a reason at that moment in the song.
  • Runs on a 12 GB consumer GPU instead of rented cloud time, so iteration stays fast and free.
  • Continuity over variety: one coherent piece beats a collection of good shots.
  • The same listening data also drives this site: the sculpture at the top and the Haven's windows move to the music.

From engine to product

Overtone is the first product built on AMBR: canvas loops for independent musicians.

An Overtone loop.
Overtone explainer frame
Overtone's explainer.
Next projectPeeCee CrittersDesktop pet game