ElevenLabs adds Instant Soundtracks for video music and effects

ElevenLabs has introduced Instant Soundtracks, a feature that analyzes an uploaded video's content and mood and generates original music and sound effects automatically, according to datanet.co.kr. The company said the feature combines background music creation and sound effect placement into a single generation process.

Instant Soundtracks detects scenes in a video and places sound effects at the matching timestamps. Music timing is tuned for the fast pacing and editing tempo of short-form content, and the style can shift with a scene's mood, such as EDM or R&B for fast scenes and acoustic guitar-led music for calm passages.

When a video already contains audio, the feature can reference that audio's genre, BPM and instrumentation to generate suitable new music. Generated tracks and effects can then be edited in ElevenCreative's Music Video Editor, where sound effects sit on a separate layer for independent adjustment, addition and retiming.

Developers get the same capability through the ElevenCreative Studio API. New parameters add_sfx, separate_tracks and use_audio_as_reference were added to the Video to Music function; setting separate_tracks=true returns the music and sound effects as separate files in a ZIP for later mixing in external editing tools. The API can process up to 10 videos per request.

The feature has been offered through ElevenCreative, ElevenMusic and the API since the 15th. It is separate from Creative Engine, the ElevenCreative feature for adding music and sound effects to advertising content.