Repository navigation
MVSep Mega 53 Stems model
First version of model with 53 stems. It's based on BS Roformer architecture.
List of stems: ['accordion', 'acoustic-guitar', 'back-vocal', 'banjo', 'bass', 'bassoon', 'bells', 'bowed_strings', 'brass', 'cello', 'clarinet', 'congas', 'digital-piano', 'dobro', 'double-bass', 'drums', 'electric-guitar', 'flute', 'french-horn', 'glockenspiel', 'guitar', 'harmonica', 'harp', 'harpsichord', 'hh', 'keys', 'kick', 'lead-vocal', 'mandolin', 'marimba', 'oboe', 'organ', 'percussion', 'piano', 'saxophone', 'sitar', 'snare', 'strings', 'synth', 'tambourine', 'timpani', 'toms', 'triangle', 'trombone', 'trumpet', 'tuba', 'ukulele', 'viola', 'violin', 'vocal', 'wind', 'wind-chimes', 'woodwind']
There are some model notes:
- We are continuing to refine and improve the model.
- The model is memory-intensive, even with a batch size of 1. I recommend at least 16 GB of VRAM.
- Currently, the model’s performance on individual stems may be lower than the specialized models available on the MVSep site.
- Stems do not sum up to the original mixture, as some may contain overlapping information. For example, the "vocals" stem includes both lead and backing vocals.
- The model returns all stems by default, but filtering out empty stems during post-processing is a logical next step.