All you need to do is upload a song, describe the style or feel you want, and the tool will automatically help you adapt the song into a new style and create a completely new remix.
For example: “I want this song to sound happier” or “Add some rock elements”.
MusicGen Remixer allows you to adjust several parameters to affect the result of your mix, including:
1. Multi-band diffusion: This is a technical option that, if turned on, processes the audio in a special way, potentially making the mix sound richer and more layered.
2. Audio standardization strategy: This option determines how to adjust the loudness of the audio so that it sounds more balanced and does not have parts that are too loud or too quiet.
3. Beat Synchronization Threshold: This parameter helps ensure that the rhythm in the mix aligns with the rhythm of the original track. If the rhythm deviation is too large, it will try to correct it.
4. Chroma factor: This affects the color of the chord and can make the chord sound brighter or darker.
5. top_k and top_p Sampling: These parameters control the variety and creativity of the mix, much like adjusting seasonings in a recipe, allowing for more varied or conservative results.
6. Temperature: This parameter controls the overall level of creativity, and the higher the temperature, the more random and diverse the music generated.
7. Classifier-free guidance: This option can enhance or reduce the impact of input on output, allowing the mix to follow the original track more closely or play more freely.
8. Output format: You can choose the file format of the final mix, such as WAV or MP3.
By adjusting these parameters, you can have fine-grained control over the style and quality of your mix, creating music that matches your imagination.
Related Tools and References:
🎼 Chord Identification: Use Jonggwon Park’s BTC model to identify and analyze chord structures in music.
🎙️ Vocal Noise Reduction: Employs Meta’s Demucs implementation to reduce noise in audio tracks, resulting in clearer vocals.
🥁 Beat Tracking and BPM Retrieval: Use Taejun Kim’s All-In-One Music Structure Analyzer to identify the beat and tempo (BPM) of your music.
⏱️ Beat Synchronization: Utilize KAIST MAC Labs’ PyTSMod technology to ensure that the mix stays in sync with the beat of the original track.
GitHub：https://github.com/sakemin/cog-musicgen-remixer
Online experience: https://replicate.com/sakemin/musicgen-remixer
Original video: https://twitter.com/i/status/1720421140416614607