The ultimate AI workflow for syncing sound and video perfectly. Watch the magic unfold!
Workflow: https://sneakyrobot.org/workflow/mmaudio-video-to-sound-audio-visual-workflow/
Buy me a coffee? https://buymeacoffee.com/sneakyrobot
Comfyui: https://github.com/comfyanonymous/ComfyUI
MMAudio GitHub:
https://github.com/kijai/ComfyUI-MMAudio
Models:
Kijai Huggingface MMAudio Models:
https://huggingface.co/Kijai/MMAudio_safetensors/tree/main
Apple Clip:
https://huggingface.co/apple/DFN5B-CLIP-ViT-H-14-378/tree/main
Bigvgan:
https://huggingface.co/nvidia/bigvgan_v2_44khz_128band_512x/tree/main
Torch Wheels:
https://download.pytorch.org/whl/torch
CMD command's:
installing node: git clone https://github.com/kijai/ComfyUI-MMAudio.git
Installing requirements: python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-MMAudio\requirements.txt
Folder paths:
MMAudio models:
mmaudio_large_44k_v2_fp16.safetensors , mmaudio_synchformer_fp16.safetensors and mmaudio_vae_44k_fp16.safetensors goes into =
models\mmaudio
clip goes into:
models\mmaudio\apple\DFN5B-CLIP-ViT-H-14-384
Bigvgan goes into:
models\mmaudio\nvidia\bigvgan_v2_44khz_128band_512x
0:00 intro
0:50 Create Videos With Sound
9:37 Install MMAudio
#comfyui #aivideo #aiaudio #cinematicmusic