Instructions to use Comfy-Org/SeedVR2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusion Single File
How to use Comfy-Org/SeedVR2 with Diffusion Single File:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
workflow
#2
by makisekurisu-jp - opened
@Kijai The submitted changes have been merged into the main branch, but the nodes used in the workflow are not available in ComfyUI.
https://github.com/user-attachments/files/28671124/seedvr2_image.json
https://gist.github.com/pollockjj/8d40c875e9eacb9b560709faef4ea31f#file-seedvr2_simple_image-json
Those workflows all have missing nodes. We need them resurrected asap. I have converted SeedVR2 to INT8 convrot. Let's go!
https://github.com/Comfy-Org/ComfyUI/pull/14110#top
[INFO] got prompt
[INFO] Model storage policy: fast_disk=False paths=['/home/ubuntu/NVME_DATA/COMFYUI_MODEL/models/vae/SEEDVR2/seedvr2_ema_vae_fp16.safetensors']
[INFO] Using xformers attention in VAE
[INFO] Using xformers attention in VAE
[INFO] VAE load device: cuda:0, offload device: cpu, dtype: torch.float16
[INFO] Requested to load VideoAutoencoderKLWrapper
[INFO] loaded completely; 478.07 MB loaded, full load: True
[INFO] SeedVR2TemporalChunk auto: free=14.69GiB, 0.52Mpx -> frames_per_chunk=49 (t_pixel=161).
[INFO] Found quantization metadata version 1
[INFO] Detected mixed precision quantization
[INFO] Using mixed precision operations
[INFO] Native ops: float8_e5m2, nvfp4, asym_w4a8_int8, convrot_w4a4, mxfp8, float8_e4m3fn, int8_tensorwise
[INFO] model weight dtype torch.bfloat16, manual cast: torch.bfloat16
[INFO] model_type FLOW
[INFO] Model storage policy: fast_disk=False paths=['/home/ubuntu/NVME_DATA/COMFYUI_MODEL/models/diffusion_models/SEEDVR2/seedvr2_3b_nvfp4.safetensors']
[INFO] Creating deepclone of SeedVR2 for cuda:1.
[INFO] Found quantization metadata version 1
[INFO] Detected mixed precision quantization
[INFO] Using mixed precision operations
[INFO] Native ops: float8_e5m2, nvfp4, asym_w4a8_int8, convrot_w4a4, mxfp8, float8_e4m3fn, int8_tensorwise
[INFO] model weight dtype torch.bfloat16, manual cast: torch.bfloat16
[INFO] model_type FLOW
[INFO] Model storage policy: fast_disk=False paths=['/home/ubuntu/NVME_DATA/COMFYUI_MODEL/models/diffusion_models/SEEDVR2/seedvr2_3b_nvfp4.safetensors']
[INFO] Using sage attention mode: auto
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
[INFO] Requested to load SeedVR2
[INFO] loaded completely; 11017.45 MB usable, 1902.87 MB loaded, full load: True
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:04<00:00, 4.32s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.87s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.90s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.87s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.87s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.87s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.88s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.89s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.86s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.87s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.86s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.85s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.81s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.82s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.83s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.82s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[MultiGPU Runtime] Using runtime device cuda:1 (comfy.sample.sample:ModelPatcher)
[MultiGPU CUDA Guard] Switching CUDA current device 0 -> 1 (comfy.sample.sample:ModelPatcher)
100%|ββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:03<00:00, 3.85s/it]
[MultiGPU CUDA Guard] Restored CUDA current device 1 -> 0 (comfy.sample.sample:ModelPatcher)
[ERROR] !!! Exception during processing !!! SeedVR2TemporalMerge.execute() got an unexpected keyword argument 'latent_chunks'
[ERROR] Traceback (most recent call last):
File "/home/ubuntu/NVME_DATA/COMFYUI_CP312_TR213_CU130_RL_CF0374/execution.py", line 547, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/NVME_DATA/COMFYUI_CP312_TR213_CU130_RL_CF0374/execution.py", line 352, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/NVME_DATA/COMFYUI_CP312_TR213_CU130_RL_CF0374/execution.py", line 320, in _async_map_node_over_list
await process_inputs(input_data_all, 0, input_is_list=input_is_list)
File "/home/ubuntu/NVME_DATA/COMFYUI_CP312_TR213_CU130_RL_CF0374/execution.py", line 314, in process_inputs
result = f(**inputs)
^^^^^^^^^^^
File "/home/ubuntu/NVME_DATA/COMFYUI_CP312_TR213_CU130_RL_CF0374/comfy_api/internal/__init__.py", line 149, in wrapped_func
return method(locked_class, **inputs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/NVME_DATA/COMFYUI_CP312_TR213_CU130_RL_CF0374/comfy_api/latest/_io.py", line 2053, in EXECUTE_NORMALIZED
to_return = cls.execute(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: SeedVR2TemporalMerge.execute() got an unexpected keyword argument 'latent_chunks'
[INFO] Prompt executed in 162.20 seconds
will be try https://gist.github.com/pollockjj/81a4aa04689f3259832b71d9834e7329
