From: bytedance-research <huggingface.co/bytedance-research>Newsgroups: alt.freeweights.videoSubject:

HuMo

Date: 2026-11-15Commit: 3a4a161Signed: 2DC28CC7B26A283B ✓

Image to video model. Onnx and safetensors weights, 75.4 GB in all. Published by bytedance-research under Apache-2.0.

video75.4GBHuMoonnx safetensorspermissive
FactsParamsnot statedSize75.4 GBFormatsonnx, safetensorsTaskimage to videoLicenseApache-2.0From sourcepermissive
$ fw get bytedance-research/HuMo
# manifest sha256 20ed7403160a… · 75.4 GB · 20 files
$ fw verify ./HuMo bytedance-research/HuMo
From sourceHosted (signed)bytedance-research/HuMoLast check: 2026-11-15 04:15 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Overview

Size
75.4 GB
Weights
68.2 GB (safetensors)
Parameters
not stated
Formats
onnx, safetensors
Task
image to video
License
Apache-2.0 (permissive)
Files
20, each with a sha256
Publisher
bytedance-research
Added
2026-11-15
Section
alt.freeweights.video
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:15 UTCpassed

Model card

From the publisher at commit 3a4a161. Shown as plain text with links; images open at the publisher.

HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioning#

arXiv&nbsp; project page&nbsp; https://huggingface.co/bytedance-research/HuMo

HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioning

Liyang Chen * , Tianxiang Ma * , Jiawei Liu, Bingchuan Li&dagger;, Zhuowei Chen, Lijie Liu, Xu He, Gen Li, Qian He, Zhiyong Wu §

  • Equal contribution, &dagger; Project lead, § Corresponding author

Tsinghua University | Intelligent Creation Team, ByteDance

Image: image

🔥 Latest News#

  • A Best-Practice Guide for HuMo will be released soon. Stay tuned.
  • Sep 16, 2025: 🔥🔥 We release the 1.7B weights, which generate a 480P video in 8 minutes on a 32G GPU. The visual quality is lower than that of the 17B model, but the audio-visual sync remains nearly unaffected.
  • Sep 13, 2025: 🔥🔥 The 17B model is merged into ComfyUI-Wan. Thank kijai for the update!
  • Sep 10, 2025: 🔥🔥 We release the 17B weights and inference codes.
  • Sep 9, 2025: We release the project page and Technique-Report of HuMo

✨ Key Features#

HuMo is a unified, human-centric video generation framework designed to produce high-quality, fine-grained, and controllable human videos from multimodal inputs—including text, images, and audio. It supports strong text prompt following, consistent subject preservation, synchronized audio-driven motion.

  • ​​VideoGen from Text-Image​​ - Customize character appearance, clothing, makeup, props, and scenes using text prompts combined with reference images.
  • ​​VideoGen from Text-Audio​​ - Generate audio-synchronized videos solely from text and audio inputs, removing the need for image references and enabling greater creative freedom.
  • ​​VideoGen from Text-Image-Audio​​ - Achieve the higher level of customization and control by combining text, image, and audio guidance.

📑 Todo List#

  • [x] Release Paper
  • [x] Checkpoint of HuMo-17B
  • [x] Checkpoint of HuMo-1.7B
  • [x] Inference Codes
    • [ ] Text-Image Input
    • [x] Text-Audio Input
    • [x] Text-Image-Audio Input
  • [x] Multi-GPU Inference
  • [ ] Best-Practice Guide for HuMo
  • [ ] Prompts to Generate Demo of Faceless Thrones
  • [ ] Training Data

⚡️ Quickstart#

Installation#
conda create -n humo python=3.11
conda activate humo
pip install torch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 --index-url https://download.pytorch.org/whl/cu124
pip install flash_attn==2.6.3
pip install -r requirements.txt
conda install -c conda-forge ffmpeg
Model Preparation#
ModelsDownload LinkNotes
HuMo-17B🤗 HuggingfaceSupports 480P & 720P
HuMo-1.7B🤗 HuggingfaceLightweight on 32G GPU
Wan-2.1🤗 HuggingfaceVAE & Text encoder
Whisper-large-v3🤗 HuggingfaceAudio encoder
Audio separator🤗 HuggingfaceRemove background noise (optional)

Download models using huggingface-cli:

huggingface-cli download Wan-AI/Wan2.1-T2V-1.3B --local-dir ./weights/Wan2.1-T2V-1.3B
huggingface-cli download bytedance-research/HuMo --local-dir ./weights/HuMo
huggingface-cli download openai/whisper-large-v3 --local-dir ./weights/whisper-large-v3
huggingface-cli download huangjackson/Kim_Vocal_2 --local-dir ./weights/audio_separator
Run Multimodal-Condition-to-Video Generation#

Our model is compatible with both 480P and 720P resolutions. 720P inference will achieve much better quality.

Some tips

  • Please prepare your text, reference images and audio as described in test_case.json.
  • We support Multi-GPU inference using FSDP + Sequence Parallel.
  • ​The model is trained on 97-frame videos at 25 FPS. Generating video longer than 97 frames may degrade the performance. We will provide a new checkpoint for longer generation.
Configure HuMo#

HuMo’s behavior and output can be customized by modifying generate.yaml configuration file. The following parameters control generation length, video resolution, and how text, image, and audio inputs are balanced:

generation:
  frames: <int>                 # Number of frames for the generated video.
  scale_a: <float>              # Strength of audio guidance. Higher = better audio-motion sync.
  scale_t: <float>              # Strength of text guidance. Higher = better adherence to text prompts.
  mode: "TA"                    # Input mode: "TA" for text+audio; "TIA" for text+image+audio.
  height: 720                   # Video height (e.g., 720 or 480).
  width: 1280                   # Video width (e.g., 1280 or 832).

dit:
  sp_size: <int>                # Sequence parallelism size. Set this equal to the number of used GPUs.

diffusion:
  timesteps:
    sampling:
      steps: 50                 # Number of denoising steps. Lower (30–40) = faster generation.
1. Text-Audio Input#
bash scripts/infer_ta.sh  # infer with 17B model
bash scripts/infer_ta_1_7B.sh  # infer with 1.7B model
2. Text-Image-Audio Input#
bash scripts/infer_tia.sh  # infer with 17B model
bash scripts/infer_tia_1_7B.sh  # infer with 1.7B model

Acknowledgements#

Our work builds upon and is greatly inspired by several outstanding open-source projects, including Phantom, SeedVR, MEMO, Hallo3, OpenHumanVid, OpenS2V-Nexus, ConsisID and Whisper. We sincerely thank the authors and contributors of these projects for generously sharing their excellent codes and ideas.

⭐ Citation#

If HuMo is helpful, please help to ⭐ the repo.

If you find this project useful for your research, please consider citing our paper.

BibTeX#
@misc{chen2025humo,
      title={HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioning}, 
      author={Liyang Chen and Tianxiang Ma and Jiawei Liu and Bingchuan Li and Zhuowei Chen and Lijie Liu and Xu He and Gen Li and Qian He and Zhiyong Wu},
      year={2025},
      eprint={2509.08519},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2509.08519}, 
}

📧 Contact#

If you have any comments or questions regarding this open-source project, please open a new issue or contact Liyang Chen and Tianxiang Ma.

Files

20 files · 75.4 GBWeights 68.2 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 20 files with their sha256
FileSizesha256
.gitattributes1.67 KB76d1e4d88f18752f5f9f8fbf460cea4b85bf212ef143f8faa715aec9c2691c25
HuMo-1.7B/ema.pth7.04 GB04126194caa9820c7294c95e321739575491693f2e97f2f1205cd469cd321332
HuMo-17B/README_safetensors_shards.txt303 B0df43b4f67769b87c2625272ea7faffabb83732d5743a1b1207f103c256839c2
HuMo-17B/humo-00001-of-00007.safetensors10.7 GB1ae1ceddb3b5b2afea77520b364f61add2a617989dd7f3dcc18ca5472cc802be
HuMo-17B/humo-00002-of-00007.safetensors10.6 GB909f22ee9d94fc3d15c141ecea35725b73ffdee4588a06f6a6f3151134013343
HuMo-17B/humo-00003-of-00007.safetensors10.7 GB49a52da3effb64e37ee20166b92788850a47781b644e4318b47affe33c5b67e7
HuMo-17B/humo-00004-of-00007.safetensors10.7 GB24ad294f87c4df1bbf921b482b2d340d7863a50807b10ce2732339a34c32eb12
HuMo-17B/humo-00005-of-00007.safetensors10.6 GB802efac3f14b447c05cff8357393cbdcf25e9514c042d017e6b0e9c301ebc107
HuMo-17B/humo-00006-of-00007.safetensors10.7 GB415081cd5030115ab07397ea2dac0a94a2291505fd1141ac2b1f5295cf258434
HuMo-17B/humo-00007-of-00007.safetensors4.39 GBc38fdd072b4ccd2559cdc820a3fba2e862be5a74001b037de2060d14e90f285d
HuMo-17B/humo.safetensors.index.json125 KB97577f81b0a482fc6e7b65728145fb43198a870de0284afe5dc4b9ed7337ba40
LICENSE11.3 KB5967a0c153e731109b76c5d83b5e0fae2382b6aaf7b898d08ff03702eea59430
README.md8.93 KB0bffca1d6c24001f3188c58526aff6ea3e070328a3871ed6d97c628ed0893137
assets/teaser.png5.83 MB722d29d27fb89a6e1ebebef233492f0c06c25b09a0bdb8e723ef567e778bcf34
audio_separator/Kim_Vocal_2.onnx66.8 MBce74ef3b6a6024ce44211a07be9cf8bc6d87728cc852a68ab34eb8e58cde9c8b
audio_separator/README.md185 B47602a3c7888bded22c400bd5ba1e909d95ab33e81b87b2c05791a5196227214
config.json66 B5684d60681723e1dd6ae0f00f6e25cf886ff8dc1891af71906c32d0039d6bc82
requirements.txt270 Bd3cdf561074b6b0f973f08b038130801d770f19cdd2317c7bfa583983920a886
zero_vae_129frame.pt13.2 MBc458d9ea111ea1107a576183cc291daa78fffacbe280967c0a0807fed9200830
zero_vae_720p_161frame.pt37.8 MB1a6b411a72faf6a1e91cd6e390596e844581c0faceeb3abc5232c2a7a1532a88
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
3a4a1610d3 pinned now2026-11-15 04:15 UTC20 files · 75.4 GB

Use it

$ fw get bytedance-research/HuMo
# manifest sha256 20ed7403160a… · 75.4 GB · 20 files
$ fw verify ./HuMo bytedance-research/HuMo
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/bytedance-research/HuMo.json --dir ./HuMo $ python3 fw.py verify ./HuMo ./bytedance-research__HuMo.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bytedance-research/HuMo --revision 3a4a1610d399a5cbb932d54dc229944029803ff7 --local-dir ./HuMo
Packaged for ComfyUI. Most image, video and music models run in ComfyUI . Check the publisher's page for the workflow. Freeweights does not host it.

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
LICENSE
Text sha256
5967a0c153e731109b76c5d83b5e0fae2382b6aaf7b898d08ff03702eea59430
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: bytedance-research <huggingface.co/bytedance-research>Newsgroups: alt.freeweights.videoSubject: HuMoDate: 2026-11-15Commit: 3a4a161Signed: 2DC28CC7B26A283B ✓
Upstream
bytedance-research/HuMo
Pinned commit
3a4a1610d399a5cbb932d54dc229944029803ff7
Manifest
HuMo.json · .minisig
Manifest sha256
20ed7403160a508582116384217d4a2f4c5c295cb05d43a86d21bf67b64876b9
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:15 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/bytedance-research/HuMo.json $ curl -O https://freeweights.allternit.com/manifests/bytedance-research/HuMo.json.minisig $ minisign -Vm HuMo.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

1 model in the catalog name this one as their parent.

Fine-tunes
1
Fine-tunes 1
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bytedance-research/HuMo
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. HuMo.json. Provenance. Takedown history: none.
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: Bernini-R
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: Causal-Forcing-Framewise
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: HuMo
From: genmo <huggingface.co/genmo>Subject: mochi-1-preview
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: Mochi-Preview
From: BAAI <huggingface.co/BAAI>Subject: MTVCraft