alt.freeweights.vision / ViCLIP-L-14-BVD-V-50M-s50M-b32K
From: laion <huggingface.co/laion>Newsgroups: alt.freeweights.visionSubject:

ViCLIP-L-14-BVD-V-50M-s50M-b32K

Date: 2026-11-14Commit: a88d16eSigned: 2DC28CC7B26A283B ✓

Video classification model with 428M parameters. Safetensors weights, 6.85 GB in all. Published by laion under MIT.

428M params6.85GBViCLIP-L-14-BVD-V-50M-s50M-b32Ksafetensorspermissive
FactsParams428MSize6.85 GBFormatssafetensorsTaskvideo classificationLicenseMITFrom sourcepermissive
$ fw get laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K
# manifest sha256 c05cb45b9d43… · 6.85 GB · 21 files
$ fw verify ./ViCLIP-L-14-BVD-V-50M-s50M-b32K laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K
From sourceHosted (signed)laion/ViCLIP-L-14-BVD-V-50M-s50M-b32KLast check: 2026-11-14 21:38 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

Overview

Size
6.85 GB
Weights
1.71 GB (safetensors)
Parameters
428M
Formats
safetensors
Task
video classification
License
MIT (permissive)
Files
21, each with a sha256
Publisher
laion
Added
2026-11-14
Section
alt.freeweights.vision
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 21:38 UTCpassed

Model card

From the publisher at commit a88d16e. Shown as plain text with links; images open at the publisher.

ViCLIP-L-14-BVD-V-50M-s50M-b32K#

Table of Contents#

  1. Model Details
  2. Uses
  3. Training Details
  4. Evaluation
  5. How to Get Started with the Model
  6. Citation

Model Details#

ViCLIP ViT-L/14 trained on the BVD-V-50M dataset with 50M video-text pairs.

Model Architecture: ViCLIP with ViT-L/14 vision tower. The vision and text encoders are both initialized from https://huggingface.co/laion/CLIP-ViT-L-14-DataComp.XL-s13B-b90K.

HF Transformers: The model is directly usable via AutoModel, AutoTokenizer and AutoVideoProcessor from HF Transformers.


Uses#

This model is intended for research purposes. We hope it enables researchers to better understand and explore zero-shot video classification, video-text retrieval, and generalisation capabilities of video-language models.

Direct Use#
  • Zero-shot video classification
  • Video-text retrieval
  • Video representation learning
Downstream Use#
  • Linear probing and full fine-tuning for various video classification tasks
  • Video retrieval systems
  • Component for multimodal models (e.g., VLMs)
Out-of-Scope Use#
  • Surveillance and facial recognition applications
  • Undeployed or unconstrained deployment without thorough in-domain testing
  • Any language other than English

Training Details#

Training Data#

Trained on the BVD-V-50M dataset.

Training Procedure#
  • Model: ViCLIP L/14
  • Frames per video 8
  • Resolution: 224×224
  • Samples: 50M samples seen
  • Optimizer: AdamW (lr=4e-5, betas=[0.9, 0.98], weight_decay=0.2)
  • Global batch size: 32000
  • Warmup: 100 steps
  • Learning Rate Scheduler: Cosine annealing

Evaluation#

Evaluated using the CLIP Benchmark video.

Results#
Kinetics-400 top-1 accuracyUCF-101 top-1 accuracyHMDB51 top-1 accuracyMSR-VTT video/text retrieval recall@1MSVD video/text retrieval recall@1
63.379.761.442.8 / 43.253.7 / 83.9

How to Get Started with the Model#

Quickstart with HF Transformers#
import torch
import torch.nn.functional as F
from transformers import AutoModel, AutoTokenizer, AutoVideoProcessor

model = AutoModel.from_pretrained("laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K", trust_remote_code=True)
video_processor = AutoVideoProcessor.from_pretrained("laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K", trust_remote_code=True)

video = video_processor("path/to/video.mp4")

labels = ["a person playing basketball", "a person swimming", "a person running"]
text_tokens = tokenizer(labels, padding="max_length", truncation=True, max_length=77, return_tensors="pt")

with torch.no_grad():
    v_feat = model.get_video_features(video["pixel_values_videos"])
    t_feat = model.get_text_features(text_tokens["input_ids"])

logits = 100.0 * v_feat @ t_feat.t()
probs = logits.softmax(dim=-1)
print("Label probs:", probs)

Citation#

@misc{laionbvd2026,
      title={LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training}, 
      author={Andreas Hochlehnert and Marianna Nezhurina and Mehdi Cherti and Andrej Radonjic and Thaddäus Wiedemer and Christoph Schuhmann and Romain Beaumont and Wieland Brendel and Bernhard Schölkopf and A. Sophia Koepke and Jenia Jitsev and Matthias Bethge},
      year={2026},
      eprint={2608.24845},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2608.24845}, 
}

Files

21 files · 6.85 GBWeights 1.71 GB (safetensors). Sizes and sha256 from the signed manifest.
Show all 21 files with their sha256
FileSizesha256
.gitattributes1.57 KB72202216d5d2650259b8ef1ba1603b20e6df311cded7d3ec3bf2dfd0b91c9a23
.modeling_viclip.py.swp20.5 KBb12619f0afdee7e381cb0f1fc2ac95e7193e6eaf2a62d5057c26290043610775
README.md3.94 KB7b4304950ed9194a6b1c80f09bdc23489b5498249c73ebef2ddfad1fdff99ed7
__pycache__/configuration_viclip.cpython-312.pyc1.34 KB1d31086c73245d3bbb2e6908dfd93f500e7df3bd67b71422e8ba33591b3966ae
__pycache__/modeling_viclip.cpython-312.pyc5.33 KBe94b679a93e4916337f6b5b51832ec43159dbe904145a42034157977d048ca7b
__pycache__/processor_viclip.cpython-312.pyc12.4 KB8237153117d76bbcb5940fce9805e9dc2528c1c254cb463fffdf129e9f121b63
__pycache__/viclip_impl.cpython-312.pyc35.9 KBa3fdaa98d8fd46e9a83873b82a65b70149871b89b436d41157ecf5e16bde52aa
config.json706 Bf931767be3734768af7f59824ea6c92d1acb40077c9dac151c9f43a4d24f2afb
configuration_viclip.py1.02 KBbb121955beb5c0f06aeb145862d1eb7beacec9d5ac09162c007bcc3e435ec6ac
convert_checkpoint_to_hf.py1.96 KB6d85798bba0c5b99a2cec7e6854d1ea7f2bd2e8a2f60c6f3be8d76db0c9a2261
merges.txt525 KBf526393189112391ce6f9795d4695f704121ce452c3aad1f5335cc41337eba85
model.safetensors1.71 GB9f54c6bba1095a01ee71e3f35971c510c4305adc0613977d312e48d71c44b7e6
modeling_viclip.py3.94 KB5c2ce2e859dc3dc6d600fac44f7687a8c02a1336ad70ad413472ecb17fd8a745
open_clip_checkpoint.pt5.13 GB9addc1f1e9b7b8822fa96fa747aaf925eec46ac59738cb2f576eef20fe971e08
processor_viclip.py9.88 KB9ee6f68e111f6f980f62ce65300eaac529927cbad03a77dea662eb14e3f4d9c9
special_tokens_map.json121 B7c50aa6489aa24ace5fa3ed23a2002b0be2ef52cd8b0e1e3026e3e3479237a07
tokenizer.json2.22 MBd8b124290bc4bcd18cd3f72747f525e2a1d8c266cf3089e52da38ee417564ac5
tokenizer_config.json806 B00439066fcba73de57644cf41e4e3b9f2dbb09d7f3fc2005898ba52399045882
viclip_impl.py24.7 KB49db6db0de4d06a4ca126b72121c6a7caca84bf8257499aea7772fb189df6ff5
video_preprocessor_config.json206 B1c1add805bd04e5729bae3d9a919744d327255dab03957c04d3ce42a093401d9
vocab.json862 KB5047b556ce86ccaf6aa22b3ffccfc52d391ea4accdab9c2f2407da5b742d4363
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
a88d16e04c pinned now manifest updated, same commit2026-11-14 21:38 UTC21 files · 6.85 GB
a88d16e04c2026-11-14 21:38 UTC21 files · 6.85 GB

Use it

$ fw get laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K
# manifest sha256 c05cb45b9d43… · 6.85 GB · 21 files
$ fw verify ./ViCLIP-L-14-BVD-V-50M-s50M-b32K laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K.json --dir ./ViCLIP-L-14-BVD-V-50M-s50M-b32K $ python3 fw.py verify ./ViCLIP-L-14-BVD-V-50M-s50M-b32K ./laion__ViCLIP-L-14-BVD-V-50M-s50M-b32K.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K --revision a88d16e04c1693762abebb2286be40c0ec01bb72 --local-dir ./ViCLIP-L-14-BVD-V-50M-s50M-b32K

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-14
Text in
README.md
Text sha256
7b4304950ed9194a6b1c80f09bdc23489b5498249c73ebef2ddfad1fdff99ed7
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: laion <huggingface.co/laion>Newsgroups: alt.freeweights.visionSubject: ViCLIP-L-14-BVD-V-50M-s50M-b32KDate: 2026-11-14Commit: a88d16eSigned: 2DC28CC7B26A283B ✓
Upstream
laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K
Pinned commit
a88d16e04c1693762abebb2286be40c0ec01bb72
Manifest
ViCLIP-L-14-BVD-V-50M-s50M-b32K.json · .minisig
Manifest sha256
c05cb45b9d43ae7ad4dc81a7de4f95e8e2101e14f1e2b45b014f567eec5407e8
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 21:38 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K.json $ curl -O https://freeweights.allternit.com/manifests/laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K.json.minisig $ minisign -Vm ViCLIP-L-14-BVD-V-50M-s50M-b32K.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download laion/ViCLIP-L-14-BVD-V-50M-s50M-b32K
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. ViCLIP-L-14-BVD-V-50M-s50M-b32K.json. Provenance. Takedown history: none.
From: dima806 <huggingface.co/dima806>Subject: ai_vs_real_image_detection
From: legekka <huggingface.co/legekka>Subject: AI-Anime-Image-Detector-ViT
From: onnx-community <huggingface.co/onnx-community>Subject: AI-Anime-Image-Detector-ViT-ONNX
From: AICodexLab <huggingface.co/AICodexLab>Subject: answerdotai-ModernBERT-base-ai-detector
From: onnx-community <huggingface.co/onnx-community>Subject: answerdotai-ModernBERT-base-ai-detector-ONNX
From: onnx-community <huggingface.co/onnx-community>Subject: bart-large-cnn-ONNX