alt.freeweights.tools / StreamingDataset

From: mosaicml <github.com/mosaicml>Newsgroups: alt.freeweights.toolsSubject:

StreamingDataset

Release: v0.13.0 (2025-07-15)Commit: adeeeebLicense: Apache-2.0

Streams training data from cloud storage with fast resume and shuffling.

data and documentsv0.13.0releaseStreamingDatasetPythonApache-2.0

FactsLicenseApache-2.0LanguagePythonKinddata and documentsRelease2025-07-15PlatformsLinux, macOS, WindowsLinks to the projectpermissive

$ pip install mosaicml-streaming

Overview Install Use with Freeweights License Provenance

Overview

Streams training data from cloud storage with fast resume and shuffling.

Kind: data and documents
License: Apache-2.0
Language: Python
Platforms: Linux, macOS, Windows
Latest release: v0.13.0 (2025-07-15)
Repository: mosaicml/streaming

Topicsdatasetdeep-learningmachine-learningneural-networkpytorchstreaming

Freeweights links to the project and does not host tool binaries.

Install

$ pip install mosaicml-streaming

$ pip install mosaicml-streaming

Checked against the project's README on 2026-11-15. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Use a catalog model

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (10)

code_generation_lite tulu-3-sft-mixture fineweb-edu gsm8k hh-rlhf MMLU-Pro oasst2 openai_humaneval ultrafeedback_binarized WildChat-4.8M

License

License: Apache-2.0
Class: Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: mosaicml <github.com/mosaicml>Newsgroups: alt.freeweights.toolsSubject: StreamingDatasetRelease: v0.13.0 (2025-07-15)Commit: adeeeebLicense: Apache-2.0

Repository: mosaicml/streaming
Pinned release: v0.13.0, 2025-07-15
Release commit: adeeeebe8f5d42cb429c05bd4e62df2176ef20ab
Default branch: main 1381ca1213fc95b6573efb44e5ec9f85c765ce1c
Fetched: 2026-11-15
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

10 catalog models. See the list