From: nomic-ai <huggingface.co/nomic-ai>Newsgroups: alt.freeweights.textSubject:

gpt4all-j

Date: 2026-11-15Commit: 5000fafSigned: 2DC28CC7B26A283B ✓

Text generation model with 6.2B parameters. Safetensors weights, 36.5 GB in all. Published by nomic-ai under Apache-2.0.

6.2B params36.5GBgpt4all-jsafetensorspermissive
FactsParams6.2BSize36.5 GBFormatssafetensorsTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get nomic-ai/gpt4all-j
# manifest sha256 b73d849f9253… · 36.5 GB · 16 files
$ fw verify ./gpt4all-j nomic-ai/gpt4all-j
From sourceHosted (signed)nomic-ai/gpt4all-jLast check: 2026-11-15 03:41 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Runs withAIBrixBentoMLCTranslate2ExLlamaV2ExLlamaV3exofastllmFlashInfergpu-unlockKTransformersLitServeLMCacheLMDeployLocalAImistral.rsMLC LLMMooncakeSGLangText Generation WebUItinygradTransformersTriton Inference ServervLLMXinferenceFine-tune withAccelerateAlignment HandbookAxolotlColossal-AIDeepSpeedEasyR1FlashAttentionH2O LLM StudioJAXKerasLiger KernelLitGPTLLaMA-FactoryMegatron-LMms-swiftnanotronOLMo-coreOpenRLHFOumiPEFTPyTorch Lightningsd-scriptsSimpleTunerTorchTitantorchtuneTransformer EngineTRLUnslothverlConvert withAQLMAutoRoundCore ML ToolsExecuTorchGPTQModelLLM CompressormergekitNeural CompressorOliveONNXOptimum QuantoOptimumsafetensorsTensorRT Model OptimizertorchaoEvaluate withAutoevalsDeepEvalEvaluateHELMLightEvallm-evaluation-harnessOpenCompassOpikRagassimple-evalsSWE-benchTruLensWeaveScan withAgentDojoAI Fairness 360DeepTeamDetoxifyFairlearngarakGiskardGuardrailsMCP ScannerModelScanNeMo GuardrailspicklescanpromptfooWorks withAgent Development KitAG2Google AI Edge GalleryAiderany-llmAnythingLLMBAMLbrowser-useCAMELHugging Face Chat UIChatboxCherry StudioClineCodex CLICogneeCrewAIDeerFlowDSPyEnchantedGemini CLIGitHub MCP ServergooseGPT ResearcherGradioGraphitiGuidanceHollamaInstructorKilo CodeLangflowLangGraphLiteLLMLlamaIndexLLMLocalAGILoLLMs WebUIMCP Python SDKMem0MetaGPTNextChatOllama JavaScriptOllama PythonOpenAI Agents SDKopencodeOpenHandsotermOutlinesPage AssistPlaywright MCPPortkey AI GatewayPrivateGPTQwen CodeRWKV RunnerSemantic KernelsmolagentsStrands AgentsVaneXGrammar

Overview

Size
36.5 GB
Weights
12.2 GB (safetensors)
Parameters
6.2B
Formats
safetensors
Task
text generation
License
Apache-2.0 (permissive)
Files
16, each with a sha256
Publisher
nomic-ai
Added
2026-11-15
Section
alt.freeweights.text
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 03:41 UTCpassed

Model card

From the publisher at commit 5000faf. Shown as plain text with links; images open at the publisher.

Model Card for GPT4All-J#

An Apache-2 licensed chatbot trained over a massive curated corpus of assistant interactions including word problems, multi-turn dialogue, code, poems, songs, and stories.

Model Details#

Model Description#

This model has been finetuned from GPT-J

  • Developed by: Nomic AI
  • Model Type: A finetuned GPT-J model on assistant style interaction data
  • Language(s) (NLP): English
  • License: Apache-2
  • Finetuned from model [optional]: GPT-J

We have released several versions of our finetuned GPT-J model using different dataset versions

  • v1.0: The original model trained on the v1.0 dataset
  • v1.1-breezy: Trained on afiltered dataset where we removed all instances of AI language model
  • v1.2-jazzy: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model
  • v1.3-groovy: We added Dolly and ShareGPT to the v1.2 dataset and removed ~8% of the dataset in v1.2 that contained semantic duplicates using Atlas.

To download a model with a specific revision run

from transformers import AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("nomic-ai/gpt4all-j", revision="v1.2-jazzy")

Downloading without specifying revision defaults to main/v1.0.

Model Sources [optional]#
Training Procedure#

GPT4All is made possible by our compute partner Paperspace.

Trained on a DGX cluster with 8 A100 80GB GPUs for ~12 hours. Using Deepspeed + Accelerate, we use a global batch size of 256 with a learning rate of 2e-5. More information can be found in the repo.

Results#

Results on common sense reasoning benchmarks

| Model                     |  BoolQ   |   PIQA   | HellaSwag | WinoGrande |  ARC-e   |  ARC-c   |   OBQA   |   Avg.   |
|:--------------------------|:--------:|:--------:|:---------:|:----------:|:--------:|:--------:|:--------:|:--------:|
| GPT4All-J 6B v1.0         |   73.4   |   74.8   |   63.4    |    64.7    |   54.9   |   36.0   |   40.2   |   58.2   |
| GPT4All-J v1.1-breezy     |   74.0   |   75.1   |   63.2    |    63.6    |   55.4   |   34.9   |   38.4   |   57.8   |
| GPT4All-J v1.2-jazzy      |   74.8   |   74.9   |   63.6    |    63.8    |   56.6   |   35.3   |   41.0   |   58.6   |
| GPT4All-J v1.3-groovy     |   73.6   |   74.3   |   63.8    |    63.5    |   57.7   |   35.0   |   38.8   |   58.1   |
| GPT4All-J Lora 6B         |   68.6   |   75.8   |   66.2    |    63.5    |   56.4   |   35.7   |   40.2   |   58.1   |
| GPT4All LLaMa Lora 7B     |   73.1   |   77.6   |   72.1    |    67.8    |   51.1   |   40.4   |   40.2   |   60.3   |
| GPT4All 13B snoozy        | **83.3** |   79.2   |   75.0    |  **71.3**  |   60.9   |   44.2   |   43.4   | **65.3** |
| Dolly 6B                  |   68.8   |   77.3   |   67.6    |    63.9    |   62.9   |   38.7   |   41.2   |   60.1   |
| Dolly 12B                 |   56.7   |   75.4   |   71.0    |    62.2    |   64.6   |   38.5   |   40.4   |   58.4   |
| Alpaca 7B                 |   73.9   |   77.2   |   73.9    |    66.1    |   59.8   |   43.3   |   43.4   |   62.4   |
| Alpaca Lora 7B            |   74.3   | **79.3** |   74.0    |    68.8    |   56.6   |   43.9   |   42.6   |   62.8   |
| GPT-J 6.7B                |   65.4   |   76.2   |   66.2    |    64.1    |   62.2   |   36.6   |   38.2   |   58.4   |
| LLama 7B                  |   73.1   |   77.4   |   73.0    |    66.9    |   52.5   |   41.4   |   42.4   |   61.0   |
| LLama 13B                 |   68.5   |   79.1   |   76.2    |    70.1    |   60.0   | **44.6** |   42.2   |   63.0   |
| Pythia 6.7B               |   63.5   |   76.3   |   64.0    |    61.1    |   61.3   |   35.2   |   37.2   |   57.0   |
| Pythia 12B                |   67.7   |   76.6   |   67.3    |    63.8    |   63.9   |   34.8   |    38    |   58.9   |
| Fastchat T5               |   81.5   |   64.6   |   46.3    |    61.8    |   49.3   |   33.3   |   39.4   |   53.7   |
| Fastchat Vicuña 7B        |   76.6   |   77.2   |   70.7    |    67.3    |   53.5   |   41.2   |   40.8   |   61.0   |
| Fastchat Vicuña 13B       |   81.5   |   76.8   |   73.3    |    66.7    |   57.4   |   42.7   |   43.6   |   63.1   |
| StableVicuña RLHF         |   82.3   |   78.6   |   74.1    |    70.9    |   61.0   |   43.5   | **44.4** |   65.0   |
| StableLM Tuned            |   62.5   |   71.2   |   53.6    |    54.8    |   52.4   |   31.1   |   33.4   |   51.3   |
| StableLM Base             |   60.1   |   67.4   |   41.2    |    50.1    |   44.9   |   27.0   |   32.0   |   42.2   |
| Koala 13B                 |   76.5   |   77.9   |   72.6    |    68.8    |   54.3   |   41.0   |   42.8   |   62.0   |
| Open Assistant Pythia 12B |   67.9   |   78.0   |   68.1    |    65.0    |   64.2   |   40.4   |   43.2   |   61.0   |
| Mosaic mpt-7b             |   74.8   | **79.3** | **76.3**  |    68.6    | **70.0** |   42.2   |   42.6   |   64.8   |
| text-davinci-003          |   88.1   |   83.8   |   83.4    |    75.8    |   83.9   |   63.9   |   51.0   |   75.7   |

Files

16 files · 36.5 GBWeights 12.2 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 16 files with their sha256
FileSizesha256
.gitattributes1.48 KBdb7c0371f46f0840b8f25794c1e3321c9b5820a8cb6ba9694a46fc64b8fae5a6
README.md6.02 KBf339c3e4dc2ceff0b25311b2ec3049d66e44f8a83ea499b48633a3ad181e4d37
added_tokens.json4.33 KB6355e9615a4cb67a9a08a6f3c2954f7e85329ed52daa9690c36bc9f726942220
config.json1.00 KB1a7977ca2297f73521b70b2d4ced77aec25b8ab874173dfeffac408518387314
generation_config.json146 B39cae384f4fd51a7858f55dcec6b7909d23edf37d0472bb752dfd065c37a17a9
merges.txt456 KB1ce1664773c50f3e0cc8842619a93edc4624525b728b188a9e0be33b7726adc5
model-00001-of-00002.safetensors10.0 GB2a9bb88c252c6d909e0b26c1342db42d7647f7a94017a4388db78051aba4778d
model-00002-of-00002.safetensors2.17 GBdd5776f8b386604d3845bdc00e247f616b4050f91603fec015bfdca300c13e67
model.safetensors.index.json27.2 KBb8be47982474a853d18ec457085fb4c307a037dac7fc577f974982dcf17b2955
pytorch_model-00001-of-00002.bin12.2 GB0adc26a253924e44fb15faa43c564674291b77140a7fb68fdd4f3a5c9cddd52c
pytorch_model-00002-of-00002.bin12.1 GBb9d47d7f95f3f3c88dc424c409624f94682bfc96fae2e24f2618d3b61fbc929d
pytorch_model.bin.index.json25.8 KB0a765864738dd708a2e889ddb96ef9366d751ad414f681bedfef9255ed59fcd9
special_tokens_map.json438 B98412137ae43c77f8af52eb51b19c3536d3242cb55339167d841005fa94a23b7
tokenizer.json2.14 MB16ebc539316fd3d3731db6cb38d9f65788d043a09ad1daf8b65cf193078aa90a
tokenizer_config.json727 Bfd1d9aed595c7ad9e64cf65c74e94bddc9dc1608e178a4f60380c8373813f30f
vocab.json798 KB3ba3c3109ff33976c4bd966589c11ee14fcaa1f4c9e5e154c2ed7f99d80709e7
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
5000faf803 pinned now2026-11-15 03:41 UTC16 files · 36.5 GB

Use it

$ fw get nomic-ai/gpt4all-j
# manifest sha256 b73d849f9253… · 36.5 GB · 16 files
$ fw verify ./gpt4all-j nomic-ai/gpt4all-j
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/nomic-ai/gpt4all-j.json --dir ./gpt4all-j $ python3 fw.py verify ./gpt4all-j ./nomic-ai__gpt4all-j.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download nomic-ai/gpt4all-j --revision 5000faf803b3edcbeff9bdb6fdbbabd1a42addd0 --local-dir ./gpt4all-j
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("nomic-ai/gpt4all-j", revision="5000faf803b3edcbeff9bdb6fdbbabd1a42addd0") model = AutoModelForCausalLM.from_pretrained("nomic-ai/gpt4all-j", revision="5000faf803b3edcbeff9bdb6fdbbabd1a42addd0", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve nomic-ai/gpt4all-j --revision 5000faf803b3edcbeff9bdb6fdbbabd1a42addd0

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
f339c3e4dc2ceff0b25311b2ec3049d66e44f8a83ea499b48633a3ad181e4d37
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: nomic-ai <huggingface.co/nomic-ai>Newsgroups: alt.freeweights.textSubject: gpt4all-jDate: 2026-11-15Commit: 5000fafSigned: 2DC28CC7B26A283B ✓
Upstream
nomic-ai/gpt4all-j
Pinned commit
5000faf803b3edcbeff9bdb6fdbbabd1a42addd0
Manifest
gpt4all-j.json · .minisig
Manifest sha256
b73d849f9253814e35767084c8042d9498d78c9b553dc62897ce161644aceb7f
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 03:41 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/nomic-ai/gpt4all-j.json $ curl -O https://freeweights.allternit.com/manifests/nomic-ai/gpt4all-j.json.minisig $ minisign -Vm gpt4all-j.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download nomic-ai/gpt4all-j
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. gpt4all-j.json. Provenance. Takedown history: none.
From: laion <huggingface.co/laion>Subject: a2-rl-e2egit_large-50-32B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B