alt.freeweights.embed / nomic-embed-text-v1-GGUF
From: nomic-ai <huggingface.co/nomic-ai>Newsgroups: alt.freeweights.embedSubject:

nomic-embed-text-v1-GGUF

Date: 2026-11-14Commit: 90c80acSigned: 2DC28CC7B26A283B ✓

Sentence similarity model. Gguf weights, 1.86 GB in all. Published by nomic-ai under Apache-2.0.

embed1.86GBnomic-embed-text-v1-GGUFggufpermissive
FactsParamsnot statedSize1.86 GBFormatsggufTasksentence similarityLicenseApache-2.0From sourcepermissive
$ fw get nomic-ai/nomic-embed-text-v1-GGUF
# manifest sha256 d4aa3c5bc5b9… · 1.86 GB · 16 files
$ fw verify ./nomic-embed-text-v1-GGUF nomic-ai/nomic-embed-text-v1-GGUF
From sourceHosted (signed)nomic-ai/nomic-embed-text-v1-GGUFLast check: 2026-11-14 21:10 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of nomic-embed-text-v1.

Works with

Convert with

Evaluate with

Scan with

Overview

Size
1.86 GB
Weights
49.4 MB (smallest of 14 GGUF variants)
Parameters
not stated
Formats
gguf
Task
sentence similarity
License
Apache-2.0 (permissive)
Files
16, each with a sha256
Publisher
nomic-ai
Added
2026-11-14
Section
alt.freeweights.embed
Lineage

Original release from the publisher.

Base model: nomic-ai/nomic-embed-text-v1

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 21:10 UTCpassed

Model card

From the publisher at commit 90c80ac. Shown as plain text with links; images open at the publisher.

nomic-embed-text-v1 - GGUF#

Original model: nomic-embed-text-v1

Usage#

Embedding text with nomic-embed-text requires task instruction prefixes at the beginning of each string.

For example, the code below shows how to use the search_query prefix to embed user questions, e.g. in a RAG application.

To see the full set of task instructions available & how they are designed to be used, visit the model card for nomic-embed-text-v1.

Description#

This repo contains llama.cpp-compatible files for nomic-embed-text-v1 in GGUF format.

llama.cpp will default to 2048 tokens of context with these files. For the full 8192 token context length, you will have to choose a context extension method. The 🤗 Transformers model uses Dynamic NTK-Aware RoPE scaling, but that is not currently available in llama.cpp.

Example llama.cpp Command#

Compute a single embedding:

./embedding -ngl 99 -m nomic-embed-text-v1.f16.gguf -c 8192 -b 8192 --rope-scaling yarn --rope-freq-scale .75 -p 'search_query: What is TSNE?'

You can also submit a batch of texts to embed, as long as the total number of tokens does not exceed the context length. Only the first three embeddings are shown by the embedding example.

texts.txt:

search_query: What is TSNE?
search_query: Who is Laurens Van der Maaten?

Compute multiple embeddings:

./embedding -ngl 99 -m nomic-embed-text-v1.f16.gguf -c 8192 -b 8192 --rope-scaling yarn --rope-freq-scale .75 -f texts.txt

Compatibility#

These files are compatible with llama.cpp as of commit 4524290e8 from 2/15/2024.

Provided Files#

The below table shows the mean squared error of the embeddings produced by these quantizations of Nomic Embed relative to the Sentence Transformers implementation.

Name | Quant | Size | MSE -----|-------|------|----- nomic-embed-text-v1.Q2\_K.gguf | Q2\_K | 48 MiB | 2.36e-03 nomic-embed-text-v1.Q3\_K\_S.gguf | Q3\_K\_S | 57 MiB | 1.31e-03 nomic-embed-text-v1.Q3\_K\_M.gguf | Q3\_K\_M | 65 MiB | 8.73e-04 nomic-embed-text-v1.Q3\_K\_L.gguf | Q3\_K\_L | 69 MiB | 8.68e-04 nomic-embed-text-v1.Q4\_0.gguf | Q4\_0 | 75 MiB | 6.87e-04 nomic-embed-text-v1.Q4\_K\_S.gguf | Q4\_K\_S | 75 MiB | 6.81e-04 nomic-embed-text-v1.Q4\_K\_M.gguf | Q4\_K\_M | 81 MiB | 3.12e-04 nomic-embed-text-v1.Q5\_0.gguf | Q5\_0 | 91 MiB | 2.79e-04 nomic-embed-text-v1.Q5\_K\_S.gguf | Q5\_K\_S | 91 MiB | 2.61e-04 nomic-embed-text-v1.Q5\_K\_M.gguf | Q5\_K\_M | 95 MiB | 7.34e-05 nomic-embed-text-v1.Q6\_K.gguf | Q6\_K | 108 MiB | 6.29e-05 nomic-embed-text-v1.Q8\_0.gguf | Q8\_0 | 140 MiB | 6.34e-06 nomic-embed-text-v1.f16.gguf | F16 | 262 MiB | 5.62e-10 nomic-embed-text-v1.f32.gguf | F32 | 262 MiB | 9.34e-11

Files

16 files · 1.86 GBWeights 49.4 MB (smallest of 14 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 16 files with their sha256
FileSizesha256
.gitattributes1.56 KBe08cf896faa882fdfbf869edf3ac5e9cfaa850c0ff3b79cf4a29e394bbe2572a
README.md4.69 KB623532fe468a3ef917e728461183f53d8832f02abdeb53d793b0f6a0b35f102b
nomic-embed-text-v1.Q2_K.gguf49.4 MBafb87e81c67d34db721db27f093d1e87e4620001fe11e4566c5ceb88cd0fc667
nomic-embed-text-v1.Q3_K_L.gguf71.6 MBa1974d4dd71b76ae3a44b58c12bd753fd57f08975a81a77960097e285a01eb32
nomic-embed-text-v1.Q3_K_M.gguf67.2 MB6b5811832d7bf8cae9ec2824128e25a7b69bc752a7c993893df7ec80ff506424
nomic-embed-text-v1.Q3_K_S.gguf59.6 MB60c6e5a619c66d210da3058e4a36aeab1c49386fa4836cb165f2e81182875fde
nomic-embed-text-v1.Q4_0.gguf77.8 MBca39592bb0191be78b0fa9263b96792203eaad7bd9de0d53ad7f07c1f7d59dc5
nomic-embed-text-v1.Q4_K_M.gguf84.1 MB7b910918b82f87301b0301134c4a131a15a6123962e8b89a0554ba7357d285fb
nomic-embed-text-v1.Q4_K_S.gguf78.1 MB9b72dd549a1589e4047ed3cd737ba6ae974ae635a0e327f4352c56536573b9d4
nomic-embed-text-v1.Q5_0.gguf94.9 MBc3fac9da3c08434befcd3f4353e68df0f2b61dc200ee7b8a38afccf55e7fb0e7
nomic-embed-text-v1.Q5_K_M.gguf99.6 MB9b27adf775cc6976755da192c1982877c54c2cbbd2f47552b4189d96829657d0
nomic-embed-text-v1.Q5_K_S.gguf94.9 MB6e1590be631a94d824c148b2f1d4297c94edf35f538c17554ccc75ee44c377e5
nomic-embed-text-v1.Q6_K.gguf113 MBc80b0668ea5ce20f55075cd46237944172b93f61907b47fa022fe35eaf05181d
nomic-embed-text-v1.Q8_0.gguf146 MB194206fcf0e77681bd2eaa3517b6fce880e1a3e15ef89935a77a1892574d15f7
nomic-embed-text-v1.f16.gguf274 MBe17ebde8d22d345aead60b0ed10726e8c45a06f4ba9a45223ab594526542e58f
nomic-embed-text-v1.f32.gguf548 MB1798c9e108b1d27fe3501339ac7785ea37f6504ee928ef7802ad881219e4c04c
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
90c80ac5c2 pinned now manifest updated, same commit2026-11-14 21:10 UTC16 files · 1.86 GB
90c80ac5c22026-11-14 21:10 UTC16 files · 1.86 GB

Use it

$ fw get nomic-ai/nomic-embed-text-v1-GGUF
# manifest sha256 d4aa3c5bc5b9… · 1.86 GB · 16 files
$ fw verify ./nomic-embed-text-v1-GGUF nomic-ai/nomic-embed-text-v1-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/nomic-ai/nomic-embed-text-v1-GGUF.json --dir ./nomic-embed-text-v1-GGUF $ python3 fw.py verify ./nomic-embed-text-v1-GGUF ./nomic-ai__nomic-embed-text-v1-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download nomic-ai/nomic-embed-text-v1-GGUF --revision 90c80ac5c2a0d13de9a36cf1dec39f34acee54a8 --local-dir ./nomic-embed-text-v1-GGUF
llama.cppDownload one GGUF variant (nomic-embed-text-v1.Q2_K, 49.4 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download nomic-ai/nomic-embed-text-v1-GGUF --include "nomic-embed-text-v1.Q2_K*" --local-dir ./nomic-embed-text-v1-GGUF $ llama-server -m ./nomic-embed-text-v1-GGUF/nomic-embed-text-v1.Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./nomic-embed-text-v1-GGUF/nomic-embed-text-v1.Q2_K.gguf\n' > Modelfile $ ollama create nomic-embed-text-v1-gguf -f Modelfile

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-14
Text in
README.md
Text sha256
623532fe468a3ef917e728461183f53d8832f02abdeb53d793b0f6a0b35f102b
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: nomic-ai <huggingface.co/nomic-ai>Newsgroups: alt.freeweights.embedSubject: nomic-embed-text-v1-GGUFDate: 2026-11-14Commit: 90c80acSigned: 2DC28CC7B26A283B ✓
Upstream
nomic-ai/nomic-embed-text-v1-GGUF
Pinned commit
90c80ac5c2a0d13de9a36cf1dec39f34acee54a8
Manifest
nomic-embed-text-v1-GGUF.json · .minisig
Manifest sha256
d4aa3c5bc5b988b7ab822bb6a5727d2b6cf5220febbc52169f67bb1bb77ad4e8
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 21:10 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/nomic-ai/nomic-embed-text-v1-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/nomic-ai/nomic-embed-text-v1-GGUF.json.minisig $ minisign -Vm nomic-embed-text-v1-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

nomic-ai/nomic-embed-text-v1 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download nomic-ai/nomic-embed-text-v1-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. nomic-embed-text-v1-GGUF.json. Provenance. Takedown history: none.
From: sentence-transformers <huggingface.co/sentence-transformers>Subject: all-MiniLM-L6-v1
From: unsloth <huggingface.co/unsloth>Subject: all-MiniLM-L6-v2
From: mlx-community <huggingface.co/mlx-community>Subject: all-MiniLM-L6-v2-4bit
From: sentence-transformers <huggingface.co/sentence-transformers>Subject: all-mpnet-base-v1
From: sentence-transformers <huggingface.co/sentence-transformers>Subject: allenai-specter
From: sentence-transformers <huggingface.co/sentence-transformers>Subject: bert-base-nli-max-tokens