CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.text / Inkling-Small-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.textSubject:

Inkling-Small-GGUF

Date: 2026-11-15Commit: 1a19ef8Signed: 2DC28CC7B26A283B ✓

Image text to text model. Gguf weights, 3.88 TB in all. Published by unsloth under Apache-2.0.

text3.88TBInkling-Small-GGUFggufpermissive
FactsParamsnot statedSize3.88 TBFormatsggufTaskimage text to textLicenseApache-2.0From sourcepermissive
$ fw get unsloth/Inkling-Small-GGUF
# manifest sha256 5a179cb27e3a… · 3.88 TB · 115 files
$ fw verify ./Inkling-Small-GGUF unsloth/Inkling-Small-GGUF
From sourceHosted (signed)unsloth/Inkling-Small-GGUFLast check: 2026-11-15 04:35 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Inkling-Small.

Works with

Run13Convert1Evaluate13Scan12Apps62

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
3.88 TB
Weights
74.8 GB (smallest of 23 GGUF variants)
Parameters
not stated
Formats
gguf
Task
image text to text
License
Apache-2.0 (permissive)
Files
115, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.text
Lineage

Original release from the publisher.

Base model: thinkingmachines/Inkling-Small

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:35 UTCpassed

Model card

No model card stored here.No README was stored for this model. Read the publisher's page: https://huggingface.co/unsloth/Inkling-Small-GGUF

Files

115 files · 3.88 TBWeights 74.8 GB (smallest of 23 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 115 files with their sha256
FileSizesha256
.gitattributes11.1 KB758fd69661c58df542ed23013cb5047bfff8f2fa739cd86569e2ba7b7f7f28d5
BF16/Inkling-Small-BF16-00001-of-00011.gguf47.7 GB7bee32f8d3e214d148dafe4f1f47ead4096842fa20ec113d8463c085db114d9e
BF16/Inkling-Small-BF16-00002-of-00011.gguf48.0 GB80bc8cb776e1eaa6e71ef8a5d9cd5a4bad6b13c0a4cc7ea16cbe8eea46ca48c4
BF16/Inkling-Small-BF16-00003-of-00011.gguf48.4 GB6f0625c4f5c99754d6b4d5fcf2430d35d62fa0d00e9a69e0c8b18ebd7c442455
BF16/Inkling-Small-BF16-00004-of-00011.gguf48.4 GB4d0fc21bd6b76a3972866b67451a5000ef728423845917d92c4431a67b2a3773
BF16/Inkling-Small-BF16-00005-of-00011.gguf48.1 GB5adb6a141436747c210623406576e69dc0b2bb5eb49e42dc439619ebe56c919d
BF16/Inkling-Small-BF16-00006-of-00011.gguf48.0 GBbe5a0bfd45d826beb5519e44c69451120a9477a93e180606b8206599ad2ac992
BF16/Inkling-Small-BF16-00007-of-00011.gguf50.0 GB20e6c54468deb24f7f8e9d5556b4559bff9ed4b2ec7533c26d6e362d2aea16b0
BF16/Inkling-Small-BF16-00008-of-00011.gguf48.0 GBd465bdac920bb559f4ae7d6e4ef1d517a32fd30946d051c8fe3d72fdcad62abd
BF16/Inkling-Small-BF16-00009-of-00011.gguf48.0 GB9017265e0adb8fb767a6bfbc095f1094e2184e897b5a84e9022a2591a9a4da32
BF16/Inkling-Small-BF16-00010-of-00011.gguf49.6 GBdf2cabc35811db5f1be29067c8d26550f3e62925a6f3bada7c331b031e8be484
BF16/Inkling-Small-BF16-00011-of-00011.gguf43.2 GB66f4362bdcfa3603c3faa6af6ab04d39acba0b4306ec73ff4a3b17d8d5bda422
MXFP4_MOE/Inkling-Small-MXFP4_MOE-00001-of-00005.gguf13.0 MB97104a29e2f71a13d53ff18e59dc153ef288ccf1c1d27a38ee34f8db5557074e
MXFP4_MOE/Inkling-Small-MXFP4_MOE-00002-of-00005.gguf48.7 GB915c15d838d2661ddb842e9f18ef25fa7f20a42adf4cb9fa0002185b9471bdb3
MXFP4_MOE/Inkling-Small-MXFP4_MOE-00003-of-00005.gguf49.0 GB6e02549ff099204cffa756529f8be4da80f1a8fd51cfadaaaa0f1d8c74bf467e
MXFP4_MOE/Inkling-Small-MXFP4_MOE-00004-of-00005.gguf49.1 GB27bf702c94bcffeebc93c2638c7d1e5d21340b15267cb1ff815084f731a3f048
MXFP4_MOE/Inkling-Small-MXFP4_MOE-00005-of-00005.gguf11.3 GB02bcee98e39d61e94eb7a58c3751e20f90ccf60825d5a6c1fa3bd011d9f995bb
Q8_0/Inkling-Small-Q8_0-00001-of-00007.gguf13.0 MB47f4a350d4b75f463cc62296971a6d89ec1b85d60f675d18b417cd964701ea32
Q8_0/Inkling-Small-Q8_0-00002-of-00007.gguf48.6 GB32d0e95bad33b7c3f6f458a6789df90b837d0b66363846c9817005e6d7ce1dbe
Q8_0/Inkling-Small-Q8_0-00003-of-00007.gguf48.6 GB0c6bd2673f9bdc26e46da742b7805bb3c2c2b269568bc8d24e40ca78e9a07557
Q8_0/Inkling-Small-Q8_0-00004-of-00007.gguf48.6 GBbee129a79169086d84a55e88b46c983a6527bbbdb117c49ad307e6d23fc6357a
Q8_0/Inkling-Small-Q8_0-00005-of-00007.gguf48.6 GBef87f19076b82da106a94919a928b4aa53ba182e464b6a44aac6ca4cb11d683a
Q8_0/Inkling-Small-Q8_0-00006-of-00007.gguf48.6 GBada319ac798c986af97039eae3ce76c397292c1a7d7c9f07c3bcb1c50d2c3fb4
Q8_0/Inkling-Small-Q8_0-00007-of-00007.gguf37.0 GBdb56fa33296a1a8e87bcc9de66026aac786269d6c07d164555f8c905dc0677be
README.md123 KB03771fd6d1534cf5ac89def088eb6bfeda9539a810448fac843800cf75fc2366
UD-IQ1_M/Inkling-Small-UD-IQ1_M-00001-of-00003.gguf13.0 MB483a5b50a0d2a2899746f62dbbb2909e3d9784c1d93f61c3049b185a699a70f8
UD-IQ1_M/Inkling-Small-UD-IQ1_M-00002-of-00003.gguf49.7 GB9db7ff4376a2d7dda01098cc04ec4e50ce220262b7d1fc70ac456bd6caeaa4dd
UD-IQ1_M/Inkling-Small-UD-IQ1_M-00003-of-00003.gguf29.1 GB48e7f9531a5ac2bad9207a0c3e4c4d2ba99c14465c48f7bd1c3a74124a85e0de
UD-IQ1_S/Inkling-Small-UD-IQ1_S-00001-of-00003.gguf13.0 MBeb600cf15a361c70fcb31adc14b4bb5d8ebe3056acff252f1aa210e49fe8ad98
UD-IQ1_S/Inkling-Small-UD-IQ1_S-00002-of-00003.gguf49.7 GB3577440036e65e2209f735cf50d5bcfbb872365ae15f3b86139c296f0a6c42f3
UD-IQ1_S/Inkling-Small-UD-IQ1_S-00003-of-00003.gguf25.1 GBda1f2395aea71a475623231d42801f3d997d1186e9c728c73ec307ae283d4d6b
UD-IQ2_M/Inkling-Small-UD-IQ2_M-00001-of-00003.gguf13.0 MB3b6ace30e488ad26e816cdba4e42714f40110a3142a210bd5c2e48f69e27cb31
UD-IQ2_M/Inkling-Small-UD-IQ2_M-00002-of-00003.gguf49.5 GB5ca94e858ae116eb513a2af1facd35844d42ef4a209e1d85cc4ecc73cd21b894
UD-IQ2_M/Inkling-Small-UD-IQ2_M-00003-of-00003.gguf32.9 GB8a84e00d4625d52491969f88f24f0999bc77527b7fa1d15cbe44ef88235bb377
UD-IQ2_XXS/Inkling-Small-UD-IQ2_XXS-00001-of-00003.gguf13.0 MB278e5cd62c7aee8db8812122fef22f7e59a5fc08fbed9147e48b1633ec982b7b
UD-IQ2_XXS/Inkling-Small-UD-IQ2_XXS-00002-of-00003.gguf49.4 GB121f0f2a6352df735bc5656e6e2b24820dbd45c3d5b7977371c0ed7a8d4a26c0
UD-IQ2_XXS/Inkling-Small-UD-IQ2_XXS-00003-of-00003.gguf32.9 GB606d2b799aff009269fcf58e87b4a4521b1f2c2b86a2f9ccc1140f5e8c16b0b2
UD-IQ3_S/Inkling-Small-UD-IQ3_S-00001-of-00004.gguf13.0 MBac70a378da7159284c63205be2c9e0673ec65c42a6819ba2d95221b4916ce514
UD-IQ3_S/Inkling-Small-UD-IQ3_S-00002-of-00004.gguf49.7 GB40816b1d6bb7dc1351ff31dc2fede9a91e883f413437cd43038ce8cd85b88849
UD-IQ3_S/Inkling-Small-UD-IQ3_S-00003-of-00004.gguf49.4 GB62c14f1b4dbd2c3acf52776a9488fc43abad003773a7751668f76394ce9c871c
UD-IQ3_S/Inkling-Small-UD-IQ3_S-00004-of-00004.gguf8.34 GB509c1470c98c45103c446c565f46390688e933437e75a7d3d4211f4cabb9da60
UD-IQ3_XXS/Inkling-Small-UD-IQ3_XXS-00001-of-00003.gguf13.0 MB6d0408e50ab6b8f7c9a67e957fbb97ba345bc13105e2c06019f8c51f394dc182
UD-IQ3_XXS/Inkling-Small-UD-IQ3_XXS-00002-of-00003.gguf49.4 GB3715be57b491c9877fdba8e07ce6df8065abd3d6463e3f7320a00567a17aa9de
UD-IQ3_XXS/Inkling-Small-UD-IQ3_XXS-00003-of-00003.gguf48.5 GBa5f3df9d7a817940dd29e0c522556455d438a232fb91770570a1a367dedf658c
UD-IQ4_NL/Inkling-Small-UD-IQ4_NL-00001-of-00004.gguf13.0 MB30a0b8102b4ed332180d7bbd71987d216b1d7d325fde95e0399c6efffdd7c352
UD-IQ4_NL/Inkling-Small-UD-IQ4_NL-00002-of-00004.gguf49.5 GB72494eeb21173d0066c606480e2cbb1f8e3a644fe416f87e318c78fc1c22e1e3
UD-IQ4_NL/Inkling-Small-UD-IQ4_NL-00003-of-00004.gguf49.5 GB79045f1e5e3867e6e090c9cba7912ac58906426f2c6c6b82bcb93aae2926312d
UD-IQ4_NL/Inkling-Small-UD-IQ4_NL-00004-of-00004.gguf31.0 GBb219ad900b3f73638fd5c3ae0843aad718cfb4d8fa4ae57fd6b03d61adad57c5
UD-IQ4_XS/Inkling-Small-UD-IQ4_XS-00001-of-00004.gguf13.0 MB26d391826cb34b51df397278f4fd9cefdcbc70779c743aacedaceb3bd7b7eddb
UD-IQ4_XS/Inkling-Small-UD-IQ4_XS-00002-of-00004.gguf49.6 GB6cb93f2d458265b3c1dae643172f9613e240bd910c0a4895040da6a772ff7f7d
UD-IQ4_XS/Inkling-Small-UD-IQ4_XS-00003-of-00004.gguf49.5 GBc0a8ca61c279361a0b4fb711eaeca48ec3172097715946e89fecf4717260c1e9
UD-IQ4_XS/Inkling-Small-UD-IQ4_XS-00004-of-00004.gguf28.3 GB09d2c406e18028d3333438401ba844ad5feed7a45e6aaf4404a95d812a705440
UD-Q2_K_XL/Inkling-Small-UD-Q2_K_XL-00001-of-00003.gguf13.0 MB66bfa27a88b457cebff967b449599fc412f094dc84d682fb90a5d6586d2897ff
UD-Q2_K_XL/Inkling-Small-UD-Q2_K_XL-00002-of-00003.gguf49.9 GB6a81a926cb7383e3dd2ca4d83ff90228403425875137ac2264df8cfab9bd8b8a
UD-Q2_K_XL/Inkling-Small-UD-Q2_K_XL-00003-of-00003.gguf38.0 GB5692c6150bd58d2c05ab49cd7e975edbb026866045cb912788110135469f4c12
UD-Q3_K_M/Inkling-Small-UD-Q3_K_M-00001-of-00004.gguf13.0 MB110190a3c20fbc6d9783125184e470ab7479a79bee7bdf4b5ceda2a6a736f496
UD-Q3_K_M/Inkling-Small-UD-Q3_K_M-00002-of-00004.gguf49.3 GB41cfa15bf7ca7c55227a5dbce9a4804cbbee2f90af62be7d39ac0043cdd319a6
UD-Q3_K_M/Inkling-Small-UD-Q3_K_M-00003-of-00004.gguf50.0 GB6078bcbe08ad005feb3cfd87dd2a21258101197bcefee9d7d6c65eb94317f4bb
UD-Q3_K_M/Inkling-Small-UD-Q3_K_M-00004-of-00004.gguf20.1 GBdd0f2e32d7ca2fabb7b1c40e8bcbc1f951e8271c42b31f8c318c002b7cdc4209
UD-Q3_K_XL/Inkling-Small-UD-Q3_K_XL-00001-of-00004.gguf13.0 MB110190a3c20fbc6d9783125184e470ab7479a79bee7bdf4b5ceda2a6a736f496
UD-Q3_K_XL/Inkling-Small-UD-Q3_K_XL-00002-of-00004.gguf49.5 GB8df5f2d79e206f7edfc811303c352734c95dc05a2e6c7bc0192c967fdd783d7f
UD-Q3_K_XL/Inkling-Small-UD-Q3_K_XL-00003-of-00004.gguf50.0 GB6078bcbe08ad005feb3cfd87dd2a21258101197bcefee9d7d6c65eb94317f4bb
UD-Q3_K_XL/Inkling-Small-UD-Q3_K_XL-00004-of-00004.gguf20.1 GBdd0f2e32d7ca2fabb7b1c40e8bcbc1f951e8271c42b31f8c318c002b7cdc4209
UD-Q4_K_M/Inkling-Small-UD-Q4_K_M-00001-of-00005.gguf13.0 MBa51ac3f439198f2817219edd582be4b600c273be24e78cbd58ebff982d9f007e
UD-Q4_K_M/Inkling-Small-UD-Q4_K_M-00002-of-00005.gguf48.8 GB3dccdd473cc3a191e6028f6105b01831ed3a8dc30ec4e02679f9e0c2ccb59671
UD-Q4_K_M/Inkling-Small-UD-Q4_K_M-00003-of-00005.gguf49.2 GB1a7edf29bda1d278b4668e1a082d7db634b845a53ea58c918a8cea1f9006c21c
UD-Q4_K_M/Inkling-Small-UD-Q4_K_M-00004-of-00005.gguf49.5 GB376f67568438da96b10566730e8a9e17e3f665ab1b9d82eba48ec33708b172f7
UD-Q4_K_M/Inkling-Small-UD-Q4_K_M-00005-of-00005.gguf15.0 GBe34364af0d04d2d295bc374f1a4fa80002e4277db1bcf4b56240dbd443ac21d3
UD-Q4_K_S/Inkling-Small-UD-Q4_K_S-00001-of-00005.gguf13.0 MB880ee43515d1de1aaa56ec0f99b93783e458d41743b6f49822e5ac8614b2d0dd
UD-Q4_K_S/Inkling-Small-UD-Q4_K_S-00002-of-00005.gguf49.3 GBfc231f77c1aacf5acac9a3aaf86c0ce96e3503eda1caf6d803c550ff90b767f4
UD-Q4_K_S/Inkling-Small-UD-Q4_K_S-00003-of-00005.gguf49.7 GBf178f248c43671543208685b9622851713afee1b73adc62a50d01c1bf418840c
UD-Q4_K_S/Inkling-Small-UD-Q4_K_S-00004-of-00005.gguf49.0 GBc6cf8af4d11e071b4866c0310b25dee595b5ad72edfe6bdd55ca3361221054a3
UD-Q4_K_S/Inkling-Small-UD-Q4_K_S-00005-of-00005.gguf4.24 GB588dbdf6fc48acf6fb0a4740d3b44e3a22ec742d881d81f69f2ff24d61db1d86
UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00001-of-00005.gguf13.0 MBa51ac3f439198f2817219edd582be4b600c273be24e78cbd58ebff982d9f007e
UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00002-of-00005.gguf49.0 GBce586d0d77c0f31d4a137ae3682f1b2748149dbe15344db7a72328ef758835cc
UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00003-of-00005.gguf49.2 GB1a7edf29bda1d278b4668e1a082d7db634b845a53ea58c918a8cea1f9006c21c
UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00004-of-00005.gguf49.5 GB376f67568438da96b10566730e8a9e17e3f665ab1b9d82eba48ec33708b172f7
UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00005-of-00005.gguf15.6 GB71fff4727f0fbecba426cd75e62b4194779cf1488666b5d4bc040ca4227b4b04
UD-Q5_K_M/Inkling-Small-UD-Q5_K_M-00001-of-00005.gguf13.0 MB93c73936fa030b05f304d9d91773c227e4cbb81c5d0fedfe2278862e29dd8f7d
UD-Q5_K_M/Inkling-Small-UD-Q5_K_M-00002-of-00005.gguf49.0 GB278cfdd47d4bdd2ef5c9e2ef5b5ca963ab48a380ecfdf7e15f294af9ddac0fc7
UD-Q5_K_M/Inkling-Small-UD-Q5_K_M-00003-of-00005.gguf49.7 GB7f737ac1245d8ff9d0cec4212fb982991162ebab589106981c4640172aeb95a5
UD-Q5_K_M/Inkling-Small-UD-Q5_K_M-00004-of-00005.gguf50.0 GBf863f54184c6757b720c39d007197e7dc0fbdf864c77dec2b35c88d317afce23
UD-Q5_K_M/Inkling-Small-UD-Q5_K_M-00005-of-00005.gguf47.4 GBf73d2e191bc305332f4b6dd0e41523924b086daff2195079537afed7a8f43c2a
UD-Q5_K_S/Inkling-Small-UD-Q5_K_S-00001-of-00005.gguf13.0 MB39660d28127cf283fe765dab39d856cd081327637ec4633da6a512a6e43a7272
UD-Q5_K_S/Inkling-Small-UD-Q5_K_S-00002-of-00005.gguf49.2 GB569a904bd3e0a1a77881c0aef6f835ec07b3039727f504200ce2133f0158a618
UD-Q5_K_S/Inkling-Small-UD-Q5_K_S-00003-of-00005.gguf49.9 GBdacc17f03b8f67714e08259b4de398e564502625d18488dc82f8c71685edd0ca
UD-Q5_K_S/Inkling-Small-UD-Q5_K_S-00004-of-00005.gguf49.9 GB1cbb76ffa597f9d1acf59bf3cf039568c973bb756b2adf0d88572698399fd56f
UD-Q5_K_S/Inkling-Small-UD-Q5_K_S-00005-of-00005.gguf35.3 GB7ee6674a36f895ca9e60e7d1b40cf58394649e01bb236654f664efbe275e9339
UD-Q5_K_XL/Inkling-Small-UD-Q5_K_XL-00001-of-00005.gguf13.0 MB93c73936fa030b05f304d9d91773c227e4cbb81c5d0fedfe2278862e29dd8f7d
UD-Q5_K_XL/Inkling-Small-UD-Q5_K_XL-00002-of-00005.gguf49.0 GB278cfdd47d4bdd2ef5c9e2ef5b5ca963ab48a380ecfdf7e15f294af9ddac0fc7
UD-Q5_K_XL/Inkling-Small-UD-Q5_K_XL-00003-of-00005.gguf49.7 GB7f737ac1245d8ff9d0cec4212fb982991162ebab589106981c4640172aeb95a5
UD-Q5_K_XL/Inkling-Small-UD-Q5_K_XL-00004-of-00005.gguf50.0 GBf863f54184c6757b720c39d007197e7dc0fbdf864c77dec2b35c88d317afce23
UD-Q5_K_XL/Inkling-Small-UD-Q5_K_XL-00005-of-00005.gguf48.0 GB33bb84e6a4ea2c9465ead1bb7da516e287a63238becf6433410753f8b3c2385b
UD-Q6_K/Inkling-Small-UD-Q6_K-00001-of-00006.gguf13.0 MB2e84a785350ab9c9ffe2d73ca0a9a52c82edecafe02045ce788c16101e8b5c8c
UD-Q6_K/Inkling-Small-UD-Q6_K-00002-of-00006.gguf49.0 GB30b555e721289add4e196ea8303a0dbbabf09bd28d7f27e846d766645c8a5339
UD-Q6_K/Inkling-Small-UD-Q6_K-00003-of-00006.gguf48.5 GB7742842a2fc0e5c268964c563da6210f2ea2a38bbbadd17a1837d3ad8728ebc0
UD-Q6_K/Inkling-Small-UD-Q6_K-00004-of-00006.gguf48.5 GBf4b053480042758e8dc987f81a5395750a973abc3983de93400b3679c3e72649
UD-Q6_K/Inkling-Small-UD-Q6_K-00005-of-00006.gguf48.5 GB10e38a0f67c107565d2ae061621820a35954cc2b879e1eb16a6b7b4b648768df
UD-Q6_K/Inkling-Small-UD-Q6_K-00006-of-00006.gguf24.4 GBe46edd8b563aaa13980df07e04262f5a2b932bd54c9fe3fccae77ba5482c2366
UD-Q6_K_XL/Inkling-Small-UD-Q6_K_XL-00001-of-00006.gguf13.0 MB2e84a785350ab9c9ffe2d73ca0a9a52c82edecafe02045ce788c16101e8b5c8c
UD-Q6_K_XL/Inkling-Small-UD-Q6_K_XL-00002-of-00006.gguf49.6 GBeae3b0df54f4b6d22fab18b3c14da10fce940233907b6a519d6203bec47918ca
UD-Q6_K_XL/Inkling-Small-UD-Q6_K_XL-00003-of-00006.gguf49.6 GB06b5a9830b30b080cf1163b415b29e4ff090b58b46294b6eb8dc4e54ee1f221d
UD-Q6_K_XL/Inkling-Small-UD-Q6_K_XL-00004-of-00006.gguf49.1 GB5bda73702703c45c16cb9b7f0f59a07c80dda8991aa59a7dd66e7ae0cdbc8ba4
UD-Q6_K_XL/Inkling-Small-UD-Q6_K_XL-00005-of-00006.gguf49.1 GB87337995089f9c4d7edc26c01d11b587278cd50f5b3292e9240f49e3707c7ccf
UD-Q6_K_XL/Inkling-Small-UD-Q6_K_XL-00006-of-00006.gguf42.4 GB5e13dda99bf3c51c8ee0e3c47cad692b4b700bccd13e3d115af5111b4b5fd65e
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00001-of-00007.gguf13.0 MB47f4a350d4b75f463cc62296971a6d89ec1b85d60f675d18b417cd964701ea32
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00002-of-00007.gguf48.6 GB32d0e95bad33b7c3f6f458a6789df90b837d0b66363846c9817005e6d7ce1dbe
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00003-of-00007.gguf48.6 GB0c6bd2673f9bdc26e46da742b7805bb3c2c2b269568bc8d24e40ca78e9a07557
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00004-of-00007.gguf48.6 GBbee129a79169086d84a55e88b46c983a6527bbbdb117c49ad307e6d23fc6357a
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00005-of-00007.gguf48.6 GBef87f19076b82da106a94919a928b4aa53ba182e464b6a44aac6ca4cb11d683a
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00006-of-00007.gguf48.6 GBada319ac798c986af97039eae3ce76c397292c1a7d7c9f07c3bcb1c50d2c3fb4
UD-Q8_K_XL/Inkling-Small-UD-Q8_K_XL-00007-of-00007.gguf45.2 GBb864411060844b24296f509c482f202d6bef80195d7508f5091f756452d0fde2
mmproj-BF16.gguf139 MB05d4475a956030be87b099865d6552a541a476db8cc3e266fcfa7c5a24846248
mmproj-F16.gguf139 MBbf1e6afc9889151b3fee61119d3ee2cd224b59a1d881cdf87e33962f64aecc7e
mmproj-F32.gguf277 MB653c88aab6699d65ecd45d82303a74a467309dcb8e837e0c9e18f394f4ee3def
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
1a19ef8288 pinned now2026-11-15 04:35 UTC115 files · 3.88 TB

Use it

$ fw get unsloth/Inkling-Small-GGUF
# manifest sha256 5a179cb27e3a… · 3.88 TB · 115 files
$ fw verify ./Inkling-Small-GGUF unsloth/Inkling-Small-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/Inkling-Small-GGUF.json --dir ./Inkling-Small-GGUF $ python3 fw.py verify ./Inkling-Small-GGUF ./unsloth__Inkling-Small-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Inkling-Small-GGUF --revision 1a19ef82883cb7b9c581b93c30ea252dabbf658d --local-dir ./Inkling-Small-GGUF
llama.cppDownload one GGUF variant (UD-IQ1_S, 74.8 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Inkling-Small-GGUF --include "UD-IQ1_S/*" --local-dir ./Inkling-Small-GGUF $ llama-server -m ./Inkling-Small-GGUF/UD-IQ1_S/Inkling-Small-UD-IQ1_S-00001-of-00003.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Inkling-Small-GGUF/UD-IQ1_S/Inkling-Small-UD-IQ1_S-00001-of-00003.gguf\n' > Modelfile $ ollama create inkling-small-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
03771fd6d1534cf5ac89def088eb6bfeda9539a810448fac843800cf75fc2366
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.textSubject: Inkling-Small-GGUFDate: 2026-11-15Commit: 1a19ef8Signed: 2DC28CC7B26A283B ✓
Upstream
unsloth/Inkling-Small-GGUF
Pinned commit
1a19ef82883cb7b9c581b93c30ea252dabbf658d
Manifest
Inkling-Small-GGUF.json · .minisig
Manifest sha256
5a179cb27e3a4264ebb0ef2c94eee43d4439a4a0f0164a298af2e6c37769d3de
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:35 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/Inkling-Small-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/Inkling-Small-GGUF.json.minisig $ minisign -Vm Inkling-Small-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

thinkingmachines/Inkling-Small · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Inkling-Small-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Inkling-Small-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/unsloth/Inkling-Small-GGUF

Related models

All of alt.freeweights.text →
From: laion <huggingface.co/laion>Subject: a2-rl-e2egit_large-50-32B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B