Based on LFM2-1.2B, LFM2-1.2B-RAG is specialized in answering questions based on provided contextual documents, for use in RAG (Retrieval-Augmented Generation) systems.
Use cases:
Chatbot to ask questions about the documentation of a particular product.
Custom support with an internal knowledge base to provide grounded answers.
Academic research assistant with multi-turn conversations about research papers and course materials.
You can find more information about other task-specific models in this blog post.
Generation parameters: We recommend using greedy decoding with a temperature=0.
System prompt: The system prompt is optional. You can force the output's language, for example, using "Always respond in English, regardless of the user's input language." By default, the output's language follows the user prompt's language.
Training approach: We fine-tuned the LFM2-1.2B-RAG model on a dataset that includes 1M+ samples of multi-turn interactions and multi-document samples consisting of a mix of curated open source documents as well as generated synthetic ones.
Chat template: LFM2 uses a ChatML-like chat template as follows:
<|startoftext|><|im_start|>user
Use the following context to answer questions:
Beach soccer differs significantly from its grass-rooted counterpart. [...]<|im_end|>
<|im_start|>assistant
Each team in a beach soccer match consists of five players, including a goalkeeper.{<|im_end|>
You can automatically apply it using the dedicated .apply_chat_template() function from Hugging Face transformers.
Warning. ⚠️ The model supports both single-turn and multi-turn conversations.
RAG systems enable AI solutions to include new, up-to-date, and potentially proprietary information in LLM responses that was not present in the training data. When a user asks a question, the retrieval component locates and delivers related documents from a knowledge base, and then the RAG generator model answers the question based on facts from those contextual documents.
# custom terms: read the license before you download$ fw get LiquidAI/LFM2-1.2B-RAG
# manifest sha256 4277b4ebe2fd… · 2.35 GB · 10 files$ fw verify ./LFM2-1.2B-RAG LiquidAI/LFM2-1.2B-RAG
Terms that come with these files. LFM 1.0: commercial use only for organisations under US$10M annual revenue. Keep a copy of the license with the files.
Custom license (custom).Read the license text first. Open this panel to show the commands once you accept its terms.
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
import os
os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("LiquidAI/LFM2-1.2B-RAG", revision="cdbd46d305e6935c544a3492feaafcc6b611970e")
model = AutoModelForCausalLM.from_pretrained("LiquidAI/LFM2-1.2B-RAG", revision="cdbd46d305e6935c544a3492feaafcc6b611970e", device_map="auto")
