Keyflow

Search Keyflow

Find a shortcut, workflow, MCP server or skill

Use an open-source LLM (via HuggingFace)

n8n template #1980
This workflow demonstrates how to connect an open-source model to a Basic LLM node. The workflow is triggered when a new manual chat message appears. The message is then run through a Language Model Chain that is set up to process text with a specific prompt to guide the model's responses. Note that open-source LLMs with a small number of parameters require slightly different prompting with more guidance to the model. You can change the default Mistral-7B-Instruct-v0.1 model to any other LLM supported by HuggingFace. You can also connect other nodes, such as Ollama. Note that to use this template, you need to be on n8n version 1.19.4 or later.

Hand off to your agent

Prompt

Help me set up the n8n workflow "Use an open-source LLM (via HuggingFace)" (https://n8n.io/workflows/1980). It uses: Basic LLM Chain, Hugging Face Inference Model. Import the template JSON into my n8n instance, list every credential I need to create, and walk me through testing it.

Paste into Claude Code and it will do the rest.

Apps and nodes

Basic LLM ChainHugging Face Inference Model

Similar workflows

NameViews
  1. Chat with PDF docs using AI (quoting sources)95K
  2. Respond to WhatsApp Messages with AI Like a Pro!91K
  3. ⚡AI-Powered YouTube Video Summarization & Analysis80K
  4. Chat with local LLMs using n8n and Ollama78K
  5. Personalize marketing emails using customer data and AI72K
  6. Gmail AI Auto-Responder: Create Draft Replies to incoming emails55K
  7. AI Automated HR Workflow for CV Analysis and Candidate Evaluation51K
  8. Host Your Own AI Deep Research Agent with n8n, Apify and OpenAI o348K
Buy me a coffee