2
 raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/generate/ (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x00000214F6282A50>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it')) 

I have downloaded llama model from hugging face hub Is this correct way to use locally downloaded model with langchain. I am not sure about that can anyone check and confirm this please. I cant understand the above error from where it got.

from langchain.prompts import PromptTemplate from langchain.chains import LLMChain from langchain_community.llms.ollama import Ollama model_path = "model\\llama-2-7b-chat.ggmlv3.q8_0.bin" llm = Ollama(model=model_path) prompt = PromptTemplate.from_template("Generate a blog post about {topic}.") chain1 = LLMChain(llm=llm, prompt=prompt) topic = "Future of graphic design for beginners" output = chain1.invoke({"topic": topic}) print(output) 
1
  • Having the same issue here... No resolution so far.... Commented Jun 9, 2024 at 13:03

0

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.