TDM 19000: Starting Ollama for Single Agent Model

In an agent system, an autonomous agent uses artificial intelligence to perceive their environment, make decisions, and take actions to achieve a set goal.

There are two kinds of agent systems:

  • Single-agent system - a system that has a single agent accessing multiple tools, and that solves the set task by itself

  • Multi-agent system - a network of agents working together, each with its own specialization in certain skills or knowledge

Single-agent systems can be used across many different contexts. Our agent will act as a customer support chatbot, so it needs to be able to handle customers' FAQs, order status requests, and to follow company policy over user demand. These systems do need to be running using an LLM, so we will be using an Ollama server. Start the Ollama server running from a new terminal window:

/anvil/projects/tdm/bin/ollama serve

To check what Ollama models you currently have, do this in a second Terminal window:

/anvil/projects/tdm/bin/ollama list

In the case that your models have been cleared, run this in the Terminal to pull llama3.2, and define a model that uses 2 threads:

/anvil/projects/tdm/bin/ollama pull llama3.2

cat > ~/mymodel << HERE
FROM llama3.2
PARAMETER num_thread 2
HERE

/anvil/projects/tdm/bin/ollama create llama3.2-2 -f ~/mymodel