{"id":10164,"date":"2024-04-29T10:25:31","date_gmt":"2024-04-29T08:25:31","guid":{"rendered":"https:\/\/via-internet.de\/blog\/?p=10164"},"modified":"2025-09-16T10:05:04","modified_gmt":"2025-09-16T08:05:04","slug":"ollama-getting-started","status":"publish","type":"post","link":"https:\/\/via-internet.de\/blog\/2024\/04\/29\/ollama-getting-started\/","title":{"rendered":"Ollama | Getting Started"},"content":{"rendered":"\n

Installation<\/h2>\n\n\n\n

Read here<\/a> for details.<\/p>\n\n\n\n

Linux<\/td>curl -fsSL https:\/\/ollama.com\/install.sh | sh<\/td><\/tr>
Mac OS<\/td>Download<\/a><\/td><\/tr>
Windows<\/td>Download<\/a><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Start Ollama Service<\/h2>\n\n\n\n
ollama start<\/pre>\n\n\n\n
This starts the Ollama Service and binds it to the default ip address 127.0.0.1:11434<\/code><\/p>\n\n\n\n
If you want to access the service from another host\/client, you have to use the ip address 0.0.0.0<\/code><\/p>\n\n\n\n
systemctl stop ollama.service\nexport OLLAMA_HOST=0.0.0.0:11434\nollama start<\/pre>\n\n\n\n
To change the IP address of the service, edit the file \/etc\/systemd\/system\/ollama.service and add<\/p>\n\n\n\n
[Unit]\nDescription=Ollama Service\nAfter=network-online.target\n\n[Service]\nExecStart=\/usr\/local\/bin\/ollama serve\nUser=ollama\nGroup=ollama\nRestart=always\nRestartSec=3\nEnvironment=\"OLLAMA_HOST=0.0.0.0:11434\"\n\n[Install]\nWantedBy=default.target<\/pre>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Access the Ollama Service from your Browser using <ip-adress of host>:11434<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Sample Python Chat<\/h2>\n\n\n\n
Install Python<\/p>\n\n\n\n
Install Ollama Library<\/p>\n\n\n\n
pip install ollama<\/pre>\n\n\n\n
Create the chat programm<\/p>\n\n\n\n
#!\/usr\/bin\/env python\n\nfrom ollama import Client\n\nollama = Client(host='127.0.0.1')\n\nresponse = ollama.chat(model='llama3', messages=[\n  {\n    'role': 'user',\n    'content': 'Why is the sky blue?',\n  },\n])\nprint(response['message']['content'])<\/pre>\n\n\n\n
Run the programm<\/p>\n\n\n\n
\u276f .\/chat.py<\/pre>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Hint: To see, whats happen with the service, monitor the logfile<\/p>\n\n\n\n
\u276f sudo journalctl -u ollama.service -f<\/pre>\n\n\n\n
Query the API<\/h2>\n\n\n\n
Read the API definition here<\/a><\/code><\/p>\n\n\n\n
Run Query with streaming<\/h3>\n\n\n\n
curl http:\/\/localhost:11434\/api\/generate -d '{\n  \"model\": \"llama3\",\n  \"prompt\": \"Why is the sky blue?\"\n}'<\/pre>\n\n\n\n
Run Query without streaming<\/h3>\n\n\n\n
curl http:\/\/localhost:11434\/api\/generate -d '{\n  \"model\": \"llama3\",\n  \"prompt\": \"Why is the sky blue?\",\n  \"stream\": false\n}'<\/pre>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Create a simple ChatGPT Clone<\/h2>\n\n\n\n
Create the Gradio App<\/h3>\n\n\n\n
<\/pre>\n","protected":false},"excerpt":{"rendered":"
Installation Read here for details. Linux curl -fsSL https:\/\/ollama.com\/install.sh | sh Mac OS Download Windows Download Start Ollama Service This starts the Ollama Service and binds it to the default ip address 127.0.0.1:11434 If you want to access the service from another host\/client, you have to use the ip address 0.0.0.0 To change the IP address of the service, edit the file \/etc\/systemd\/system\/ollama.service and add Access the Ollama Service from your Browser using <ip-adress of host>:11434 Sample Python Chat Install Python Install Ollama Library Create the chat programm Run the programm Hint: To see, whats happen with the service, monitor the […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_crdt_document":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[168],"tags":[],"class_list":["post-10164","post","type-post","status-publish","format-standard","hentry","category-ai"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/posts\/10164","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/comments?post=10164"}],"version-history":[{"count":4,"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/posts\/10164\/revisions"}],"predecessor-version":[{"id":10426,"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/posts\/10164\/revisions\/10426"}],"wp:attachment":[{"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/media?parent=10164"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/categories?post=10164"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/via-internet.de\/blog\/wp-json\/wp\/v2\/tags?post=10164"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}