Certification

Running Local LLMs With Ollama

Arsh Sharma

DevOps expert and coach

Fill this form to get a notification when course is released.

Enroll for Free

Subscribe Now

Enroll Now

Already Subscribed? Log in

Enroll in this Course

Start Course

Lessons

Challenges

Topics

What you’ll learn

Our students work at..

Description

AI is transforming the world, and at the core of this revolution are Large Language Models (LLMs). While cloud-based AI services like ChatGPT and Claude dominate the landscape, running AI models locally opens up new possibilities for control, customization, and efficiency. That’s where Ollama comes in.

This course empowers you to deploy and manage LLMs efficiently on your own infrastructure. Whether you’re a developer, data scientist, or AI enthusiast, mastering Ollama will give you the flexibility to build AI-powered applications while maintaining full control over your models.

What You'll Learn

Getting Started with Ollama
- Set up and configure Ollama on your system.
- Run your first AI model and explore key CLI commands.
- Experiment with different models, parameters, and community tools.
  ‍
Building AI Applications
- Understand Ollama’s REST API and its endpoints.
- Integrate AI models into real-world applications.
- Adapt projects for OpenAI API compatibility.
  ‍
Customizing Models with Ollama
- Modify pre-built AI models with a Modelfile.
- Fine-tune models and adjust parameters to fit specific use cases.
- Upload and deploy custom AI models.

Why Take This Course?

‍This course combines hands-on labs with real-world scenarios, ensuring you gain practical experience in deploying and working with LLMs. You’ll experiment with model customization, build AI-powered applications, and develop skills to harness the full potential of AI on your local infrastructure.

About the instructor

Arsh is a passionate technologist with a deep curiosity for exploring and experimenting with emerging technologies. A strong advocate for continuous learning, he actively shares his knowledge through blogs and video tutorials. As a dedicated member of open-source communities, he has built a reputation as a prominent contributor and advocate. Recognized as a CNCF Ambassador and a recipient of the Kubernetes Contributor Award, Arsh has made significant contributions to the cloud-native ecosystem. His open-source journey includes working on the Kubernetes team at VMware and contributing to key CNCF projects such as cert-manager and Kyverno.

Beyond engineering, Arsh has extensive experience in technical marketing. At Okteto, a fast-growing startup in the platform engineering space, he led technical content creation and advocacy, bridging the gap between engineering and community engagement.

No items found.