Setting Up Ollama With Docker
docker ps Method 2: Running Ollama with Docker compose Ollama exposes an API on http://localhost:11434, allowing other tools to connect and interact with it. That was when I got hooked…
Must Know Ollama Commands for Managing LLMs locally
I feel that this should be enough to get you started with Ollama, it’s not rocket science. My advice? Just fiddle around with it. ollama run llava:7b “Describe the content…
5 Open-source Local AI Tools for Image Generation I Found Interesting
While I won’t dive into the murky waters of how these models get trained (support your favorite creators, and remember, stealing is bad!), I can tell you this: each project…
How to Install DeepSeek R1 Locally on Linux
In this guide, we’ll walk you through setting up DeepSeek R1 on your Linux machine using Ollama as the backend and Open WebUI as the frontend. Source: The Hacker News…
I Ran Deepseek R1 on Raspberry Pi 5 and No, it Wasn’t 200 tokens/s
DeepSeek’s raw performance on the Raspberry Pi 5 showcases the growing potential of SBCs for AI workloads. DeepSeek v/s OpenAI benchmark | Source: Brian Roemmele Here’s how the performance data…
5 Local AI Tools to Interact With PDF and Documents
These are some of the projects I recommend for interacting with or chatting with PDF documents. However, if you know of more tools that offer similar functionality, feel free to…
Running Opencoder LLM in VS Code: A Local, Copilot Alternative
This tutorial is performed on Ubuntu 24.04 in a VM. Steps mentioned are mostly applicable on Ubuntu. But, feel free to replicate the same on other Linux distributions and operating…
I Ran the Famed SmolLM on Raspberry Pi
Their compact nature makes them well-suited for various applications, particularly in scenarios where local processing is crucial. As the industry shifts towards local deployment of AI technologies, the advantages of…
TEN AI: Open Source Framework for Quickly Creating Real-Time Multimodal AI Agents
Plus, it works on pretty much any device from your computer to your phone so you can create solutions that scale as your project grows.Drag-and-Drop Workflow Management: The Graph Designer…
I Ran 9 Popular LLMs on Raspberry Pi 5; Here’s What I Found
The model utilized around 5 GB of RAM, which left some capacity for other tasks, but the hallucinations ultimately detracted from the overall experience.Similar to llama2 model, due to its…
Meet Open NotebookLM: An Open Source Alternative to Google’s NotebookLM
Open NotebookLM allows users to test the tool via its Hugging Face page or install it locally from its GitHub repository. However, Google’s track record raises concerns about future monetization…
Exploring Llamafile: Mozilla’s Attempt in the World of Open Source AI
If you’re using Linux or macOS, open a terminal window and navigate to the downloaded file. However, the experience you get can vary based on your hardware; those with discrete…
Generative AI & LLMs: How are They Different or Similar?
Generative AI uses neural networks, which are algorithms inspired by how the human brain works. The way generative AI and LLMs complement each other is mind-blowing whether it’s generating vivid…
What are Tokens in LLMs? A Beginner’s Guide
It can be as short as a single letter or as long as a word or even part of a word. Think of it as the unit of language that…
What is Hugging Face?
There are 9,00,000+ models on the platform, and you can easily utilize each one of them on your system as per their usage instructions, and license requirements.A type of deep-learning…