Tech Blog

How to Create a Chatbot with Your Own Documents Using Ollama and OpenWebUI Introduction Would you like to build a chatbot that interacts with your own documents? In this guide, you’ll learn how to: Run Ollama with a local LLM (Large Language Model) Use OpenWebUI as your AI chat interface Enable RAG (Retrieval-Augmented Generation) for smarter, document-aware conversations using your own PDF files This example runs on Windows but is also compatible with macOS and Linux. Note for macOS users: It's recommended to run Ollama natively (not via Docker) to enable GPU acceleration, as Docker on macOS does not support GPU passthrough.  Windows Prerequisites Ensure your system meets the following requirements: Windows 10 or Windows 11 NVIDIA GPU (recommended, but not required) WSL2 (Windows Subsystem for Linux 2) Docker Desktop At least 16GB RAM (32GB or more recommended) Step 1: Run Olla...

What are Containers Containers are lightweight, portable units that package an application with its dependencies, libraries, and configuration files, allowing it to run consistently across different environments. Unlike virtual machines, which include an entire operating system, containers share the host OS kernel, making them more efficient in terms of resource usage and startup time. Containers isolate applications at the process level, enhancing portability and scalability, though they share the host kernel and do not provide full OS isolation like VMs. Key characteristics of containers include: Portability: Run consistently on any system with a compatible container runtime. Lightweight: Minimal overhead compared to VMs, as they don’t include a full OS. Isolation: Processes are isolated, preventing interference between applications. Scalability: Easily replicate and deploy containers for distributed systems. Containers are the fou...

Running Linux on Windows with WSL The Windows Subsystem for Linux (WSL) allows you to run a Linux environment directly on Windows without the need for a traditional virtual machine or dual-boot setup. This blog post dives into WSL2, the second generation of this powerful tool, explaining what it is, how it works, why you might want to use it, and some of its limitations. What is WSL2? WSL2 is an enhanced version of the original Windows Subsystem for Linux, introduced by Microsoft to provide better performance and compatibility for running Linux distributions on Windows. Unlike WSL1, which translated Linux system calls to Windows, WSL2 uses a lightweight virtual machine (VM) to run a full Linux kernel. This VM is optimized to use minimal resources while providing near-native performance. How WSL2 Works Lightweight VM: WSL2 uses Hyper-V technology to create a minimal virtual machine that runs the Linux kernel. This VM is highly optimized, booting ...

Ollama   What is Ollama? Installing Ollama. Ollama CLI. Creating custom model files . Advanced CLI. REST API Access. What is Ollama? Ollama is a tool designed to simplify and accelerate the process of building AI-powered applications, specifically through the use of large language models (LLMs). It is built to enable developers to run and interact with models locally on their machines, offering a more user-friendly interface and a set of tools to facilitate easy integration of AI capabilities into apps. Key Features of Ollama: Local Deployment : Ollama allows you to run LLMs on your local machine rather than relying on cloud-based APIs. This gives you greater control over the models, data privacy, and reduces reliance on internet connectivity. Cross-Platform Support : It works across various operating systems (macOS, Windows, Linux), making it versatile and accessible for developers with different preferences. Pre-Trained Model...

Set Up Your Own Offline LLM Locally. Ever wondered what it would be like to run your very own AI language model on your computer? Imagine having a powerful language model like GPT or Meta's LLaMA running locally on your hardware—no cloud, no external servers, just you and the model. If you're curious about diving into this world, Ollama is the perfect tool to help you do just that. Here’s how you can get started! What is Ollama? Ollama is a platform designed for enthusiasts, developers, and researchers who want to run, manage, and interact with large language models (LLMs) locally. It’s an easy-to-use tool that lets you host powerful models like Meta’s LLaMA (Large Language Model Meta AI) directly on your own machine. Whether you’re building AI-powered apps, conducting research, or just exploring AI for fun, Ollama makes it simple. Key Features of Ollama: Run Models Locally Ollama lets you run LLMs entirely on your own hardware, so there’s no need to send sen...

Create a GitHub Pages Website. GitHub In this example we are going to build a very simple website and host it on GitHub Pages. This demonstration requires a Git Client and a Code Editor app. These are the apps that I use… GitHub Desktop: [Download GitHub Desktop] ( https://github.com/apps/desktop ) Visual Studio Code: [Download Visual Studio Code] ( https://code.visualstudio.com/ ) You will require a GitHub account, If you don’t already have one Goto https://github.com and sign up.  Once signed up, we can create a repository as follows… Login with your new account. Click - Create repository Enter username.github.io as the repository name. Replace username with your GitHub username. For example, if your username is webdev66, the repository name should be webdev66.github.io Choose a repository visibility as Public (Free hosting requires that the repository is public). Select Initialize this repository with a README. ...

GitHub Pages - Hosting for Free! When you're ready to build and host a website, there are many options to consider. You might wonder: Should I use a website generator? Can I write the code myself? Or maybe even use AI to create the site? Then, there's the question of hosting: Where will I host it? Will it cost money, and if so, will those costs change over time? One hosting option worth considering, especially if you're comfortable writing your own code and want a cost-effective solution, is GitHub Pages. What is GitHub Pages? GitHub Pages offers free web hosting straight from your GitHub repository, giving you a fast, no-fuss way to launch static websites. Perfect for developers, designers, or anyone wanting to get a site live without the headaches of server management. Whether it's a portfolio, blog, or project showcase, GitHub Pages lets you focus on what matters, your content! If you're a hobbyist, small business owner, or just need a simple website, ...