How Run llama.cpp on Runpod – Step by step Guide

In this tutorial we discuss how to run and use llama.cpp on Runpod. RunPod is a cloud platform that lets you rent powerful GPUs on demand for AI workloads such as running LLMs, image generation, video generation, and model training. It provides access to GPUs like NVIDIA RTX 5090, A100, and H100 without needing to … Read more

Regression Bug? Learn Git Bisect to Find the Problem Commit

Git bisect tutorial feature image

In this tutorial we will discuss git bisect to find the commit that caused regression bug. Regression Bug A regression bug is an error that appears in software after a change like a new feature, update, or fix causing previously working functionality to break.It indicates the system has “regressed” in quality. This can happen in … Read more

App-to-App Authentication with Keycloak – Step by Step Guide

In this step-by-step guide, we will explore how to set up Keycloak for app-to-app authentication. Project In this demo, we are going to create a project named “Cool Project” . It has a FastAPI-based API server and client app. For app-to-app authentication/authorization, we will use the OAuth2 client credentials flow. OAuth 2.0 Client Credentials Flow … Read more

How to serve LLM using the OpenVINO Model Server on Windows

OpenVINO model server feature image

In this step-by-step guide, we will discuss the deployment of the Large Language Model (LLM) using the OpenVINO model server. This tutorial focuses on the serving of the TinyLlama chat model REST API endpoint using the openVINO model server. We know that OpenVINO is an open-source toolkit by Intel for optimizing and deploying deep learning … Read more

How to use ComfyUI with FastSDCPU and OpenVINO

ComfyUI fastsdcpu

This tutorial will discuss how to use FastSD webserver with ComfyUI. FastSDCPU is a faster version of a stable diffusion application running on a CPU, based on OpenVINO and Pytorch implementations. Step 1: Download and Install FastSDCPU In this demo, we are using a Windows 11 machine to test, first download FastSD CPU release. Extract … Read more

Short-Circuiting in Python

Short circuiting in python

In this article, we will discuss the short-circuiting technique in Python programming. What is Short Circuiting? Short-circuiting is a technique many programming languages use when evaluating boolean logic expressions to save computing power by skipping unnecessary parts of the expression. Python provides 2 short-circuit operators : or and The or Operator Python evaluates the left-hand … Read more