Home
About

Subscribe

Architectural Characteristics

Yingting Huang

Oct 25, 2022

Photo by Anthony DELANOIX / Unsplash

Sign up for more like this.

Enter your email

Cost-Effective Private Large Language Model Inference on Azure Kubernetes Service

Introduction This article provides a method for private and cost-optimized deployment of large language models on the Azure cloud. It assumes the reader has foundational knowledge of large language models and Kubernetes. It utilizes AKS spot instances, quantization techniques, and batching inference to reduce compute costs compared to traditional deployment

Aug 22, 2023 8 min read

Upgrade all dotnet packages

#!/bin/bash regex='PackageReference Include="([^"]*)" Version="([^"]*)"' find . -name "*.*proj" | while read proj do while read line do if [[ $line =~ $regex ]] then name="${BASH_REMATCH[1]}" version="${BASH_REMATCH[2]}" dotnet add $proj package $name fi done < $proj done

Jul 28, 2023

Building a WASM Serverless Solution with KEDA HTTP Add-on and Slight Containerd Shim

Introduction In this article, we will explore how to use KEDA, KEDA HTTP add-on, with Slight Containerd Shim to build a WASM serverless solution. The solution provides scale to/from zero support, reduced time for cold start, and cloud integration capabilities such as Azure blob, App Configuration, ServiceBus etc. The

Jan 29, 2023 5 min read

Unofficial Azure Club © 2023

Powered by Ghost