Unofficial Azure Club
  • Home
  • About
Subscribe

Architectural Characteristics

  • Yingting Huang

Yingting Huang

Oct 25, 2022
Architectural Characteristics
Photo by Anthony DELANOIX / Unsplash

Sign up for more like this.

Enter your email
Subscribe
Cost-Effective Private Large Language Model Inference on Azure Kubernetes Service
Featured

Cost-Effective Private Large Language Model Inference on Azure Kubernetes Service

Introduction This article provides a method for private and cost-optimized deployment of large language models on the Azure cloud. It assumes the reader has foundational knowledge of large language models and Kubernetes. It utilizes AKS spot instances, quantization techniques, and batching inference to reduce compute costs compared to traditional deployment
Aug 22, 2023 8 min read

Upgrade all dotnet packages

#!/bin/bash regex='PackageReference Include="([^"]*)" Version="([^"]*)"' find . -name "*.*proj" | while read proj do while read line do if [[ $line =~ $regex ]] then name="${BASH_REMATCH[1]}" version="${BASH_REMATCH[2]}" dotnet add $proj package $name fi done < $proj done
Jul 28, 2023
Building a WASM Serverless Solution with KEDA HTTP Add-on and Slight Containerd Shim
Featured

Building a WASM Serverless Solution with KEDA HTTP Add-on and Slight Containerd Shim

Introduction In this article, we will explore how to use KEDA, KEDA HTTP add-on, with Slight Containerd Shim to build a WASM serverless solution. The solution provides scale to/from zero support, reduced time for cold start, and cloud integration capabilities such as Azure blob, App Configuration, ServiceBus etc. The
Jan 29, 2023 5 min read
Unofficial Azure Club © 2023
Powered by Ghost