Blog
Notes
Hire Me
OSS
Teaching
Notes
Jupyter
Notes
Python Concurrency
CUDA Version Management
GitHub Actions
dbt
Docker
How to learn
Linux
pandoc filters
programming languages
Video Editing
Coding Agents
Amp
fastai
Fundamentals
Image Classification
Data
FastHTML
Building Annotation Apps with FastHTML
Concurrency For Starlette Apps (e.g FastAPI / FastHTML)
Jupyter
Fix Jupyter CUDA cache
K8s
Basics
Secrets
Storage
Storage Basics
Dynamic Provisioning
Scaling
ReplicaSets
Scaling
StatefulSet
Jobs & CronJobs
Rollouts
Helm
Creating Helm Charts
Testing With Helm
Multi-Container Pods
Multi-Container Pods
Ambassador Sidecars
Restart Conditions
Sharing Processes in MC Pods
Developer tips
Pod restart vs. replacement
Probes
Resource Limits
Requesting resources
Logging
Monitoring
Ingress
Cluster Components
Security
Network Security
Securing Containers
Webhooks
Updating a K8s Cluster
RBAC
Workload Placement
Auto Scaling
Preemption
Random TILs
LLMs
Inference
Optimizing latency
Max Inference Engine
vLLM & large models
OpenAI
Function prompts
Evals
Inspect AI, An OSS Python Library For LLM Evals
Evals Flashcards
Evals Memes
Fine-tuning
Dataset Basics
LangChain
DocumentLoaders
Estimating vRAM
Curating LLM data
Tokenization Gotchas
Template-free axolotl
Function Calling
Llama-3 Func Calling
RAG
Stop Saying RAG Is Dead
P3: Optimizing Retrieval with Reasoning Models
P4: Late Interaction Models For RAG
P5: RAG with Multiple Representations
P6: Context Rot
P7: You Don’t Need a Graph DB (Probably)
Open Office Hours
Evals: Doing Error Analysis Before Writing Tests
Multi-Turn Chat Evals
Observability in LLM Applications
Tame Complexity By Scoping LLM Evals
Data Processing
How to Process Documents at Scale with LLMs
Prompt engineering
Course
Guidelines for Prompting
Iterative Prompt Development
Summarizing
Inferring
Transforming
Expanding
The Chat Format
Quarto
Syntax Highlighting
Listings from data
Merge listings
ML Serving
TF Serving
Basics
GPUs & Batching
TorchServe
Basics
Serving Your Own Model
FastAPI
Web Scraping
Browser requests to code
Transcribe & Diarize Videos
Notes
Jupyter
Jupyter
various Jupyter tricks
Title
Description
Fix Jupyter CUDA cache
A situation where you get GPU OOM in Jupyter
No matching items