Archives
All the articles I've archived.
-
Capacity Planning Qwen3-TTS on an A10G
A single-GPU capacity study for streaming Qwen3-TTS: SLOs, vLLM-Omni comparison, fleet estimates, and a proposed production architecture.
-
How to Build a Low-Latency Streaming Qwen3-TTS Server
Turning Qwen3-TTS into a deployable AWS streaming service with CUDA graphs, FastAPI WebSockets, and measured sub-200ms first-audio latency.
-
Advanced Retrieval for Retrieval-Augmented Generation
Query expansion, cross-encoder re-ranking, and embedding adaptors for improving RAG retrieval quality.
-
LLMs Evals: A General Framework for Custom Evaluations
A general framework for building rule-based and model-graded evaluations for LLM-based applications.
-
Implementing RAG in LangChain with Chroma: A Step-by-Step Guide
A step-by-step guide to building a Retrieval-Augmented Generation system using LangChain, Chroma, and OpenAI embeddings.
-
Malicious LLM Prompt Detection in Python
Building a malicious prompt detector using traditional ML classifiers in sklearn, trained on Deepset's prompt-injection dataset.
-
Continual Learning: Which metrics are important?
Ranking the most valuable metrics for monitoring deployed ML models, from user feedback to distribution drift.