AI engineer writing about production ML, language models, retrieval systems, and the engineering details that decide whether demos survive contact with users.https://callumjmac.github.io/https://callumjmac.github.io/posts/advanced-retrieval-rag/https://callumjmac.github.io/posts/advanced-retrieval-rag/Query expansion, cross-encoder re-ranking, and embedding adaptors for improving RAG retrieval quality.Tue, 21 May 2024 00:00:00 GMThttps://callumjmac.github.io/posts/llm-evals-framework/https://callumjmac.github.io/posts/llm-evals-framework/A general framework for building rule-based and model-graded evaluations for LLM-based applications.Tue, 07 May 2024 00:00:00 GMThttps://callumjmac.github.io/posts/rag-langchain-intro/https://callumjmac.github.io/posts/rag-langchain-intro/A step-by-step guide to building a Retrieval-Augmented Generation system using LangChain, Chroma, and OpenAI embeddings.Wed, 24 Apr 2024 00:00:00 GMThttps://callumjmac.github.io/posts/malicious-llm-prompt-detection/https://callumjmac.github.io/posts/malicious-llm-prompt-detection/Building a malicious prompt detector using traditional ML classifiers in sklearn, trained on Deepset's prompt-injection dataset.Mon, 22 Apr 2024 00:00:00 GMThttps://callumjmac.github.io/posts/continual-learning-metrics/https://callumjmac.github.io/posts/continual-learning-metrics/Ranking the most valuable metrics for monitoring deployed ML models, from user feedback to distribution drift.Tue, 16 Apr 2024 00:00:00 GMT