Rahul Dubey

Machine learning engineer building ranking, search, and recommendation systems. I write from-scratch explainers on ML systems, LLM internals, and the craft of writing good Python.

About me GitHub LinkedIn

Writing

LLMs Part 2: Attention Mechanism

ml

deep-learning

llm

In this post, I’ll dive into the attention mechanism that is one of the key features of modern LLMs. We’ll go over some of the shortcomings of pre-LLM Neural language models…

LLMs Part 1: Token Embeddings

ml

deep-learning

llm

In this post, I am diving into token embeddings. LLMs like any other ML model cannot process raw-text directly. The process with which we convert raw-text into acceptable…

Feature Store: an essential part of ML infrastructure

ml

feature-store

In this post, I’ll talk about Feature Store: an essential component of a modern Machine Learning infrastructure. We’ll first briefly look at what a production ML system…

Writing Pythonic code: Part 2

python

This is the second post (here’s the first) on writing Pythonic code. In this post, we will first go over some aspects of writing effective Python code by brushing over…

Writing Pythonic Code: Part 1

python

This is the first of many Python related posts that I plan to write while studying how to write good Python code from the book Effective Python. In this post, we will go…