Projects
Things I've built
QuasiQ
A simple quantum computer simulator. Implements quantum gates, superposition, and entanglement.
Learn more →
TinyTorch
A minimal autograd engine built from scratch in under 1000 lines. Capable of training complex models like GPT.
Learn more →
microjax
A minimal implementation of JAX-style function transformation engine. Builds automatic differentiation, JVP, and VJP from first principles.
Learn more →
Baji - Programming Language
The first Marathi programming language. A high-level, dynamically typed, interpreted language with syntax and documentation entirely in Marathi.
Learn more →
Iza
A minimal container runtime built from scratch, similar to Docker. Implements core container functionality using chroot and syscalls for process isolation.
Learn more →
nanoGRPO
A lightweight implementation of Group Relative Policy Optimization (GRPO), a reinforcement learning algorithm.
Learn more →
Multi-Head Latent Attention (MLA)
Working implementation of DeepSeek's Multi-Head Latent Attention mechanism.
Learn more →
Ohara
A collection of autoregressive model implementations. Includes diverse models and experiments designed for easy replication and modification.
Learn more →Attention as Graph
An alternative approach to calculating self-attention using graph-based methods.
Learn more →fuchsia
A minimal library for Reinforcement Learning on Large Language Models. Provides clean abstractions for RLHF and related techniques.
Learn more →Reinforced Steering Vectors
Using Reinforcement Learning to discover steering vectors for controlled text generation.
Learn more →