Published onDecember 1, 2024NOV-24 Things I've ReadMLpapersMachine-Learningshort notes on things I've readRead more →
Published onNovember 1, 2024OCT-24 Things I've ReadMLpapersMachine-Learningshort notes on things I've readRead more →
Published onAugust 26, 2024MicroJaxjaxmicrojaxtpupytorchflaxjax-from-strachMicroJax is a minimal implementation of JAX in pure Python. It is a fun project to learn about JAX and how it works under the hood.Read more →
Published onApril 11, 2024Mixture of Depth is VibeMLGPTlanguage-modelmixture-of-depthpytorchbitnetMoDThought and code about mixture of depthRead more →
Published onMarch 23, 2024Expriments with Bitnet 1.5 (~ngmi~)MLGPTlanguage-modeltinytorchpytorchbitnetThe blog explores implementing Bitnet 1.5, highlighting its efficiency gains and challenges in quantized neural network training.Read more →