Published onAugust 26, 2024MicroJaxjaxmicrojaxtpupytorchflaxjax-from-strachMicroJax is a minimal implementation of JAX in pure Python. It is a fun project to learn about JAX and how it works under the hood.Read more →
Published onApril 11, 2024Mixture of Depth is VibeMLGPTlanguage-modelmixture-of-depthpytorchbitnetMoDThought and code about mixture of depthRead more →
Published onMarch 23, 2024Expriments with Bitnet 1.5 (~ngmi~)MLGPTlanguage-modeltinytorchpytorchbitnetThe blog explores implementing Bitnet 1.5, highlighting its efficiency gains and challenges in quantized neural network training.Read more →
Published onSeptember 29, 2023Building autograd engine (tinytorch) 04autogradMLGPTlanguage-modeltinytorchpytorchnumpyBuilding my own dl framework name tinytorch,Read more →
Published onAugust 29, 2023Building autograd engine (tinytorch) 03autogradMLGPTlanguage-modeltinytorchpytorchnumpyBuilding my own dl framework name tinytorch,Read more →