- Published on
Thought and code about mixture of depth
Bitnet
All Posts
- ml (9)
- python (7)
- gpt (7)
- language-model (7)
- pytorch (7)
- tinytorch (5)
- autograd (4)
- numpy (4)
- pygame (3)
bitnet (2)
- papers (2)
- machine-learning (2)
- closure (1)
- game-of-life (1)
- convolution (1)
- game (1)
- fps (1)
- fractal-tree (1)
- recursion (1)
- os (1)
- subprocess (1)
- system (1)
- jax (1)
- microjax (1)
- tpu (1)
- flax (1)
- jax-from-strach (1)
- mixture-of-depth (1)
- mod (1)
- csv (1)
- pandas (1)
- file (1)
- json (1)
- llm (1)
- edge (1)
- termux (1)
- android (1)
- Published on
The blog explores implementing Bitnet 1.5, highlighting its efficiency gains and challenges in quantized neural network training.