- Published on
- |Views: 70|7 min read
tl;dr: `torch.cat` is not in-place, instead use pre-allocated buffers
Pytorch
All Posts
- llm (4)
pytorch (3)
- cuda (2)
- writing (2)
- tensors (2)
- linear-algebra (2)
- machine-learning (2)
- transformers (2)
- kv-cache (2)
- inference (2)
- metal (1)
- gpu (1)
- parallel-programming (1)
- nvcc (1)
- colab (1)
- pretraining (1)
- midtraining (1)
- posttraining (1)
- data-quality (1)
- synthetic-data (1)
- dpo (1)
- energy-based-model (1)
- likelihood (1)
- score-matching (1)
- diffusion (1)
- personal-growth (1)
- webdev (1)
- side-project (1)
- attention (1)
- deepseek (1)
- mla (1)
- optimization (1)
- Published on
- |Views: 459|17 min read
Part 2 of my Tensor Puzzles Walkthrough series: optimizing solutions to fit the puzzle constraints, and comparing notes with the author.- Published on
- |Views: 1055|17 min read
My solutions and notes to the tensor broadcasting puzzles created by Sasha Rush.