- Published on
Notes on Microsoft phi-4 data pipeline for pre-training, 'mid-training', supervised fine-tuning and preference optimization
Latest Posts
My blog on human (mostly mine) and machine learning.
- Published on
Notes on the Apple Silicon GPUs: Architecture, Memory Hierarchy, and the Metal Programming framework, and how it compares to NVIDIA CUDA.- Published on
A recap of my day debugging issues with nvcc and nvcc4jupyter on Google Colab's free T4 GPUs, with brief notes on CUDA backward compatibility and compute capability- Published on
Part 2 of my Tensor Puzzles Walkthrough series: optimizing solutions to fit the puzzle constraints, and comparing notes with the author.- Published on
My solutions and notes to the tensor broadcasting puzzles created by Sasha Rush.