It’s a physical manifestation of an old system known as lattice multiplication or gelosia. Lattice multiplication makes use of the multiplication table in order to multiply huge numbers together ...
in this file, i implemented llama3 from scratch, one tensor and matrix multiplication at a time. also, im going to load tensors directly from the model file that meta ...