Implementing the first Deepmind papers on deep reinforcement learning and realizing that the Sutton-Barto textbook is a masterpiece in technical pedagogy.

3

Forward-mode and reverse-mode autodiff in python featuring dual numbers and graph traversals

6

A note on how Gaussians are convolved to make the reparameterization trick work in the diffusion forward process.

8

Andrew Barto and Richard Sutton for pioneering Reinforcement Learning

16

Learning about where diffusion models break and collecting attempts at solutions

17

My thoughts on the "Grandmaster-Level Chess Without Search" paper from Google DeepMind

23

Notes and some ideas while reading the DreamCoder paper

25

A half-baked idea I had while checking my equations

49

Paper reading notes from w2v-BERT by Google Brain

58

Some ideas on improving semantic segmentation with SAM

61

Live Coding Seam Carving Part 2

72

there is a country layer in the llama 2 transformer

75

Three implementations of self attention, one for visualizing the self attention between two tensors, one for language, and one in PyTorch

84

Exercises in faster and more intuitive tensor notation for deep learning.

85

Helper code that has different ways to visualize audio files, mostly for future reference.

98

Testing whether Newton's method decays updates exponentially

100

Live Coding Seam Carving Part 1

103

13th International (Online) Conference on Transportation Planning and Implementation Methodologies for Developing Countries

134

Official Work Product Submission for the 2020 edition of Google Summer of Code with TensorFlow.

138

Hardcore History, Kobe Bryant and new adventures.

146