Blog

This is some of my writing. It is likely going to be a combination of academic writing, things I find interesting, and my views on the world.

With regard to my own academic content, I'm going to try to publish all source code as far as confidentiality allows. Please shoot me an email if you find any discrepencies!

Diffing Models Without Crosscoders

Sparse Matrix Optimization

Soviet Chess Diplomacy

Modeling Protein Evolution

Notes from a talk from Dr. Arnold

Redundant Attention Heads in Large Language Models For In Context Learning

Language Models Update Based on In-Context Learning

WIP: Mixture of Blocks

reval

Journal Club: July 17 2024

Journal Club: July 10 2024