Goodfire's block-sparse featurizers advance AI interpretability

Goodfire AI introduced Block-Sparse Featurizers (BSF), which decompose neural network activations into multidimensional subspaces instead of one-dimensional directions like Sparse Autoencoders. This captures continuous concepts such as a rotating curve without fracturing them, achieving lower minimum description length on the DINOv3 vision model.