DiScoFormer: One transformer for density and score, across distributions

Ai2 introduced the DiScoFormer, a transformer that estimates both density and score from any set of data points without retraining. It replaces kernel density estimation and neural score-matching models, which each force a trade-off between generalizability and accuracy. The model works across distributions.