AIDropbox Tech3 months ago
How we optimized Dash's relevance judge with DSPy
14 min read
Dropbox Dash used DSPy to optimize its LLM relevance judge for production. Manual prompt tuning plateaued and caused regressions during model swaps. DSPy enabled systematic prompt optimization against a measurable objective, making the judge cheaper and more reliable across models.
Level
Hype check
Tap to vote and see what everyone thinks.