
Slack removed SSH-based job execution from its Amazon EMR pipelines, migrating over 700 Airflow operators to a REST-driven orchestration layer called Quarry. The shift eliminated direct SSH access to production clusters, improving security, reliability, and observability across eight data regions. Jobs now follow a server-side lifecycle with HTTP APIs instead of persistent SSH sessions.
Tap to vote and see what everyone thinks.