Staff Software Engineer - Databases
DatabricksP-375
At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical services.
What You’ll Do
As a Staff Software Engineer, you’ll lead the design, development, and reliability of our global platform that manages schema and data changes at scale:
- Schema Migration Platform: Architecting and maintaining automated schema change infrastructure for MySQL and TiDB, while implementing versioning, rollback, validation, and auditing for safe, predictable, and fast migrations.
- Scale, Reliability & Test Harness: Ensuring the platform operates across thousands of global databases with zero downtime, enhancing resilience, observability, and recovery, and building a test harness for migration and deployment validation.
- Developer Experience & CI/CD Integration: Designing intuitive tools and APIs for seamless schema and data change management, and embedding migration workflows into CI/CD pipelines to increase velocity and reduce friction.
- Schema & Data management: Designing infrastructure for safe, large-scale schema and data operations like backfills and purging. This includes ensuring backfill operations are monitored, retryable, minimally disruptive, and automated to align with schema/data evolution and maintain data integrity.
Your role will be crucial in:
- Ensuring the scalability and reliability of schema and data operations across Databricks’ global footprint.
- Driving predictable deployments by architecting robust test harnesses and automation.
- Elevating the developer experience by building accessible, resilient tools that make complex migrations feel simple.
- Guaranteeing the integrity of both schema and data through safe, efficient backfill strategies.
What we look for:
- 12+ years of professional experience in backend systems or platform engineering.
- Experience in building platforms, infrastructure, or database engineering, especially with MySQL, TiDB.
About the company
Databricks
Unified analytics and data lakehouse platform.
Similar roles
Counsel, Commercial & Partnerships
Airbnb
Account Executive, Strategic Accounts | Southern Europe
Airtable
Director, Product Management (Shopping & Offers)
Affirm
Product Manager
Airbnb