Sr Software Engineer, Infrastructure

Databricks runs its internal IT Infrastructure group as a product led organisation, and this senior engineering role sits inside it. The team owns the core infrastructure and observability platforms that other engineering groups build on, so the work is about making good practice the default rather than handling tickets. The position is hybrid in San Francisco.

What you would work on - Building and running production infrastructure on AWS, defined entirely in code - Operating containerised workloads on Kubernetes with attention to security posture and efficient use of resources - Designing deployment pipelines and looking after the CI runner fleet behind them - Creating frameworks so that any new application arrives with logging and metrics already wired up - Writing internal command line tools and automation that smooth out day to day developer workflows - Working across Security, Engineering and Support, and mentoring less experienced engineers while documenting what you build

What they are looking for - At least five years writing production software, not solely operations work - Strong Python, which the posting calls non negotiable - Deep familiarity with Terraform, with Pulumi noted as a preference - Hands-on time with AWS, Kubernetes and Docker in real deployments - Advanced knowledge of GitHub Actions and self hosted GitHub runners - A grasp of the observability pillars and tools such as Datadog, Prometheus or the ELK stack - Comfort with distributed systems concepts including Kafka and message queues, and the independence to run ambiguous projects without close direction

Stack: Python, Terraform, Pulumi, AWS, EKS, Azure Kubernetes Service, Docker, Kubernetes, GitHub Actions, GitHub Runners, Datadog, Prometheus, ELK, Kafka

Compensation: The employer publishes a Zone 1 range of $159,900 to $219,900 USD.