Staff Software Engineer - Compiler & Spark Runtime
- Salary
- $236K - $339.2K
- Level
- Staff
- Work type
- Hybrid · Menlo Park
Not stated in the posting: visa.
Open. First seen 13 November 2026.
About the role
Snowflake's standard text
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact.
We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.
Staff Software Engineer – Compiler & Spark Runtime
Location: Bellevue, WA or Menlo Park, CA
About the Team
The Spark Runtime Engineering Team brings Snowflake’s performance, efficiency, and reliability to Spark workloads. Our mission is to help customers scale data processing while preserving the familiar Spark APIs and semantics they rely on. We build the compiler and runtime integration that translate Spark workloads into efficient execution on Snowflake’s cloud-native query engine.
This includes tackling complex challenges in compiler infrastructure, query-plan lowering, Spark compatibility, execution integration, and end-to-end observability to deliver faster, more cost-efficient data processing at scale.
We are seeking an experienced, hands-on engineer who combines deep technical expertise with the ability to lead complex engineering initiatives and influence technical direction. You will design and build critical compiler and runtime capabilities, guide architectural decisions, and mentor engineers through technical collaboration.
Role Overview
You will own complex projects from design through implementation and production rollout, contribute directly to the codebase, review critical designs and code, and investigate challenging correctness, performance, and reliability issues. You will provide technical leadership for engineers building production compiler and runtime capabilities for Spark workloads on Snowflake.
In partnership with compiler, query engine, runtime, and product teams, you will translate customer needs into focused technical priorities and measurable engineering outcomes. You will lead through technical judgment, hands-on execution, mentorship, and influence—not through formal reporting relationships.
Responsibilities
- Lead the technical design and implementation of Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and efficient SQL generation.
- Own complex engineering initiatives from problem definition and architecture through implementation, validation, and production rollout.
- Provide technical leadership to project teams by clarifying engineering trade-offs, aligning contributors, reviewing designs and code, and resolving technical blockers.
- Improve end-to-end workload performance and cost-efficiency through profiling, compilation-latency reduction, metadata-access improvements, and collaboration with query-engine teams.
- Establish strong correctness and compatibility practices, including differential testing against Apache Spark, regression coverage, and clear handling of unsupported behavior.
- Drive production quality for owned components, including observability, incident investigation, fault recovery, and safe rollout practices.
- Mentor engineers through design discussions, code reviews, debugging, and knowledge sharing, strengthening the team’s technical capabilities.
- Partner with senior technical leaders and Product Management to prioritize investments, identify dependencies, and scope deliverable engineering milestones.
- Validate changes against representative customer workloads and track measurable improvements in compatibility, latency, reliability, and cost-efficiency.
Minimum Qualifications
- 10+ years of hands-on software engineering experience, including substantial work on compilers, query-processing systems, or runtime infrastructure.
- Demonstrated experience serving as a technical lead for complex engineering initiatives, guiding engineers and coordinating delivery without requiring formal management authority.
- A track record of designing, implementing, and delivering production systems, with ownership of significant architectural and implementation decisions.
- Deep expertise in at least one relevant area, such as compiler architecture and IR transformations, relational query processing, language semantics and type systems, or runtime integration.
- Proficiency in Scala, Java, C++, or a comparable implementation language, with the ability to write and review production code.
- Strong systems fundamentals, including concurrency, memory behavior, and performance analysis, together with experience debugging complex production issues.
- Ability to translate technical and customer requirements into practical engineering priorities and collaborate effectively across teams and locations.
- Strong technical communication and mentorship skills, including the ability to build alignment around architectural decisions and explain complex trade-offs.
Preferred Qualifications
- Experience with Apache Spark internals, Catalyst, Spark Connect, or DataFrame APIs.
- Experience with relational algebra, SQL generation, query optimization, or database execution systems.
- Experience with Scala/JVM performance, native runtime functions, metadata caching, or compilation-performance optimization.
- Experience building compatibility-test frameworks, differential testing, performance benchmarks, or production observability for data systems.
- Experience technically leading systems through customer adoption, production hardening, and staged releases.
- A degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.
Snowflake's standard text
Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.
How do you want to make your impact?
For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com
What this role asks for
Particular to this role
Scala
Rare in Snowflake's other 239 open postings.
81% of this description is written for the role. The rest is Snowflake's standard text, folded away below.
Compared with Snowflake's other open jobs.
The team: Engineering HIRES STEADILY
This role is one of 119 open in Engineering. 36 were posted in the last 30 days and the oldest in February: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Snowflake (119 of 119), Java (61 of 119), AWS (52 of 119), Azure (51 of 119), Python (51 of 119), GCP (50 of 119), Golang (44 of 119)
OTHER ROLES ON THIS TEAM
- Software Engineer - Dynamic Tables posted Nov 18
- Software Engineer - Database Search posted Nov 17
- Staff Software Engineer, Cortex AI Functions posted Nov 16
- Principal Software Engineer (Outer Loop), Engineering Systems posted Nov 16
- Senior Software Engineer - Elastic Global Services posted Nov 16
- Senior Engineering Manager - Control Plane & Regulatory and Sovereign Cloud posted Nov 13
- Software Engineer Intern - Zurich (2027) posted Nov 13
- Staff Software engineer - Storage posted Nov 13
- Staff Software Engineer posted Nov 12
- Software Engineer, Identity & Access Management posted Nov 12
- Technical Program Manager, Compute Infrastructure posted Nov 11
- Software Engineering Intern – Data Ingestion & Platform Infrastructure (Warsaw, Summer 2027) posted Nov 11
- Software Engineering Intern – Developer Platform (Warsaw, Summer 2027) posted Nov 11
- SENIOR SOFTWARE ENGINEER posted Nov 11
- Technical Program Manager posted Nov 10
- Senior Engineering Manager - Data Lake posted Nov 10
- Principal Software Engineer - Observability posted Nov 6
- Staff Software Engineer - Billing Platform posted Nov 4
- Senior Engineering Manager - AIM Virtualization posted Nov 3
- Information Systems Security Engineer posted Nov 3
- Software Engineer - Trust & Platform Security posted Oct 30
- Staff Software Engineer - Metadata posted Oct 30
- Staff Forward Deployed Engineer, Applied AI posted Oct 28
- Senior Software Engineer, Compute Service posted Oct 26
- Senior Software Engineer, Enterprise Team posted Oct 26
- Software Engineering Manager, Data Processing posted Oct 26
- Director of Engineering, Frontier Engineering posted Oct 24
- Software Engineer posted Oct 23
- Forward Deployed Engineer, Frontier Engineering posted Oct 23
- AI/ML Consulting Manager posted Oct 23
- Engineering Manager/Tech Lead Manager - Runtime Engineering posted Oct 22
- Senior Software Engineer - Marketplace posted Oct 22
- Senior Software Engineer - Warehouse UX posted Oct 22
- Senior Infrastructure Engineer, Observe by Snowflake posted Oct 21
- Principal Software Engineer - Parameters & Experimentation posted Oct 20
- Software Engineering Manager, AI Migrations (Forward Deployed) posted Oct 16
- Senior Principal Forward Deployed Engineer, Frontier Engineering posted Oct 16
- Incident Response Engineer posted Oct 16
- Staff Software Engineer — Engineering Systems, Continuous Integration posted Oct 16
- Software Engineer — Engineering Systems, Continuous Integration posted Oct 15
- Principal Forward Deployed Engineer I, Frontier Engineering posted Oct 15
- Senior Software Engineer - Identity, Data Security and Trust posted Oct 15
- Principal Software Engineer, Anti-Abuse posted Oct 15
- Staff Software Engineer - Ingestion posted Oct 13
- Software Engineer, Enterprise Team posted Oct 13
- Technical Program Manager posted Oct 12
- Engineering Manager - Snowpark posted Oct 12
- Software Engineer Intern AI/ML - Warsaw (2027) posted Oct 12
- Senior Technical Program Manager - ML/AI posted Oct 10
- Principal Software Engineer - Elastic Global Services posted Oct 8
- Senior Software Engineer, Engineering Productivity posted Oct 7
- Senior Software Engineer posted Oct 6
- Engineering Manager, Release Validation posted Oct 6
- Tech Lead/Manager, AI-Native Authoring posted Oct 6
- Principal Software Engineer 2 - OLTP posted Oct 6
- Senior Technical Program Manager - Capacity Planning posted Oct 5
- Senior Manager - AI for Engineering Systems posted Oct 5
- Software Engineer AI Team posted Oct 1
- Software Engineer – Mobile Team posted Sep 30
- Frontend Software Engineer– Cortex AI Apps posted Sep 29
- Software Engineer - SnowConvert AI posted Sep 29
- Software Engineer Intern - Berlin (2027) posted Sep 29
- Principal Software Engineer II - Interoperable Foundations posted Sep 28
- Staff Software Engineer - Postgres Control Plane posted Sep 26
- Software Engineer - Postgres posted Sep 25
- Software Engineer - Java Platform posted Sep 25
- Staff Applied AI Engineer (FDE) posted Sep 24
- Principal Software Engineer - Agentic Pipelines posted Sep 23
- Senior Software Engineer - Foundation DB posted Sep 22
- Senior/Staff System Research Engineer – LLM Inference Optimization posted Sep 21
- Senior Software Engineer - Billing Platform posted Sep 18
- Staff Frontend AI Engineer - Cortex Code posted Sep 18
- Engineering Manager - Cloud Efficiency posted Sep 18
- Staff Software Engineer, Frontier Security Team posted Sep 18
- Staff Software Engineer, Cortex AI Search Infrastructure posted Sep 17
- Intermediate/ Senior Software Engineer - Cortex LLM Training Platform posted Sep 17
- Principal Software Engineer - Performance Engineering (Cloud Infrastructure) posted Sep 17
- Senior Software Engineer - Snowflake Feature Store posted Sep 15
- Fullstack Engineer - Marketplace posted Sep 15
- Senior Software Engineer - Security Foundations posted Sep 11
- Director of Engineering, AI Functions posted Sep 11
- Engineering Manager posted Sep 10
- AI Research Scientist, New Grad – Agents & Reinforcement Learning posted Sep 3
- Senior Software Engineer - Cloud Efficiency posted Sep 3
- Senior Software Engineer - Cloud Security posted Sep 2
- Senior Software Engineer, Cortex Quality posted Aug 31
- Senior Software Engineer - ManagedDB posted Aug 31
- Senior Software Engineer - Dynamic Tables posted Aug 30
- Staff Software Engineer, Snowpark Container Service posted Aug 24
- Engineering Manager - Cost Intelligence posted Aug 24
- Platform Infrastructure Engineer posted Aug 20
- Staff/Principal AI Software Engineer - Snowflake CoWork posted Aug 19
- Senior Software Engineer - NatSec posted Aug 15
- Staff Frontend Software Engineer, AI Product: Observe by Snowflake posted Aug 10
- Senior Software Engineer, CXE – Frontier Engineering posted Aug 6
- Software Engineer - Database Engineering posted Jul 28
- Post-Doctoral AI Researcher (2 year Fixed-Term) posted Jul 24
- Software Engineer - SnowCommand posted Jul 23
- Senior Software Engineer, Snowpark Container Service posted Jul 14
- Senior Full Stack Engineer, App Runtime posted Jul 14
- Software Engineer, AI Native Authoring posted Jul 7
- Senior Software Engineer - Identity & Access Management posted Jul 1
- Staff Software Engineer - FDB Platform posted Jun 30
- Staff Software Engineer - Database Engineering posted Jun 29
- Staff Software Engineer - Unistore posted Jun 25
- Senior Software Engineer - Product Security - Poland posted Jun 25
- Principal Engineer posted Jun 8
- Software Engineer (AI-Native), Database Engineering posted May 27
- Engineering Manager, Bedrock posted May 22
- Senior Software Engineer - Observe by Snowflake, OpenTelemetry posted May 8
- Senior Frontend Engineer, AI Product - Observe by Snowflake posted Apr 29
- Principal Software Engineer - AI Poland posted Apr 7
- Principal Software Engineer II - Next-Gen Data Transformations posted Apr 1
- Staff Research Scientist, AI Agents & LLMs posted Mar 26
- Principal Software Engineer II - Product Security posted Mar 9
- Staff Software Engineer, App Runtime posted Mar 4
- Principal Software Engineer I - Snowhouse Foundation posted Feb 26
- Software Engineer - Backend posted Feb 6
From the team and dates on Snowflake's own job board.
Similar jobs
- Principal Software Engineer at Microsoft
Shares 5 skills: Scala, Spark, Java… · Staff level · same country - Staff Backend Software Engineer - Activations at LiveRamp
Shares 5 skills: Scala, Spark, Snowflake… · Staff level · same country - Sr. Software Engineer, Data Engineering at Poshmark
Shares 5 skills: Scala, Spark, Snowflake… · same country - Sr. Software Engineer, Machine Learning & Data Infrastructure at OKX
Shares 5 skills: Scala, Spark, Java… · same country - Staff Software Engineer, Ads Data Platform at Instacart
Shares 4 skills: Scala, Spark, Snowflake… · Staff level · same country - Software Engineer - Customer Experience Engineering at Snowflake
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.