Data Engineer
- Level
- Mid
Not stated in the posting: salary, work type, visa.
Open. First seen 2 October 2026.
About the role
Overview
Black Canyon Consulting (BCC) is searching for a Data Engineer to support the design, development, and maintenance of data infrastructure that enables artificial intelligence, machine learning, and analytical workloads. The Data Engineer will help ensure that data is reliable, accessible, scalable, and operationally ready throughout the full lifecycle from ingestion through deployment.
Job Description
The Data Engineer will design, implement, maintain, and optimize data pipelines, APIs, data transformation workflows, and supporting infrastructure. This position will work with databases, data lakes, data warehouses, feature stores, and other data platforms to ensure information can be efficiently ingested, transformed, accessed, and used by analytical and AI-enabled systems.
The Data Engineer will also develop and maintain ETL/ELT processes, feature engineering workflows, and service layers that expose data or model endpoints to downstream systems and applications.
Duties and Responsibilities
- Develop and maintain data ingestion and transformation pipelines using Python and SQL.
- Implement bronze, silver, and gold data processing patterns using DuckDB and Apache Iceberg.
- Build reusable, metadata-driven capabilities for ingesting data from databases, APIs, files, SaaS platforms, CDC, and event-driven sources.
- Develop configuration-driven source onboarding and source-to-canonical data mappings.
- Transform heterogeneous source data into standardized and governed data models while maintaining source provenance and traceability.
- Implement agentic and AI-enabled workflows to support source profiling, schema analysis, data mapping, pipeline generation, testing, troubleshooting, reconciliation, and data quality.
- Develop automated data validation, reconciliation, testing, monitoring, and error-handling capabilities.
- Support incremental processing, schema evolution, backfills, and historical data migration.
- Integrate structured data with related document and geospatial datasets where required.
- Work with the Data Architect and Lead Data Engineer to implement common engineering standards and reusable platform patterns.
- Participate in code reviews, automated testing, CI/CD, technical documentation, and operational support.
Requirements
- 4+ years of relevant data engineering or software engineering experience.
- Strong hands-on experience with Python, SQL, DuckDB, and Apache Iceberg.
- Experience developing production ETL/ELT pipelines across databases, APIs, files, and semi-structured data sources.
- Experience implementing bronze/silver/gold or comparable layered data architectures.
- Experience designing reusable, metadata-driven ingestion and transformation pipelines.
- Experience with AWS data services, particularly Amazon S3 and AWS Glue.
- Experience with data modeling, source-to-target mappings, data quality, reconciliation, and schema evolution.
- Experience developing or implementing agentic or AI-enabled data engineering workflows, including the use of AI agents or LLMs to assist with data engineering tasks.
- Experience with Git-based development, automated testing, and CI/CD.
Bonus Skills
- Experience with agentic frameworks such as LangChain, LangGraph, or similar orchestration frameworks.
- Experience with Kafka, Amazon MSK, or CDC technologies.
- Experience integrating Salesforce, ServiceNow, Microsoft Dataverse, or similar enterprise platforms.
- Experience with OpenSearch, vector stores, or document-processing pipelines.
- Experience with GeoParquet, PostGIS, or geospatial datasets.
- Experience working in the U.S. Federal Government space.
- Experience with permitting, regulatory, land management, environmental, energy, or natural-resource datasets.
Black Canyon Consulting's standard text
Benefits and Salary
We attract the best people in the business with our competitive benefits package that includes medical, dental and vision coverage, 401k plan with employer contribution, paid holidays, vacation, and tuition reimbursement.
If you enjoy being a part of a high performing, professional service and technology focused organization, please apply today!
What this role asks for
Particular to this role
Apache Iceberg · DuckDB · Kafka · LLM · LangChain · OpenSearch · Salesforce · ServiceNow
Rare in Black Canyon Consulting's other 71 open postings.
Standard for data engineering roles
AWS · CI/CD · Data Warehousing · ETL · SQL
Common in data engineering postings at any company.
In most of Black Canyon Consulting's ads
Python
Named in most of its open postings, whatever the role.
90% of this description is written for the role. The rest is Black Canyon Consulting's standard text, folded away below.
Compared with Black Canyon Consulting's other open jobs.
The team: Platform & DevOps HIRES STEADILY
This role is one of 30 open in Platform & DevOps. 1 was posted in the last 30 days and the oldest in January: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (21 of 30), AWS (15 of 30), Azure (11 of 30), C++ (11 of 30), CI/CD (11 of 30), Linux (11 of 30), GitLab (10 of 30)
OTHER ROLES ON THIS TEAM
- Content Pipeline Engineer posted Oct 20
- Junior Data Scientist posted Oct 5
- Senior Business Intelligence Analyst posted Sep 25
- Data Architect posted Sep 25
- Data Scientist posted Sep 25
- Lead Data Engineer posted Sep 25
- Junior Solutions Analyst posted Sep 25
- Mid-Level Solutions Analyst posted Sep 25
- Senior Solutions Analyst posted Sep 25
- Systems Developer posted Sep 25
- GIS Data Engineer posted Sep 25
- Solutions Architect posted Sep 25
- AI/ML Engineer posted Sep 25
- Embedded Systems Engineer (Medical Devices) posted Aug 25
- Senior Windows Systems Administrator posted Jun 11
- Platform DevEx Engineer posted Jan 28
- Senior AI and Large Language Model (LLM) Engineer posted Dec 19
- AI/Machine Learning Specialist posted Nov 5
- Senior Platform Engineer (DataOps) posted May 2
- Platform Engineering Manager posted May 1
- Senior Platform DevEx Engineer (DevOps) posted May 1
- Platform Ops Lead posted Feb 13
- Systems Adminstrator posted Feb 11
- QA Platform Engineer posted Apr 10
- Platform Engineer (DataOps) posted Sep 24
- Operations Support Engineer - Lead posted Nov 15
- Openshift / Kubernetes Engineer posted Oct 7
- System Security Engineer posted May 12
- Web Service Protection Engineer posted Jan 29
From the team and dates on Black Canyon Consulting's own job board.
Salary context
62 other open postings titled Data Engineer state a salary: median USD 132,050 to USD 179,350 a year.
See Data Engineer salaries in the United States →
Similar jobs
- Data Engineer II, JVM at PlayStation Global
Shares 8 skills: OpenSearch, ETL, Kafka… · same seniority · same country - Data Engineer – Mobile Monetization – Big Data, GenAI & Mobile AdTech at PubMatic
Shares 8 skills: Apache Iceberg, LangChain, Data Warehousing… · same seniority · same country - Forward Deployed Engineer at Neuroscale AI
Shares 9 skills: OpenSearch, ServiceNow, Vector Databases… · same seniority · same country - Technical Lead, Data Engineering at Distributed Spectrum
Shares 8 skills: DuckDB, Apache Iceberg, Vector Databases… · same country - Manager, Data Engineering at Fanatics Commerce
Shares 8 skills: Apache Iceberg, Data Warehousing, ETL… · same country - Lead Data Engineer at Black Canyon Consulting
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.