Azure Data Engineer

ValleySoft is a regional IT services provider delivering enterprise technology solutions and process-focused services to clients worldwide. Working across the Information Technology and Services space, the company helps organizations build dependable, scalable platforms that support critical business operations and data-driven decision-making.

This is an opportunity to join a team focused on building reliable enterprise data capabilities in a complex delivery environment. As an Azure Data Engineer, you will contribute to data solutions that connect systems, improve operational performance, and help ensure business and analytics teams can access trusted information when they need it.

Responsibilities

• Build, maintain, and optimize Azure-based data pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, or equivalent Azure data technologies.
• Integrate SAP and other enterprise data sources into Azure using Velocity, Theobald, or similar integration technologies.
• Design and optimize scalable data ingestion, transformation, and orchestration solutions.
• Implement data governance, lineage, cataloging, and metadata management requirements using Microsoft Purview.
• Support data quality management processes in collaboration with Pulse.
• Provide L1.5–L3 support for data platform incidents, pipeline failures, and production issues.
• Monitor data loads, platform performance, and operational health, resolving issues proactively.
• Collaborate with business, analytics, and data engineering teams to deliver reliable data solutions.
• Document data architecture, integration patterns, data flows, and operational procedures.
• Implement enhancements and operational improvements across the Intelligent Data Platform.
• Apply CI/CD practices and data engineering best practices to improve reliability and maintainability.

Requirements

Required Qualifications

• Hands-on experience delivering Azure data engineering solutions in a mid-level individual contributor capacity.
• Hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, or equivalent Azure data engineering technologies.
• Advanced SQL development skills, with experience using Python and/or Apache Spark for data engineering and data transformation.
• Experience integrating SAP data sources into cloud platforms.
• Hands-on experience troubleshooting production data pipelines and supporting Azure data platform operations across L1.5–L3 support tiers, including investigating pipeline failures, resolving data load and transformation issues, and monitoring platform performance and operational health.
• Strong understanding of data governance, lineage, metadata management, and data quality concepts.
• Understanding of CI/CD principles for reliable data engineering delivery.
• Experience collaborating with data engineering and other technical teams on data pipelines, integrations, troubleshooting, and production support.
• Experience collaborating with business and analytics teams to understand data requirements and ensure data availability and quality.
• Fluency in English.

Preferred Qualifications

• 3+ years of Azure data engineering experience.
• Experience with incident tracking and root-cause analysis to help prevent recurring production issues.
• Hands-on experience configuring or implementing Microsoft Purview or other enterprise data cataloging solutions.
• Experience implementing cloud-based governance frameworks.
• Hands-on experience with deployment pipelines for Azure data workloads, version control, automated testing, and release and change management.
• Experience working in Agile or Scrum teams and following development, testing, deployment, and production support processes.
• Experience working with SAP teams, enterprise system owners, and stakeholders responsible for source systems and data governance.