You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

Job Description: Data Engineer

Experience: 3-9 yearsEmployment type: W2 contract

About the Role

We are looking for a Data Engineer to build and maintain the data infrastructure that powers analytics, reporting, and machine learning. You will design reliable, scalable pipelines and work closely with data scientists, analysts, and software engineers to deliver trusted data across the business.

Depending on experience, you will either build and maintain pipelines and data models (3-5 years), own end-to-end data products and optimize platform performance (5-7 years), or lead data architecture and engineering standards (7-9 years).

Key ResponsibilitiesDesign, build, and maintain scalable batch and streaming data pipelines (ETL/ELT)Ingest data from databases, APIs, event streams, files, and third-party sourcesBuild and manage data warehouses, data lakes, and lakehouse platformsDevelop data models for analytics (dimensional modeling, star/snowflake schemas, medallion architecture)Transform and process large datasets using Spark, SQL, and dbtOrchestrate workflows using Airflow, Dagster, or similar toolsImplement data quality checks, validation, lineage, and observabilityOptimize query and pipeline performance, and manage cloud costsApply data security, privacy, and governance practices (access control, PII handling, encryption)Automate deployments using CI/CD and infrastructure as codeTroubleshoot production failures, perform root-cause analysis, and maintain pipeline SLAsPartner with stakeholders to turn business requirements into data solutions

Additional for senior profiles (6+ years):

Define data platform architecture, standards, and best practicesLead technical design reviews and tool/vendor evaluationsMentor junior engineers and drive project planning and deliveryRequired Skills and QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or a related field (or equivalent experience)3-9 years of hands-on experience in data engineeringAdvanced SQL skills, including query optimization and window functionsStrong programming skills in Python (Scala or Java is a plus)Experience with Apache Spark or similar distributed processing frameworksExperience with orchestration tools such as AirflowHands-on experience with a cloud platform (AWS, Azure, or GCP) and its data services (S3/ADLS/GCS, Glue, Redshift, BigQuery, Synapse, etc.)Experience with a modern warehouse or lakehouse such as Snowflake, Databricks, or BigQueryStrong understanding of data modeling, warehousing, and partitioning conceptsExperience with Git and CI/CD workflows