You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

SoftStandard Solutions
Email

Data Engineer — Job Description

Job Title

Data Engineer

Position Overview

We are seeking a highly skilled Data Engineer to design, develop, and maintain scalable data pipelines and data infrastructure. The ideal candidate will be responsible for building robust data solutions that support analytics, reporting, machine learning, and business intelligence across the organization.

Key Responsibilities

  • Design and implement scalable and efficient ETL/ELT pipelines for structured and unstructured data.
  • Develop and maintain data warehouses, data lakes, and real-time data processing systems.
  • Integrate data from multiple sources including APIs, databases, and streaming platforms.
  • Ensure high data quality, accuracy, consistency, and security across systems.
  • Optimize data workflows for performance, scalability, and cost efficiency.
  • Collaborate with data analysts, data scientists, and business stakeholders to deliver reliable data solutions.
  • Monitor and troubleshoot data pipelines and resolve production issues.
  • Implement data governance, compliance, and best practices.
  • Automate data processing workflows using orchestration tools.
  • Support cloud-based data platform development and migration.

Required Skills & Qualifications

  • Strong proficiency in SQL and Python.
  • Experience with data engineering concepts, ETL/ELT processes, and data modeling.
  • Hands-on experience with big data frameworks such as Apache Spark or Hadoop.
  • Knowledge of cloud platforms like AWS, Azure, or Google Cloud.
  • Experience with data warehousing solutions such as Snowflake, Redshift, or BigQuery.
  • Familiarity with data pipeline orchestration tools like Airflow.
  • Understanding of APIs, JSON, XML, and data integration methods.
  • Strong problem-solving and analytical skills.

Preferred Skills

  • Experience with real-time streaming tools such as Kafka.
  • Knowledge of containerization tools like Docker and orchestration tools like Kubernetes.
  • Exposure to CI/CD pipelines and DevOps practices.
  • Experience with BI tools such as Power BI, Tableau, or Looker.
  • Understanding of machine learning data pipelines.

Education & Experience

  • Bachelor’s degree in Computer Science, Information Technology, or related field.
  • 2–8 years of experience in Data Engineering or related roles.
  • Cloud certifications (AWS/Azure/GCP) are a plus.