You are viewing a preview of this job. Log in or register to view more details about this job.

Junior Data Engineer

Job Description

  • Design, develop, implement, and maintain scalable data pipelines and data integration solutions to support enterprise reporting, analytics, and business intelligence initiatives.
  • Develop and maintain ETL/ELT processes to extract data from multiple source systems, transform and validate data, and load it into data warehouses, data lakes, and other analytical platforms.
  • Design and optimize data structures, data models, schemas, and database solutions to support analytical and operational requirements.
  • Develop complex SQL queries, stored procedures, views, and data transformation logic to efficiently process and integrate large datasets.
  • Build and maintain data pipelines that integrate data from relational databases, enterprise applications, APIs, files, and other structured and unstructured data sources.
  • Collaborate with data analysts, business analysts, application developers, database administrators, and business stakeholders to understand data requirements and develop appropriate technical solutions.
  • Perform data profiling, cleansing, transformation, validation, and reconciliation to ensure the accuracy, completeness, consistency, and reliability of enterprise data.
  • Implement data quality checks, validation rules, monitoring processes, and error-handling procedures throughout data pipelines.
  • Troubleshoot and resolve issues related to data pipelines, ETL processes, database performance, data integration, and data availability.
  • Optimize data processing workflows and database queries to improve system performance, scalability, reliability, and processing efficiency.
  • Develop automated processes for data ingestion, transformation, processing, and delivery to reduce manual data-management activities.
  • Support the design and implementation of data warehouses, data marts, data lakes, and other enterprise data platforms.
  • Develop and maintain technical documentation covering data sources, data flows, data models, transformation logic, interfaces, dependencies, and system processes.
  • Participate in the design and implementation of data integration interfaces between enterprise applications and analytical systems.
  • Monitor data pipelines and scheduled data-processing jobs, investigate failures, and implement corrective actions to maintain data availability and reliability.
  • Support data migration and system implementation projects by analyzing source and target data structures, developing transformation logic, and validating migrated data.
  • Apply data security, access-control, governance, and compliance requirements to data engineering solutions.
  • Evaluate new data technologies, tools, and methodologies and recommend improvements to existing data engineering processes and platforms.
  • Develop solutions that enable reliable and efficient access to high-quality data for reporting, analytics, machine learning, and business intelligence applications.

Minimum Requirements

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Information Technology, Data Engineering, Data Science, or a related field.
  • Strong experience with SQL and relational database technologies.
  • Experience designing and developing ETL/ELT pipelines and data integration solutions.
  • Experience with data warehouse, data lake, data mart, or other analytical data-platform technologies.
  • Experience with programming or scripting languages such as Python, Java, Scala, JavaScript, or similar technologies.
  • Experience with ETL and data integration frameworks or tools such as Informatica, SSIS, Talend, Azure Data Factory, AWS Glue, or similar platforms.
  • Strong understanding of database design, data modeling, schemas, indexing, query optimization, and data-processing concepts.
  • Knowledge of cloud-based data platforms and services such as Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), or similar technologies.
  • Knowledge of data-quality, data-governance, data-security, and data-management principles.
  • Strong analytical and problem-solving skills with the ability to troubleshoot complex data and integration issues.
  • Strong written and verbal communication skills and the ability to collaborate effectively with technical and non-technical teams.

Equal Employment Opportunity

We are an equal opportunity employer and do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected by applicable federal, state, or local law.