Data Engineer
Group 1 Job Title: Data Engineer
Position Overview:
We are seeking a skilled and detail-oriented Data Engineer to join our team and play a key role in building, optimizing, and maintaining the data infrastructure that powers our analytics and business intelligence capabilities. In this role, you will design and manage scalable data pipelines, ensure data quality, and enable seamless access to reliable datasets for analysts, data scientists, and business stakeholders. This is an exciting opportunity to work on impactful projects that provide the foundation for data-driven decision-making across the organization.
Key Responsibilities:
Data Architecture & Pipeline Development:
- Design, develop, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources.
- Implement best practices for data modeling, database optimization, and storage solutions.
- Integrate new data sources and ensure compatibility with existing systems.
Data Quality & Governance:
- Ensure data accuracy, consistency, and completeness through validation and cleansing processes.
- Implement data governance policies and security protocols to protect sensitive information.
- Monitor data pipelines and troubleshoot issues to ensure uninterrupted data flow.
Collaboration & Support:
- Work closely with BI Analysts, Data Scientists, and business teams to understand data needs and deliver high-quality, accessible datasets.
- Collaborate with IT teams to optimize system performance and data storage solutions.
- Support ad-hoc data requests and analysis by providing clean, well-structured datasets.
Performance Optimization & Scalability:
- Optimize queries, processing workflows, and storage for maximum performance.
- Recommend and implement improvements to increase the scalability and efficiency of data systems.
- Leverage cloud platforms and modern data engineering tools for advanced data processing capabilities.
Continuous Improvement:
- Stay updated on emerging technologies, tools, and best practices in data engineering.
- Recommend and implement automation strategies to improve data workflows and reduce manual intervention.
- Participate in architectural discussions to enhance data infrastructure and analytics capabilities.
Qualifications:
- Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- Proficiency in SQL and experience with programming languages such as Python, Java, or Scala.
- Hands-on experience with ETL/ELT processes and tools (e.g., Apache Airflow, Talend, dbt).
- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
- Strong understanding of relational and non-relational databases (e.g., PostgreSQL, MySQL, MongoDB).
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
As a Data Engineer, you’ll be at the core of our data ecosystem, enabling teams to access reliable, high-quality data that fuels insights, innovation, and business success.