You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

SoftStandard Solutions
Email

Job brief

 

We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.

To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.

 

Contract Type: W2 Contract

 

Responsibilities

  • Analyze and organize raw data
  • Build data systems and pipelines
  • Evaluate business needs and objectives
  • Interpret trends and patterns
  • Conduct complex data analysis and report on results
  • Prepare data for prescriptive and predictive modeling
  • Build algorithms and prototypes
  • Combine raw information from different sources
  • Explore ways to enhance data quality and reliability
  • Identify opportunities for data acquisition
  • Develop analytical tools and programs
  • Collaborate with data scientists and architects on several projects

 

Requirements and skills

  • BS/MS in Computer Science or related discipline (math, engineering etc).
  • Experienced with 3 – 5 years.
  • 3+ years of experience in data engineering disciplines.
  • A passion for writing good, clean, and reliable code.
  • Substantial experience with a broad range of database systems.
  • Strong communications skills with both technical and non-technical team members.
  • Collaborative and enthusiastic approach to software development.
  • Strong sense of project ownership and personal responsibility.
  • Requires technical competencies:
  • Expertise in Python, SQL
  • Expertise in at least one orchestration tool (Airflow, Dagster, etc.)
  • Experience working with Apache Spark
  • Column-oriented SQL data warehouses such as Snowflake or Redshift
  • Experience working with AWS suite of data tools (S3, Glue, Lambda etc)
  • Distributed messaging systems such as Apache Kafka or Amazon SNS
  • Experience with Databricks, Deltalake.
  • Must have any of these mentioned certifications : Databricks Certified Data Engineer Associate , Microsoft Azure Data Engineer Associate