You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

SoftStandard Solutions
Email

Senior Data Engineer – AI/ML + Python (9+ Years)

Company: Softstandard Solutions
Location: Onsite – United States
Experience: 9+ years (with 4+ years in Python development)
Visa: H1B Transfer Available, STEM Extension, GC Filing
Apply Email: garima.patankar@softstandard.com

About Softstandard Solution

Softstandard Solution is a leading IT consulting and staffing firm dedicated to delivering top-tier talent to global clients. We specialize in providing highly skilled technology professionals for cutting-edge projects in FinTech, AI/ML, Data Engineering, and cloud-native solutions. Our mission is to connect exceptional talent with high-impact opportunities, enabling innovation and success in enterprise-scale environments.

Role Overview

We are seeking an extraordinary Senior Data Engineer with deep expertise in AI/ML and Python development. The ideal candidate will architect, implement, and optimize scalable, fault-tolerant data pipelines, and productionize machine learning models in cloud-based environments. This role requires strong Python engineering skills, hands-on experience with AWS cloud technologies, and the ability to deliver enterprise-grade solutions in high-performance data environments.

Key Responsibilities

  • Architect and implement large-scale, high-performance data pipelines (batch & streaming) using PySpark, Kafka, and Python.
  • Collaborate with Data Scientists to deploy AI/ML models into production with MLOps frameworks (MLflow, Kubeflow, SageMaker).
  • Build and maintain ETL/ELT pipelines with advanced data modeling for OLTP/OLAP environments.
  • Optimize data workflows, ensuring data quality, governance, and lineage using tools like Great Expectations, DBT, or Apache Atlas.
  • Lead CI/CD implementation for data workflows using Git, Jenkins, GitHub Actions, or Azure DevOps.
  • Develop event-driven services and APIs to support real-time data streaming and microservices architecture.
  • Mentor and review code of junior engineers, enforcing best practices, clean code, and design patterns.
  • Manage containerized workflows using Docker and orchestration via Kubernetes or Airflow.

Required Technical Skills

  • Expert in Python (4+ years) – OOP, multithreading, memory optimization, performance tuning.
  • Advanced experience with PySpark, Pandas, SQL, and FastAPI/Flask.
  • Apache Spark, Kafka, Hadoop ecosystem, Hive, HBase.
  • Familiarity with Delta Lake, Iceberg, or Hudi for lakehouse architectures.
  • AWS: Redshift, Glue, EMR, Kinesis, Lambda, Step Functions, S3.
  • PostgreSQL, MySQL, MongoDB, Cassandra, Elasticsearch.
  • Feature engineering, model deployment, ML lifecycle management (MLflow, Kubeflow, SageMaker).
  • Experience with scikit-learn, TensorFlow, PyTorch preferred.
  • CI/CD, Git, Jenkins, Docker, Kubernetes.
  • Workflow orchestration via Airflow, Prefect, or Luigi.

Qualifications

  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related field.
  • 9+ years experience in Data Engineering with 4+ years in Python.
  • Strong understanding of algorithms, distributed systems, and system design.
  • Proven experience in production-grade enterprise environments.

 

Skills & Keywords for LinkedIn Search

Python, PySpark, AWS, Data Engineering, Machine Learning, AI/ML, MLOps, ETL/ELT, Big Data, Apache Spark, Kafka, Airflow, Hive, Delta Lake, Data Modeling, Docker, Kubernetes, DataOps, Feature Engineering, MLflow, TensorFlow, PyTorch

How to Apply

📧 Send your resume to garima.patankar@softstandard.com with the subject line:
“Senior Data Engineer – AI/ML + Python Application”

Note: H1B Transfer, STEM Extension, and Green Card Filing support available.