You are viewing a preview of this job. Log in or register to view more details about this job.

Big Data Engineer

Neo Prism Solutions LLC
Email

Big Data Engineer Responsibilities:


  • Meeting with managers to determine the company’s Big Data needs.
  • Developing Hadoop systems.
  • Loading disparate data sets and conducting pre-processing services using Hive or Pig.
  • Finalizing the scope of the system and delivering Big Data solutions.
  • Managing the communications between the internal system and the survey vendor.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.
  • Training staff on data resource management.

Big Data Engineer Requirements:


  • Bachelor’s degree in computer engineering or computer science.
  • Previous experience as a big data engineer.
  • In-depth knowledge of Hadoop, Spark, and similar frameworks.
  • Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
  • Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.
  • Familiarity with Mesos, AWS, and Docker tools.
  • Excellent project management skills.
  • Good communication skills.
  • Ability to solve complex networking, data, and software issues.