Launch Recite Me assistive technology
Back to job search

Hadoop Engineer

  • Location:

    New York, USA

  • Salary:

    Negotiable

  • Contact:

    Daryl Medlin

  • Contact email:

    Daryl.Medlin@ojassociates.com

  • Job ref:

    JOB-112020-130490_1605711844

  • Published:

    über 3 Jahre her

  • Expiry date:

    2020-12-18

  • Startdate:

    ASAP

The Role

Serving as a Platform Engineer, this provides a unique opportunity to help shape and influence one of the most strategic initiatives in the organization. The position will be responsible for building enterprise data management platforms both on-premise and in the cloud. It is expected that this engineer will architect and build out the core data platforms for the enterprise. This role will require an advanced skillset across a variety of technologies. This individual will often have to learn on their own and remain on the cusp of new technologies in the Big Data, Analytics, and Cloud space.

Primary Responsibilities

  • Accountable for designing and delivering against the data technology strategy
  • Work with a team of engineers and developers to deliver against the overall technology data strategy
  • Ensure enterprise data platforms are standardized, optimized, available, reliable, consistent, accessible and secure to support business and technology needs
  • Understand data related initiatives within the organisation and engineer optimal designs and solutions
  • Drive knowledge management practices for key enterprise data platforms and collaborate with team members
  • Collaborate with peers across Enterprise Data Management, to deliver on the overarching strategy
  • Develop framework, metrics and reporting to ensure progress can be measured, evaluated and continually improved
  • Stay current and informed on emerging technologies and new techniques to refine and improve overall delivery

Desired Qualifications:

  • 8+ years in a variety of technology - especially Linux, Web, Databases, Big Data, and Cloud
  • Experience with Cloudera's Data Platform (CDP), Hortonworks Data Platform (HDP), and AWS is preferred
  • Deep expertise in data related tools including latest data solutions (i.e. Big Data, Cloud, In Memory Analytics, etc.)
  • Hands-on experience with Hadoop, NoSQL DBs, Big Data warehouses, and insights on when to recommend a particular solution
  • Solid experience in standing up enterprise practices for Big Data, Analytics, Self-Service
  • Proven track record for identifying, architecting and building new technology solutions to solve complex business problems
  • Capable of working with open source software, debugging issues and working with vendors toward effective resolution

Education:

Minimum Bachelor's Degree in relevant field; Master's Degree a plus

Competencies:

  • Thinks strategically - sets overall direction for solution design and delivery for enterprise platforms aligned to the data & analytics strategy
  • Results Driven - sets aggressive goals and is accountable for continuously driving improved outcomes, leading change and ensuring high standards
  • Excellent communication skills, both written and verbal in conveying technical design and approach for delivering technical solution
  • Pragmatic in his/her approach, delivering incrementally and demonstrating value
  • Ability to help train/develop less senior people on the team
  • Other competencies: critical thinker, adaptable, self-starter, demonstrates sound judgment

Skills:

  • Proficient with Unix/Linux (building/assembling packages, shell scripts, configuration management and OS tuning)
  • Knowledge of configuration management/automation tooling (Puppet/Chef/Salt)
  • Solid understanding of Hadoop technologies (YARN, Hive, MR, Tez, Spark, etc.)
  • Solid understanding of AWS technologies (EC2, S3, Glue, Athena, RedShift, etc.)
  • Experience with Java, Python and API's
  • Knowledge of enabling Kerberos and best practices for securing data a plus
  • Experience working with Vendors/Open Source in the Hadoop ecosystem
  • Knowledge of the open source community (opening issues, tracking issues and identifying problematic issues ahead of time by tracking open JIRA issues in the community)
  • Understanding of Networking (tracing, packet capture, etc.)

Image 2020 11 03 T18 21 29

The latest OJ Webinar

Are you looking to relocate?