Hadoop Developer
Horizon blue Cross blue shield
Newark, New Jersey
3 months ago
Job Description
Job Title Synonyms
Job Description
Job Title Synonyms
Job Description
Job Title Synonyms
hadoop developers, hadoop engineer, hadoop expert, hadoop development, hadoop devlpr, hadoop eng, big data developer
Job Description
Job Responsibilities:
- Hands on experience developing large scale enterprise data lake and analytical applications with Hadoop , Python, Spark and AWS services
- Track record of implementing MPP databases, NoSQL databases, Data Warehouse and enterprise Data Lake design
- Research and evaluate new technologies, design patterns and software products to determine feasibility and incorporate their capabilities in enterprise initiatives
- Solution design for Big Data projects with active involvement in POCs
- Support development teams by reviewing code and provide performance and security recommendations
- Work with enterprise architecture and Data architecture teams to understand projects scope and collaborate with them for solution design
- Collaborate with infrastructure and security teams for setting up required tools to be used for Data Lake development team and users
- Partner with Data Strategy and Data Modelling teams for Source data profiling , Data Matrix development and Data Quality Rules implementation
Qualifications:
- Over 10+ years' experience in IT with at least 4+ years in the lead developer role
- Expert in Big Data / Hadoop / Data Lake architectures
- Experience in Big Data solutions like Hadoop (AWS EMR & Hortonworks preferred) , Mongo DB, Amazon S3 etc
- Good working knowledge of Java, Python and Spark
- Experience with R Studio and R packages
- Effectively communicate complex technical concepts and solutions to non-technical business stakeholders
- Knowledge of infrastructure for Big Data platform and ability to work across various infrastructure teams
Education:
- Bachelor's Degree Required