Big Data Engineer - Java.Python

Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend. - 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. - Programming background - Mandatory- Scala, Spark and Java / Python - Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming. - Experience in creating e2e pipelines in Hadoop. - Experience in SQL, Hive and NoSQL databases - Experience in Linux / Unix platform - Experience of cloud design patterns - Experience in Jenkins, GitHub, Debugging the code, and error handling. - Experience in Building end to end ETL Pipelines - Self-starter & resourceful personality with the ability to manage pressure situations. - Experience working with geographically distributed teams. - Work on high- level business and technical problems, contribute to architectural decisions. - Create the core framework/ templates that gives a starting point for the team members to get started with implementation/ execution. Role & Responsibilities : - Build Data and ETL pipelines in Hadoop. - Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python - Interact with customers daily to ensure smooth engagement. - Exposure to GCP - Responsible for timely and quality deliveries. - Exposure to Scrum and Agile Development best practices - Fulfil organization responsibilities - Sharing knowledge and experience within the other groups in the organization, conducting various technical sessions and training. (ref:hirist.tech)

Location: Pune, IN

Posted Date: 4/24/2024