WovV Technologies
WovV Technologies - Big Data Developer - Scala
Job Location
Pune, India
Job Description
Location : Pune (Hybrid Work module compulsory, WFH not available). Experience : 5-7 years. Contract Duration : Contract position for 6 months (can be extended). Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery. Role and Responsibilities : - Scala is a mandatory skill here. - Please ensure that the candidate has worked into Scala before sharing the profiles. - Also, while screening profiles please check if candidate was involved in "Product Development" or "application development". - Design, develop, and deploy scalable and performant backend Spark jobs for data processing and integration. - Collaborate with cross-functional teams to understand data requirements and develop solutions that meet business needs. - Integrate Spark jobs with Key Management API to ensure secure handling of sensitive data. - Deploy and manage Spark jobs on Google Dataproc, ensuring optimal performance and resource utilization. - Orchestrate workflows using Apache Airflow to schedule and monitor Spark jobs. - Integrate Snowflake and BigQuery as data targets for Spark jobs, ensuring data consistency and accuracy. - Optimize Spark jobs for performance and scalability, identifying bottlenecks and implementing solutions to improve efficiency. - Write clean, maintainable, and efficient code, following best practices and coding standards. - Collaborate with data engineers, data scientists, and other stakeholders to drive continuous improvement and innovation in data processing workflows. - Stay updated on emerging technologies and industry trends in big data processing and analytics. (ref:hirist.tech)
Location: Pune, IN
Posted Date: 4/24/2024
Location: Pune, IN
Posted Date: 4/24/2024
Contact Information
Contact | Human Resources WovV Technologies |
---|