Senior Data Engineer - Hadoop/BigQuery

Role : Senior Data Engineer Location : Bangalore We are seeking a Lead/Senior Data Engineer to drive the development of cutting-edge data systems that enhance security insights for a global customer base. This role offers the opportunity to solve complex challenges in Data, Cloud, and Security while designing scalable, distributed systems using the latest technologies. Key Responsibilities : - Architect & Build : Develop scalable services for data validation, transformation, loading, and analytics. - Collaborate : Work with application development and product management teams to design and scale data-driven applications. - Innovate : Evaluate and implement open-source technologies to meet evolving business needs. - Optimize : Design frameworks for efficient data mining, analytics, and usage pattern analysis. - Lead : Mentor junior team members, fostering a culture of best practices and continuous improvement. Required Skills & Experience : - 10 years of hands-on experience in building highly scalable, distributed data systems. - Proficiency in Python, Java, or Golang. - Strong experience with cloud platforms: AWS, Azure, GCP, etc. - Deep understanding of data structures, algorithms, and system design. - Expertise in data technologies such as Kafka, Kubernetes, MySQL, Hadoop, BigQuery, Spark, Snowflake, and other open-source databases. - Proven ability to design fault-tolerant, distributed systems, especially with columnar data stores. - Excellent written and verbal communication skills. Preferred Qualifications : - Master's degree in Computer Science or a related field (strongly preferred). - Contributions to the open-source community (bonus points). Why Join Us ? - Work alongside industry experts in Data and Cloud Analytics. - Make a global impact with innovative data-driven solutions. - Thrive in a collaborative, supportive, and dynamic work environment. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 5/1/2025