Data Engineer - Apache NiFi

Job Title : Data Engineer Location : remote Job type : contractual for 6 months Experience : 5 years Key Responsibilities : - Design, develop, test, and deploy NiFi data pipelines to integrate with various data sources and destinations (e.g., databases, APIs, messaging queues). - Develop custom NiFi processors, controllers, and reporting tasks as needed. - Collaborate with data architects to design scalable data architectures and ensure data quality. - Work with data scientists and analysts to understand data requirements and deliver data products. - Troubleshoot data pipeline issues, optimize performance, and ensure high availability. - Develop and maintain technical documentation for data pipelines and NiFi configurations. - Participate in code reviews, ensure coding standards, and contribute to the improvement of the overall codebase. Requirements : - 5-6 years of experience in data engineering, with a focus on NiFi development. - Strong expertise in Apache NiFi, including: - Developing custom processors and controllers. - Configuring and optimizing NiFi pipelines. - Integrating NiFi with various data sources and destinations. - Proficiency in programming languages such as Java, Python, or Scala. - Experience with data processing frameworks like Apache Kafka, Apache Spark, or Apache Flink. - Strong understanding of data architecture principles, data governance, and data quality. - Experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes) is a plus. - Excellent problem-solving skills, with the ability to debug complex issues. - Strong communication and collaboration skills, with experience working with cross-functional teams. (ref:hirist.tech)

Location: in, IN

Posted Date: 5/1/2025