Data Engineer - Python/Power BI

We are hiring a Data Engineer for one of our client MNCs. Job Title : Data Engineer (Nifi, Glue, Airflow) Location : Remote Job Type : 6 months contract (extendable) Experience Required : - 4 years in developing and configuring workflows on Apache Nifi, including AWS-related connectors. - 3 years in Apache Airflow, including writing jobs/DAGs/tasks using Python and experience with HTTP, S3, and Database operators. - Experience with AWS Step Functions, Glue, and Athena is a must. - Strong proficiency in Python. - Experience with Apache Spark (good to have). - Experience with PowerBI (a plus). - Workflow optimization experience in Nifi, Glue jobs, and query optimization. Job Description : We are seeking an experienced Data Engineer specializing in Apache Nifi, AWS Glue, and Airflow to join our team. The ideal candidate will have a strong background in developing and optimizing workflows, with a focus on using AWS technologies and Python. This is a remote position, with the potential for contract extension. Roles and Responsibilities : Apache Nifi Workflows : Develop, configure, and optimize workflows using Apache Nifi, focusing on AWS-related connectors. Apache Airflow DAGs : Write, configure, and manage Airflow DAGs/jobs using Python, including scheduling, monitoring, and alerting for various tasks. AWS Step Functions & Glue : Implement and optimize workflows using AWS Step Functions, Glue, and Athena to streamline data processing. Python Development : Write and maintain Python scripts for various data engineering tasks, ensuring code quality and performance. Data Processing Optimization : Optimize Nifi workflows, Glue jobs, and database queries to enhance performance and reduce costs. Spark and PowerBI (Optional) : Work with Apache Spark for large-scale data processing (preferred) and PowerBI for data visualization (a plus). Collaboration : Work closely with other engineers, data scientists, and stakeholders to ensure smooth project execution. Required Skills : Must-Have : - 4 years of experience with Apache Nifi, including AWS-related connectors. - 3 years of experience with Apache Airflow, including writing DAGs/jobs in Python. - Experience with AWS Step Functions, Glue, and Athena. - Strong Python programming skills. Good to Have : - Experience with Apache Spark. - Experience with PowerBI. Optimization Expertise : Demonstrated ability to optimize workflows and queries for performance and efficiency. Work Environment : Location : Remote Contract Duration : 6 months with the possibility of extension. (ref:hirist.tech)

Location: noida, IN

Posted Date: 5/1/2025