Big Data Analyst

Job Summary We are looking for an experienced and detail-oriented Big Data Analyst to join our data engineering and analytics team. The ideal candidate will have hands-on experience working with large-scale datasets, developing data pipelines, and applying data analysis techniques to derive actionable insights. You will collaborate with data scientists, engineers, and business teams to transform raw data into strategic value. Key Responsibilities : Data Analysis & Insights : - Analyze complex, high-volume data sets to discover trends, patterns, and actionable insights - Perform data mining, statistical analysis, and predictive modeling to support business decisions - Work with business stakeholders to gather requirements and translate them into data solutions - Develop visualizations and dashboards for key business KPIs using modern BI tools Data Engineering & Pipeline Development : - Design, build, and maintain data ingestion pipelines for structured and unstructured data - Work with distributed data processing frameworks to handle massive data volumes - Perform ETL/ELT operations, data cleansing, and transformation using big data tools Reporting & Visualization : - Deliver interactive dashboards, reports, and visualizations using tools like Power BI, Tableau, or Looker - Automate reporting workflows and provide real-time data monitoring and alerts - Collaborate with end users to ensure reporting needs are met and solutions are scalable Performance & Data Quality : - Ensure data integrity, governance, and security across all data layers - Optimize performance of analytical queries and data pipelines - Establish data validation, error handling, and quality assurance procedures Technical Skills : Big Data Technologies : - Apache Hadoop, Hive, HBase, Pig - Apache Spark (PySpark, Spark SQL), Kafka - MapReduce, Flume, Sqoop Programming & Query Languages : - Proficiency in SQL and Python - Hands-on experience with Scala or Java is a plus Data Processing & Warehousing : - AWS (Redshift, S3, EMR), Azure (Synapse, Data Lake), GCP (BigQuery) - Experience with Snowflake, Databricks, Airflow, or NiFi BI & Visualization : - Tableau, Power BI, Qlik Sense, Looker - Strong skills in storytelling with data and dashboard design Tools & Platforms : - Git, Jupyter, Zeppelin - Data wrangling tools like Trifacta, Talend, or Alteryx Statistical & Analytical Techniques : - Regression, clustering, time series, anomaly detection - A/B testing and experimental design Soft Skills : - Strong analytical and problem-solving mindset - Excellent communication and presentation skills - Ability to collaborate with both technical and business stakeholders - Adaptable and curious to explore new tools, techniques, and technologies - Strong attention to detail and commitment to data accuracy Qualifications : - Bachelors or Masters degree in Data Science, Computer Science, Statistics, Engineering, or related field - 7-8 years of experience in a data analysis or data engineering role, preferably in a big data ecosystem - Experience working in cloud-native environments and with large-scale enterprise data systems - Certifications in Big Data, Data Analytics, or Cloud platforms (AWS/GCP/Azure) are a plus (ref:hirist.tech)

Location: pune, IN

Posted Date: 5/1/2025