Insight Global
Senior Data Engineer
Job Location
Greater Vancouver, Canada
Job Description
Insight Global is seeking a Senior Data Engineer to join a real estate tech company. The successful resource must be located in the Greater Vancouver Area. The successful candidate will be supporting the group with the following tasks Database Design and Development: Design and implement robust, scalable, and performance-optimized database solutions using SQL Server and Snowflake. Develop and maintain database procedures, schemas, tables, indexes, and views to support application requirements. SQL Server Query Optimization: Analyze and optimize SQL queries for maximum efficiency and performance. Identify and resolve performance bottlenecks in database systems through the use of query plans. Collaborate with application developers to enhance query performance and database responsiveness. Data Modeling: Work closely with data engineering to design and implement data models that align with business requirements. Ensure data integrity and consistency across the database environment. ETL Processes: Design, implement, and maintain ETL processes for efficient data extraction, transformation, and loading. Collaborate with cross-functional teams to integrate data from various sources into the SQL Server database. Monitoring and Maintenance: Implement effective monitoring solutions to proactively identify and address potential issues. Perform routine maintenance tasks such as backups, restores, data purges, and index de-fragmentation. Experience with Unix and Powershell scripting technologies (running back scripts, basic) > SSIS for defining ETL pipelines so has call command lines and will call from powershel, backfile, move datafile into S3, scripting simple stuff, not advanced Collaboration and Documentation: Collaborate with cross-functional teams, including data scientists, product analysts, and application developers, to understand data requirements. Participate in architectural discussions and technical decision-making processes. Effectively communicate technical concepts to non-technical stakeholders. Document database design, configurations, and procedures. Must Haves: Strong experience with Snowflake, Aurora, Postgres, Glue (Spark) or EMR or Spark and Kinesis (streaming) Strong experience working with QL Server, AWS Glue, Snowflake, Lambda, python Experience with cloud technologies such as S3 [AWS], EC2, Linux Strong SQL query experience including having the ability to write high performing queries Plusses: JavaScript SSIS
Location: Greater Vancouver, CA
Posted Date: 5/7/2025
Location: Greater Vancouver, CA
Posted Date: 5/7/2025
Contact Information
Contact | Human Resources Insight Global |
---|