Azure Data Lake Consultant (ID5057)

New Value Solutions, a national, is seeking a highly experienced and visionary Azure Data Lake Architect to setup, design, build, and operationalize a modern, scalable, and secure data lake architecture from the ground up. We have two projects and require 3 resources. This is a contract opportunity. Most of the work can be done remotely; however, preference will be given to resources that can come in person (Vancouver, B.C.) for a few days at the start of the project. This successful candidate is someone who has strong technical expertise in Azure Data Lakes, data engineering best practices, and governance frameworks. You will work closely with cross-functional teams including data engineering, analytics, DevOps, and business stakeholders to define and execute the enterprise data lake strategy. Key Responsibilities: Architectural Design & Strategy Define the end-to-end architecture for a modern data lake solution including ingestion, storage, processing, governance, and consumption layers. Select appropriate technologies (cloud services, storage formats, orchestration tools) and define architecture patterns that ensure scalability, resilience, and cost-efficiency. Implementation Leadership Lead the implementation of the data lake including the setup of infrastructure, pipelines, and tooling (e.g., ingestion, transformation, cataloging, access control). Design and implement ingestion pipelines for structured, semi-structured, and unstructured data from diverse sources (e.g., APIs, files, databases, event streams). Define partitioning, compaction, and data versioning strategies to support analytics and ML use cases. Data Governance & Security Collaborate with security and compliance teams to ensure data privacy, encryption, and access controls are implemented and auditable. Define and implement metadata management, lineage tracking, and data quality frameworks. Collaboration & Stakeholder Engagement Translate business data requirements into scalable architectural blueprints. Work with data analysts, data scientists, and application teams to ensure the lake meets analytical and operational needs. Provide technical leadership, mentorship, and knowledge transfer to internal data teams. Required Qualifications: Proven experience (8 years) in data engineering with at least 3 years designing and implementing large-scale data lake architectures. Expertise in Azure Data Lakes, Purview and other associated services. Familiarity with data governance tools Experience with real-time and batch processing pipelines. Background in designing lakehouse architectures or hybrid cloud data ecosystems.

Location: Canada, CA

Posted Date: 6/16/2025