Senior Data Engineer

Summary

Join Cyclotron as a Senior Azure Data Engineer and lead the development of high-value data solutions using Microsoft Fabric, Azure Intelligent Data Stack, and Databricks. You will design architecture, define requirements, and manage project delivery teams. This fully remote position (US/Canada) requires extensive experience in Azure data engineering, Databricks, and data lifecycle management. You will collaborate with sales, service delivery, and project management teams. The ideal candidate possesses strong technical and leadership skills, along with a client-focused approach. This role offers the opportunity to work with cutting-edge cloud solutions and contribute to a diverse and inclusive team.

Requirements

• Focus on Azure data engineering solutions
• 8+ years data engineering delivery experience
• 3+ years of Databricks engineering development experience
• Microsoft Fabric development experience
• 2+ years technical team leadership or technical management experience
• 2+ years Microsoft Purview experience
• Current Azure and/or Databricks certifications
• Design, develop and maintain data pipelines using Databricks, Fabric, and Azure Data tools
• Experience solutioning Azure Cloud based enterprise data architectures
• Experience with data engineering pipeline automation
• Data Modeling principles for relational and dimensional data structures
• Data Warehouse design principles
• Data Lake design principles, Data Virtualization
• Hybrid enterprise data architecture
• Strong knowledge of data lakehouse and medallion architecture concepts and T-SQL relational/non-relational databases for data access and Advanced Analytics
• Experience with following languages: Python, SQL, DAX, M, Spark
• Experience with reporting and data visualization tools, specifically PowerBI
• Practical knowledge of Microsoft SQL Server, Azure SQL Server, Microsoft Fabric
• Experience in Synapse Analytics, CI/CD
• Microsoft Azure Stack
• RDBMS: Azure SQL / SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning)
• ETL/ELT, (ADF, SSIS)
• Data governance – (Purview, Unity Catalogue)
• Microsoft Fabric, Synapse Analytics, Spark Engine Optimization
• Databricks Delta Lake Storage
• Azure Dev OPS

Responsibilities

• Lead the creation of high-value data driven solutions leveraging Cyclotron’s proven implementation methodology and solutions for enterprise projects
• Contribute to technical pre-sales activities as required
• Design solution architecture
• Define requirements
• Lead the project delivery team
• Contribute to all stages of the data lifecycle including data ingestion, data modeling, data profiling, data quality, data transformation, data movement, and data curation
• Design and implement Advanced Analytics solutions based on customer needs and knowledge of Microsoft Cloud and related Open-Source (Apache) technologies
• Triage and self-direct, prioritize and manage time effectively
• Collaborate with other members of the Cyclotron team, including Project Managers, Software Engineers, and Business Analysts
• Provide thought leadership and business strategy acumen around advanced analytics and business information lifecycle
• Lead customers through a value-based decision-making cycle
• Develop functional, non-functional and technical requirements based on business imperatives
• Present to customer executive teams with authority and purpose
• Direct business analysts and developers in the execution of project tasks
• Lead consultants in various project work streams
• Estimate, plan and execute advanced analytics solutions
• Manage geographically distributed project teams

Preferred Qualifications

• Advanced Analytics Data Technologies
• Databricks, Delta Lake, Synapse
• Spark SQL, Pyspark
• Azure Data Explorer
• Logic Apps, Key Vault
• Semi structured data processing
• Integration Runtime
• Coding experience: Python, C#, Java for Data analysis purpose
• One of the following certifications: Microsoft Certified - Data Analyst Associate, MCSA - BI Reporting
• Knowledge of some of the main components of Azure Analytics: Azure Data Processing Technologies (DataFactory, Databricks), Azure Big Data Technologies, Databricks, Synapse
• Data Stewardship, Ownership and Quality Management principles
• Data Governance, Data Catalog, Enterprise Information Management

Benefits

Fully remote (US/Canada)