Data Engineer

Summary

Join BPM LLP, a top 40 public accounting and advisory firm, as a Data Engineer and help drive our data-driven culture. You will build, maintain, and optimize our data infrastructure in an Azure environment, focusing on scalable and secure data pipelines. This role involves collaborating with cross-functional teams, implementing data governance and security measures, and staying current with the latest technologies. You will leverage your expertise in Databricks, data modeling, and programming languages like Python and SQL. BPM offers a comprehensive total rewards package, including flexible work arrangements, well-being resources, and professional development opportunities.

Requirements

• Undergraduate degree in data or computer science, IT, statistics, or mathematics preferred
• Minimum of 2 years of experience as a Data Engineer in a Databricks environment
• Specific expertise in Databricks Delta Lake, notebooks, and clusters
• Data Vault Modeling experience
• Knowledge of big data technologies such as Hadoop, Spark, and Kafka
• Strong understanding of relational data structures, theories, principles, and practices
• Proficiency in Python and SQL programming languages
• Strong understanding of data modeling, algorithms, and data transformation strategies for data science consumption
• Experience with performance metric monitoring and improvement
• Experience analyzing and specifying technical and business requirements
• Ability to create consistent requirements documentation in both technical and user-friendly language
• Excellent critical thinking skills and understanding of relationships between data and business intelligence
• Strong communication skills with technical and non-technical audiences
• Ability to work remotely and collaborate with geographically distributed team

Responsibilities

• Support BPM's culture of data, representing the firm's approach to data management, stewardship, lineage, architecture, collection, storage, and utilization for delivering analytic results
• Deliver, maintain, and build trusted business relationships that contribute to BPM's data culture
• Stay current with the latest technologies and methodologies with a pragmatic mindset
• Participate in technology roadmaps and maintain data pipeline and tool documentation
• Data Pipeline Development
• Build, maintain, and govern data pipelines in an Azure environment with best of breed technology
• Develop pipelines to the data Lakehouse ensuring scalability, reliability, security, and usability for insights and decision-making
• Develop, deploy, and support high-quality, fault-tolerant data pipelines
• Build infrastructure for optimal extraction, loading, and transformation of data from various sources
• Support architecture for observing, cataloging, and governing data
• ETL / ELT
• Build and optimize ELT functionality using Python, dbt, and SQL
• Monitor and troubleshoot ELT processes to ensure accuracy and reliability
• Implement development best practices including technical design reviews, test plans, peer code reviews, and documentation
• Data Governance & Security
• Implement data governance and access controls to ensure data security and compliance
• Collaborate with security to implement encryption, authentication, and authorization mechanisms
• Monitor and audit data access to maintain data privacy and integrity
• Collaboration & Communication
• Collaborate with cross-functional stakeholders and IT to deliver meaningful outcomes
• Profile data sources and understand data relationships to support analytics

Benefits

• Total rewards package: from flexible work arrangements to personalized benefit structures and financial compensation options that give you choice and flexibility
• Well-being resources: interactive wellness platform and incentives, employee assistance program and mental health resources, and Colleague Resource Groups (CRGs)
• Balance & flexibility: 14 Firm Holidays (including 2 floating), Flex PTO, paid family leave, winter break, summer hours, and remote work options
• Professional development opportunities: a learning culture with CPA exam resources and bonuses, tuition reimbursement, a coach program, and workshops through BPM University