Remote Senior Software Data Engineer

Summary

The Senior Data Engineer is responsible for participating in agile ceremonies, writing complex queries, designing ETL frameworks, developing ETL pipelines, creating data export frameworks, optimizing database schema, performing query analysis, maintaining compliance, adhering to confidentiality and HIPAA requirements, and fulfilling other responsibilities as needed. The position requires a minimum of 7 years healthcare industry experience, strong knowledge of healthcare data, 5+ years working on data warehouses, ETL processes/pipelines, MS SQL, T-SQL, Microsoft tools, 2+ years experience in writing query plans, indexes, working with Analytics teams, Azure Cloud, and more. Education required is a BS degree in Computer Science or equivalent experience.

Requirements

• Minimum of 7 years healthcare industry experience with strong knowledge of healthcare data (837i/837p will be a plus)
• 5+ years working on datawarehouse, ETL process/pipeline, Workflow
• 5+ experience in MS SQL, T-SQL, ETL Jobs
• 5+ experience in Microsoft tools like SSMS, SSIS, SQL Server
• 2+ years experience in writing query plans, indexes etc
• 2+ years working with Analytics team (like Tabluea, PowerBI – Preferred)
• 2+ years’ experience working on Azure Cloud is preferred utilizing ADF (Azure Data Factory), Azure Delta Lake, Azure SQL Server, Data Sync, Log Insights and Analytics
• Experience working with Role based security at database, ETL jobs, data exports level
• Strong understanding of database concepts and schema (like star, snowflake schema)
• Experience with HIPPA and PHI will be a plus
• Ability to effectively communicate with internal and external customers
• Excellent verbal and written communication skills
• Excellent computer proficiency (MS Office – Word, Excel and Outlook)
• Must be able to work under pressure and meet deadlines
• Ability to work independently and to carry out tasks to completion following standard accepted practices

Responsibilities

• Participate in agile ceremonies like grooming, planning, standup, retrospective, demos
• Write complex queries, stored procedures, functions, SSIS Packages for various job execution
• Work with data architects and business analysts to create a logical data model and create DDL scripts for physical model creation
• Design and develop modern ETL framework utilizing tools like ADF (Azure Data Factory), MS-SSIS etc
• Design and develop ETL pipelines, using SQL, Stored procedures/functions to extract data from various sources and load into warehouse
• Design STAR or SNOWFLAKE database schema utilizing industry best practices to build datawarehouse and data marts, views, cubes and data sets/products
• Design and develop data export frameworks to extract data from the warehouse, transform, pre-aggregate, perform calculations and load into various data marts for Analytics use
• Develop data export framework to extract data from datawarehouse and data marts to generate reports for internal and external customers in .csv, flat files and
• Work on large data to ensure configurable ingestion of data, dynamic rule & validation of data, cleansing, transforming and loading into the data warehouse
• Design and implement data validation and quality checks to ensure the accuracy and completeness of the data in the data warehouse
• Build data marts which will be utilized by Analytics tools like PowerBI and work with PowerBI developer to optimize database schema, queries
• Perform performance of queries and data processing, identify and resolve any issues looking at query plans, create appropriate indexes, resolve dead locks and create table hints
• Participate in design discussions, data analysis, data model creation etc

Benefits

• Health insurance
• Retirement benefits
• Paid time off
• Remote work, flexible hours
• Life and disability insurance
• Bonuses and incentives
• Professional development opportunities
• Wellness programs
• Family and parental leave