Remote Senior Data Engineer

Summary

Lextegrity is seeking a Senior Data Engineer to join their data platform group for the Compliance Monitoring product. The candidate will build scalable batch data processing frameworks, create foundational data for machine learning models, and monitor and improve the performance of data pipelines. They should have 5+ years of experience with Python, SQL, Apache Airflow, Snowflake, AWS services, Git/GitHub, Spark (PySpark), and be proficient in SQL.

Requirements

• 5+ years of experience working heavily with Python, SQL, Apache Airflow, Snowflake, AWS services (RDS, EMR, S3), Git/GitHub, Spark (PySpark)
• Extensive experience building data processing systems & analytical data products
• Knowledge of machine learning algorithms and techniques for data analysis

Responsibilities

• Build scalable batch data processing frameworks for processing data through analytical transformations
• Create foundational data to support machine learning models & implement models in production
• Monitor and Improve the performance of data pipelines and database queries
• Monitor and debug data quality issues

Preferred Qualifications

Experience with Snowpark and Snowpipe is a plus, enhancing capabilities in building scalable data applications and automating data loading

Benefits

• Flexible working conditions and ability to work remotely
• Flexible PTO – we trust you
• Work for one of the fastest-growing companies with some of the most talented people in the industry
• A transparent and collaborative team environment
• Medical, Dental & Vision Coverage
• FSA, HSA, Life insurance, Short-Term and Long-term Disability insurance
• Stock options
• 401K Matching Program