Senior Data Engineer

Summary

Join Blue Coding as a Senior Data Engineer and work with a global leader in government technology. Leverage diverse data sources to build solutions, standardize data approaches, and answer business questions. Collaborate with stakeholders, incorporate best practices, and develop processes for data trust and documentation. Refine data models for reporting and analysis, improve data availability, and build a reporting system in BigQuery. Revamp orchestration, manage database archiving, and work in a fast-paced, agile environment. This role requires strong Python, cloud tools, and database experience. The position offers a competitive salary in USD, long-term opportunities, a flexible schedule within US time zones, and is 100% remote.

Requirements

• Strong hands-on experience with Python and core Python Data Processing tools such as pandas, numpy, scipy, scikit
• Experience with cloud tools and environments like Docker, Kubernetes, GCP, and/or Azure
• Experience with Spark/PySpark
• Experience with Data Lineage and Data Cataloging
• Relational and non-relational database experience
• Experience with Data Warehouses and Lakes, such as Bigquery, Databricks, or Snowflake
• Experience in designing and building data pipelines that scale
• Strong communication skills, with the ability to convey technical solutions to both technical and non-technical stakeholders
• Experience working effectively in a fast-paced, agile environment as part of a collaborative team
• Ability to work independently and as part of a team
• Willingness and enthusiasm to learn new technologies and tackle challenging problems
• Experience in Infrastructure as Code tools like Terraform
• Advanced SQL expertise, including experience with complex queries, query optimization, and working with various database systems

Responsibilities

• Work with business stakeholders to understand their goals, challenges, and decisions
• Assist with building solutions that standardize their data approach to common problems across the company
• Incorporate observability and testing best practices into projects
• Assist in the development of processes to ensure their data is trusted and well-documented
• Effectively work with data analysts on refining the data model used for reporting and analytical purposes
• Improve the availability and consistency of data points crucial for analysis
• Standing up a reporting system in BigQuery from scratch, including data replication, infrastructure setup, dbt model creation, and Integration with reporting endpoints
• Revamping orchestration and execution to reduce critical data delivery times
• Database archiving to move data from a live database to cold storage

Preferred Qualifications

• Experience building across clouds
• Experience with BI systems like Thoughtspot, Looker, Metabase, or PowerBI
• Knowledge of different data modeling paradigms, e.g., relational, data vault, and medallion

Benefits

• Salary in USD
• Long-term
• Flexible schedule (within US Time zones)
• 100% Remote