Senior Data Engineer

Summary

Join Blue Coding, a leading next-gen software developer, as a Senior Data Engineer and work remotely from anywhere in the world. You will be part of a global team working with cutting-edge companies in the US and Canada. In this role, you will leverage data from various sources to help stakeholders create products and answer business questions. You will work with business stakeholders to understand their goals and challenges, build solutions to standardize data approaches, incorporate observability and testing best practices, and develop processes to ensure data is trusted and well-documented. You will also refine the data model for reporting and analytical purposes, improve data availability and consistency, and stand up a reporting system in BigQuery from scratch. You will be responsible for revamping orchestration and execution to reduce critical data delivery times and archiving data from live databases to cold storage.

Requirements

• Strong hands-on experience with Python and core Python Data Processing tools such as pandas, numpy, scipy, scikit
• Experience with cloud tools and environments like Docker, Kubernetes, GCP, and/or Azure
• Experience with Spark/PySpark
• Experience with Data Lineage and Data Cataloging
• Relational and non-relational database experience
• Experience with Data Warehouses and Lakes, such as Bigquery, Databricks, or Snowflake
• Experience in designing and building data pipelines that scale
• Strong communication skills, with the ability to convey technical solutions to both technical and non-technical stakeholders
• Experience working effectively in a fast-paced, agile environment as part of a collaborative team
• Ability to work independently and as part of a team
• Willingness and enthusiasm to learn new technologies and tackle challenging problems
• Experience in Infrastructure as Code tools like Terraform
• Advanced SQL expertise, including experience with complex queries, query optimization, and working with various database systems

Responsibilities

• Work with business stakeholders to understand their goals, challenges, and decisions
• Assist with building solutions that standardize their data approach to common problems across the company
• Incorporate observability and testing best practices into projects
• Assist in the development of processes to ensure their data is trusted and well-documented
• Effectively work with data analysts on refining the data model used for reporting and analytical purposes
• Improve the availability and consistency of data points crucial for analysis
• Standing up a reporting system in BigQuery from scratch, including data replication, infrastructure setup, dbt model creation, and Integration with reporting endpoints
• Revamping orchestration and execution to reduce critical data delivery times
• Database archiving to move data from a live database to cold storage

Preferred Qualifications

• Experience building across clouds
• Experience with BI systems like Thoughtspot, Looker, Metabase, or PowerBI
• Knowledge of different data modeling paradigms, e.g., relational, data vault, and medallion

Benefits

• Salary in USD
• Long-term
• Flexible schedule (within US Time zones)
• 100% Remote