Remote Big Data Engineer

Summary

Basis Technologies is hiring a Big Data Engineer to join their data engineering organization. The role involves designing, implementing, and maintaining deployment and ETL pipelines for data products, integrating diverse data sources, automating repetitive tasks, and developing scalable data pipelines for large volumes of data.

Requirements

• Strong computer science fundamentals
• Strong programming skills in Python or Java
• Proficiency with SQL and relational databases
• Proficiency with Snowflake and their services (development, performance tuning)
• Proficiency with workflow orchestration engines (Apache Airflow, Argo Workflows)
• Proficiency with CI/CD engines (Harness, Circle CI, Argo CI/CD, Jenkins)
• Proficiency with build management tools (Bazel)
• Proficiency with at least one of database versioning tool (Flyway, Sqitch or similar)
• Proficiency with source control systems (Git)
• Experience with containerization and orchestration tools (Docker, Kubernetes)
• Experience developing for BI tools (Looker, Thoughtspot, Power BI)
• Ability to work independently and manage multiple tasks

Responsibilities

• Integrate diverse data sources and vendor products, including databases, APIs, and third-party services to make data available for analytical and operational use
• Automate repetitive and complex ETL deployment tasks to improve team efficiency and reduce manual intervention
• Develop, deploy, and maintain scalable data pipelines for large volumes of data
• Implement monitoring solutions to track data pipeline performance and quickly identify and resolve issues

Benefits

• Competitive 401k/RRSP matching
• Mental health support
• Funded health savings account
• Paid sabbatical
• Generous parental leave
• Flexible work environment and time off policy