Senior Data Engineer

Summary

Join Omnidian, a fast-growing tech-enabled service company, as a Senior Data Engineer and play a crucial role in shaping our data infrastructure. You will design, build, document, and maintain data pipelines for our Data Warehouse and Data Acquisition systems, ensuring quality and security. Collaborate with cross-functional teams to enhance data capabilities and contribute to a sustainable future. This role offers autonomy and impact, allowing you to make significant contributions in a well-funded, growth-stage company. The position is within the Data Management and Infosec team, reporting to the Manager of Data Engineering, with preferred locations in Pittsburgh, Seattle, Chicago, Upstate NY, or the Denver area. Omnidian prioritizes a positive work-life balance and offers remote work opportunities.

Requirements

• 4+ years experience building and optimizing data sets, ‘big data’ data pipelines, and architectures
• Experience successfully delivering large scale data engineering projects
• Proficiency with distributed systems like Spark, Kafka and data lakes
• Experience working with IoT data
• Experience with cloud platforms like AWS or Azure
• Understanding of data modeling principles
• Proficiency with object oriented programming languages such as Python or Kotlin
• Comfortable with SQL
• Proven ability to perform root cause analysis on processes and data to identify improvement opportunities
• Demonstrated experience with data transformation, workload management, and metadata

Responsibilities

• Build and maintain data warehouse pipelines via Databricks bronze, silver and gold medallion structures
• Build and maintain data acquisition pipelines which acquire IoT data from aggregator portals, land and transform the data, and make the data available to consumer services
• Use your knowledge of different programming languages to code and update data systems
• Write or contribute to technical specification documents as appropriate
• Create and maintain related data documentation as outlined in Data Governance standards
• Act as an ambassador for data governance standards when working cross functionally
• Participate in code reviews and change management processes
• Identify, align stakeholders on and implement improvements to our processes, code and/or architecture

Preferred Qualifications

• Solar Industry experience
• Experience with Databricks, including medallion architecture
• Experience with RDS
• Experience with Spring Boot
• Experience with asynchronous programming (such as kotlin coroutines)
• Experience with multithreaded programming

Benefits

• Most of our roles offer the opportunity to work remotely
• If you are in the Seattle area, we offer a vibrant office space in the historic and beautiful Smith Tower, in the heart of Pioneer Square
• We prioritize applicants near one of our employee clusters and offer one or more local gatherings per year
• We provide outstanding benefits including family medical, dental, vision, disability, 401(k) administration and $1k match per year and thoughtful paid time off
• We offer 12 weeks of paid parental leave to all FTE employees (birthing and non-birthing) after 1 year, and four-week paid sabbatical leave after four years
• We offer a competitive total compensation package that includes monthly health insurance premiums, bonuses and long-term stock options for every employee
• 100% of health insurance monthly premiums for employees, and 50% for dependents
• Performance Bonus: Because exceptional work deserves exceptional rewards. Eligibility begins after 90 days
• Equity Stake: Join us in shaping the future and be rewarded for your dedication with stock options
• Continuous Growth: Up to $500 annual learning reimbursement because investing in your development is investing in our success