Remote Data Platform Engineer

Summary

The job is for a Data Engineer at Onehouse, a fast-growing company specializing in data platform solutions. The role involves building and operating data pipelines, implementing new sources and connectors, optimizing Spark or Flink applications, tuning clusters, and being the thought leader around data engineering.

Requirements

• 3+ years of experience in building and operating data pipelines in Apache Spark or Apache Flink
• 2+ years of experience with workflow orchestration tools like Apache Airflow, Dagster
• Proficient in Java, Maven, Gradle and other build and packaging tools
• Adept at writing efficient SQL queries and trouble shooting query plans
• Experience managing large-scale data on cloud storage
• Great problem-solving skills, eye for details. Can debug failed jobs and queries in minutes
• Operational excellence in monitoring, deploying, and testing job workflows

Responsibilities

• Be the thought leader around all things data engineering within the company - schemas, frameworks, data models
• Implement new sources and connectors to seamlessly ingest data streams
• Building scalable job management on Kubernetes to ingest, store, manage and optimize petabytes of data on cloud storage
• Optimize Spark or Flink applications to flexibly run in batch or streaming modes based on user needs, optimize latency vs throughput
• Tune clusters for resource efficiency and reliability, to keep costs low, while still meeting SLAs

Preferred Qualifications

Hands-on experience with k8s and related toolchain in cloud environment

Benefits

• Equity Compensation
• Health & Well-being - reimbursement up to 20,000 INR for monthly insurance premium
• Financial Future - eligible for the provident fund of which Onehouse will contribute up to 1800 INR/month
• Location - remote-friendly company (internationally distributed across N. America + India)
• Generous Time Off - unlimited PTO, uncapped sick days and 17 paid company holidays
• Food & Meal Allowance - weekly lunch stipend, in-office snacks/drinks
• Equipment - equipment provided and a one-time $500 (USD) stipend for initial office/desk setup
• Child Bonding! - 26 weeks off for birthing and 12 weeks for surrogate and adoptive parents - fully paid