Lead Data Engineer

Summary

Join Brillio's California-based team as a Senior Data Engineer and build high-performance, scalable data solutions for millions of users. You will design, develop, and test data platform components, collaborating with various teams to understand data pipeline needs and create innovative solutions. This role requires extensive experience in Scala/Java, real-time stream processing, data pipeline development, and NoSQL/SQL databases. The ideal candidate possesses strong analytical and communication skills, a collaborative work ethic, and a passion for big data. Brillio offers a remote work opportunity and competitive hourly pay.

Requirements

• BS/MS in Computer Science, Engineering, or related technical discipline or equivalent combination of training and experience
• 7+ years core Scala/Java experience: building business logic layers and high-volume/low latency/big data pipelines
• 5+ years of experience in large scale real-time stream processing using Apache Flink or Apache Spark with messaging infrastructure like Kafka/Pulsar
• 7+ years of experience on Data Pipeline development, ETL and processing of structured and unstructured data
• 5+ years of experience using NoSQL systems like MongoDB, DynamoDB and Relational SQL Database systems (PostgreSQL) and Athena
• Experience with technologies like Lambda, API Gateway, AWS Fargate, ECS, CloudWatch, S3, DataDog
• Experience owning and implementing technical/data solutions or pipelines
• Excellent written and verbal communication skills in English
• Strong work ethic and entrepreneurial spirit

Responsibilities

• Build high performance, scalable data solutions that meet the needs of millions of agents, brokers, home buyers, and sellers
• Design, develop, and test robust, scalable data platform components
• Work with a variety of teams and individuals, including product engineers to understand their data pipeline needs and come up with innovative solutions
• Work with a team of talented engineers and collaborate with product managers and designers to help define new data products and features

Benefits

• Remote (for California based team)
• $70 - $75 an hour