Atlan is hiring a
Senior Software Engineer

Summary

The job description is for a Senior Software Engineer position at Atlan, focusing on building distributed systems in Java with expertise in Cassandra & Elastic Search. The role involves optimizing metadata consumption, storage, and consistency, managing background tasks, designing and implementing ingestion systems, contributing to ongoing projects, providing mentorship, becoming a Subject Matter Expert, and demonstrating design and implementation skills, backend services development, problem-solving abilities, communication, and a collaborative mindset.

Requirements

Experience building data platforms focusing on ingestion, storage & consumption for both batch & streaming data

Responsibilities

• Metadata Consumption Optimization: Spearhead efforts to reduce search and graph lookup times to sub-second latency, enhancing the overall performance of our platform
• Storage & Consistency Enhancement: Optimize storage mechanisms and consistency protocols for handling large datasets efficiently and reliably
• Background Tasks Management: Develop robust solutions for managing resource-intensive background tasks, ensuring smooth operation of our systems under heavy workloads
• Metadata Ingestion Systems: Lead the design and implementation of systems capable of ingesting millions of data assets per hour, supporting the seamless integration of diverse datasets into our platform
• Technical Mastery: Rapid familiarity with our codebase and technical stack, coupled with active contributions to ongoing projects
• Leadership: Assume a leadership role on a core project, providing mentorship to junior engineers and driving innovative solutions

Preferred Qualifications

Familiarity with optimizing Elastic Search instances for search query & latency and event consumption, Kafka cluster management is a big plus