SecurityScorecard is hiring a
Data Engineer (Intermediate)

Summary

Join our Data Analytics Engineering team as a Senior Data Engineer and contribute to developing and managing the core data platform for ratings infrastructure. You will work alongside outstanding engineers to implement new products and features, refine requirements with product management, and collaborate cross-team. This is an opportunity to interact with customers, ensure their needs are met, and work in a high-performance, fast-paced environment.

Requirements

• BS/MS in computer science or equivalent technical experience, and must have worked in Data engineering space for 3+ years
• Must have experience in full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Technical requirements
• Must have 2+ years experience in building and maintaining big data pipelines using Scala with Spark, Airflow, Hive, Presto, Redis
• Must have 2+ years experience with NoSQL databases, preferably Cassandra / Scylla and Clickhouse; and SQL databases, preferably Postgres
• Must have 2+ years experience in developing batch/real-time data streams
• Worked with CI/CD pipelines using Jenkins
• Experience with cloud environments, preferably AWS
• Worked with variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, parquet)
• Worked in Agile methodology

Responsibilities

• Lead and collaborate with engineers to deliver projects from inception to successful execution
• Write well-crafted, well-tested, readable, maintainable code
• Participate in code reviews to ensure code quality and distribute knowledge
• Share engineering support, release, and on-call responsibilities for an always-on 24x7 site
• Participate in Technical Design Review sessions, and have the ability to explain the various trade-offs made in decisions
• Maintain existing APIs and data pipelines, contribute to increasing code-coverage
• Understand requirements, build business logic and demonstrate ability to learn and quickly adopt
• Automate and improve existing processes to sustainably maintain the current features and pipelines
• Analyze our internal systems and processes, and locate areas for improvement/automation

Benefits

• Competitive salary
• Stock options
• Comprehensive benefits package, including health and dental insurance
• Unlimited PTO
• Parental leave
• Tuition reimbursements