Lead Data Engineer

Summary

Join Hypergiant, an Accelint company, as a Lead Data Engineer to contribute to the development of a cutting-edge, cloud-based command and control system for complex DoD projects. You will develop and improve a data service, collaborate with cross-functional teams, and ensure data quality and seamless integration. This role requires extensive experience in data engineering, proficiency in various technologies, and strong leadership skills. The ideal candidate is a US Citizen eligible for a security clearance. Hypergiant offers a competitive salary, unlimited PTO, flexible work environment, and a comprehensive benefits package.

Requirements

• 10+ years of professional software development or data engineering experience (10+ with a STEM B.S. or 8+ with a relevant Master's degree)
• Strong proficiency in Python and familiarity with Java and Bash scripting
• Hands-on experience implementing database technologies, messaging systems, and stream computing software (e.g., PostgreSQL, PostGIS, MongoDB, DuckDB, KsqlDB, RabbitMQ)
• Experience with data fabric development using publish-subscribe models (e.g., Apache NiFi, Apache Pulsar, Apache Kafka and Kafka-based data service architecture)
• Proficiency with containerization technologies (e.g., Docker, Docker-Compose, RKE2, Kubernetes, and Microk8s)
• Experience with version control systems (e.g., Git), CI/CD tools (e.g., Jenkins), and collaborative development workflows
• Strong knowledge of data modeling and database optimization techniques
• Familiarity with data serialization languages (e.g., JSON, GeoJSON, YAML, XML)
• Excellent problem-solving and analytical skills that have been applied to high visibility, important data engineering projects
• Strong communication skills and ability to lead the work of other engineers in a collaborative environment
• Demonstrated experience in coordinating team activities, setting priorities, and managing tasks to ensure balanced workloads and effective team performance
• Experience managing and mentoring development teams in an Agile environment
• Ability to make effective architecture decisions and document them clearly
• Must be a US Citizen and eligible to obtain and maintain a US Security Clearance

Responsibilities

• Develop and continuously improve a data service that underpins cloud-based applications
• Support data and database modeling efforts
• Contribute to the development and maintenance of reusable component libraries and shared codebase
• Participate in the entire software development lifecycle, including requirement gathering, design, development, testing, and deployment, using an agile, iterative process
• Collaborate with developers, designers, testers, project managers, product owners, and project sponsors to integrate the data service to end user applications
• Communicate tasking estimation and progress regularly to a development lead and product owner through appropriate tools
• Ensure seamless integration between database and messaging systems and the frontend / UI they support
• Ensure data quality, reliability, and performance through code reviews and effective testing strategies
• Write high-quality code, applying best practices, coding standards, and design patterns
• Team with other developers, fostering a culture of continuous learning and professional growth

Preferred Qualifications

• Cloud platforms (e.g., AWS, Azure, GCP) and deployment strategies experience (Ansible, Terraform, WebGL)
• Geospatial information system (GIS) experience (e.g., Geoserver)
• Data science and AI/ML applications experience
• Experience managing robust build & test tools and implementing workflow automations / scripts
• Penchant for learning new technologies, balanced with strong pragmatic thinking
• Design-minded attention to detail in data service implementation
• Leadership of a fully remote team
• Portfolio of past projects with code samples
• Ability to travel as needed
• Active Security Clearance

Benefits

• Unlimited Paid Time Off
• 14 Paid Company Holidays
• Paid Maternity/Paternity Leave
• Flexible Work Environment with Remote Options
• Medical, Dental & Vision Insurance
• Optional HSA and FSA
• Complimentary Life Insurance
• Personal & Professional Development Reimbursement
• Short Term & Long Term Disability Insurance
• 401k with Matching
• Diversity & Inclusion Workplace Initiatives
• Company contributions to medical benefits