Data Engineer

Summary

Join Two Six Technologies and leverage your data engineering skills to help decision-makers understand complex information spaces. We provide Information Advantage to government, military, and private sector clients. Our products collect and synthesize vast amounts of public data, serving it to analysts and machine learning. As a data engineer, you will collaborate with product engineering teams, data scientists, and others to design and implement data storage and retrieval solutions using the Elasticsearch stack, SQL and NoSQL databases, and AWS. You will work in a remote Agile environment, focusing on building scalable, production-ready solutions while adhering to security best practices. Most importantly, you will share our passion for applying technology to solve complex problems and derive insights from high-volume data.

Requirements

• Extensive experience with the full Elasticsearch stack, including indexing and search APIs, and Kibana, ideally with both locally hosted and Elastic hosted instances
• Experience with SQL database technologies, ideally Postgres
• Experience with AWS or similar cloud-based infrastructure
• Experience with Python
• Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
• Experience working independently and as a part of an Agile team

Responsibilities

• Developing and enhancing high volume data storage and querying solutions that enable analysis by both human experts and machine learning solutions
• Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
• Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
• Considering security best practices at every phase of software development
• Continuously learning and improving
• Working within Agile software development methodologies and being an active part of our continuous improvement efforts
• Working in a fully remote team with a diverse set of skills and experiences
• Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
• Actively participating in the peer code review process
• Working closely with application engineers, mostly working in Python, to implement scalable solutions for loading, generating, aggregating, and analyzing data
• Creating and executing both manual and automated testing

Preferred Qualifications

• Experience with optimizing the processing, storage, and querying of data in multiple languages
• Hands on experience managing the full Elastic stack, including deployment, infrastructure, security, and backup & recovery, is not required but definitely a plus
• Elastic certification
• AWS certification
• Experience with data science and advanced analytics

Benefits

• Medical, dental, and vision insurance
• Life and disability insurance
• Retirement benefits
• Paid leave
• Tuition assistance and professional development