Data Engineer

Summary

Join MetroStar as a Data Engineer and support the configuration and ingestion of diverse data repositories into capabilities meeting mission partner needs. You will contribute to a data analytics and DevOps pipeline for rapid functionality delivery. Maintain operational aspects of data transfers, ensuring infrastructure security. Automate configuration management, leverage ETL technologies, and identify areas for optimization and cost reduction. Apply your expertise in data engineering technologies, databases, and cloud architectures. Collaborate with functional groups to develop innovative solutions and implement full feature components.

Requirements

• Requires an active Top-Secret clearance with the ability to obtain a SCI clearance
• Bachelor’s degree plus 5-7 years experience, or a Masters Degree plus 3 years of experience
• Experience with Big Data systems, including Apache Spark / Databricks
• Experience with ETL processes
• Experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0
• Applying DoD Security Technical Implementation Guides (STIGs) and automating that process
• Experience with multiple coding languages

Responsibilities

• Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities
• Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services
• Work under general guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment
• Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles
• Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy full features and components of solutions
• Maintain an existing collection of web scraping tools used as the initial step of the ETL process
• Identify and implement scalable and efficient coding solutions

Benefits

• A generous benefits package
• Professional growth
• Valuable time to recharge