SMX is hiring a
Data Engineer Python

Summary

Join our team as a Data Engineer (Python) and contribute to designing and implementing robust data pipelines, ensuring high data quality, and collaborating with stakeholders. This is a remote position supporting a Washington, DC based team.

Requirements

• Proficiency in Python: A strong understanding of Python programming language is crucial. This includes knowledge of Python libraries and frameworks like Pandas, NumPy, and Django
• Expertise in Apache Airflow: Experience in designing, building, and maintaining data pipelines using Apache Airflow. Knowledge of Airflow's architecture, including DAGs and Operators, is important
• ETL Processes: Proficiency in ETL (Extract, Transform, Load) processes, including data extraction from various sources, data transformation (cleaning, validating, aggregating, joining, etc.), and loading data into the end target (database or data warehouse)
• Database Knowledge: Strong understanding of SQL and NoSQL databases, including writing complex queries and database optimization techniques
• Data Warehousing: Experience with data warehousing solutions like Amazon Redshift, Google BigQuery, or Microsoft Azure SQL Data Warehouse
• Strong communication and collaboration skills
• Excellent problem-solving skills

Responsibilities

• Design, develop, and maintain ETL processes using Python and Apache Airflow
• Collaborate with data analysts and other stakeholders to understand and meet their data requirements
• Develop and implement data validation processes to ensure high data quality
• Troubleshoot and resolve issues related to data pipelines
• Optimize data extraction, transformation, and loading processes to improve efficiency and performance
• Document and maintain the design and details of data processes and schemas
• Stay updated with the latest industry trends and technologies to ensure our data practices remain current

Benefits

• Health insurance
• Paid leave
• Retirement