Remote Data Engineer

Summary

Join our team as a Data Engineer and work on designing and implementing core data analytic platform components, maintaining and designing common data flow pipelines, and supporting and troubleshooting data flow activities on cloud data warehouse environments.

Requirements

• Bachelor’s degree in computer Science or related field
• 5-7 years’ experience in the following: Snowflake, Databricks management
• Python and AWS Lambda
• Scala and/or Java
• Data integration service, SQL and Extract Transform Load (ELT)
• Azure or AWS for development and deployment
• Jira or similar tool during SDLC
• Experience managing codebase using Code repository in Git/GitHub or Bitbucket
• Experience working with a data warehouse
• Familiarity with structured and semi-structured data formats including JSON, Avro, ORC, Parquet, or XML
• Exposure to working in an agile work environment

Responsibilities

• Design and implement core data analytic platform components that would be shared extended to different analytics group
• Review approaches and completed data pipelines against platform best practices and patterns
• Maintain and design a common data flow pipeline data transformation activities such as Extract Transform Load (ETL)
• Support and troubleshoot the data flow activities on cloud data warehouse environments
• Develop data pipeline code using Python, Java, AWS Lambda and/or Azure Data Factory
• Perform requirements planning, monitoring, and end-to-end requirements management throughout the data asset development life-cycle
• Direct and help other developers and analyst to ensure data platform patterns are adhered. Designing, building, and documenting RESTful API using OpenAPI specification tools such as Swagger