Data Engineer/Data Architect
S M Software Solutions Inc.
Job highlights
Summary
Join Thales as an Expert Support Consultant for a one-month remote engagement starting immediately. This role demands a highly skilled professional with at least nine years of experience in data engineering and cloud environments. You will design, develop, and maintain data pipelines using Databricks and PySpark, implement data governance with Unity Catalog, and utilize Terraform for GCP infrastructure management. Collaboration with cross-functional teams and providing expert guidance are key aspects of this position. The ideal candidate possesses strong expertise in Databricks, Unity Catalog, Terraform, PySpark, and GCP, along with proven experience in designing scalable data solutions and excellent problem-solving and communication skills.
Requirements
- Minimum of 9 years of experience in data engineering, data architecture, or a related field
- Strong expertise in Databricks, Unity Catalog, Terraform, PySpark, and GCP
- Proven track record of designing and implementing scalable data solutions
- Excellent problem-solving skills and the ability to work independently
- Strong communication and collaboration skills
Responsibilities
- Design, develop, and maintain data pipelines using Databricks and PySpark
- Implement and manage data governance using Unity Catalog
- Utilize Terraform for infrastructure as code to manage and provision cloud resources on Google Cloud Platform (GCP)
- Collaborate with cross-functional teams to ensure seamless integration and deployment of data solutions
- Provide expert guidance and support to the client on best practices and optimization of data workflows