Remote GCP Data Engineer

Summary

Join Mindcurv as a Data Engineer to design, develop, optimize, and maintain data pipelines that adhere to ETL principles and business goals. The ideal candidate will have a strong background in data architecture, ETL processes, and cloud technologies, with a focus on building scalable data solutions.

Requirements

• A highly skilled Data Engineer with extensive experience on the Google Cloud Platform (GCP)
• 3-5 years of hands-on experience in GCP based analytics projects as a Team lead (Sr role) or team member
• Proficiency in GCP analytics services: BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, Cloud Functions, and Cloud Composer
• Expertise in Python, Scala, Pyspark, Pytorch, Javascript (any 2 at least) and have extensive experience in data analysis (Apache Spark environments), data libraries (e.g. Pandas, SciPy, Tensorflow, Keras etc.), and SQL (required)
• Comfortable with one of the many BI tools such as Tableau, Power BI, Looker (not mandatory)
• Working knowledge of key concepts in data analytics, such as dimensional modeling, ETL, reporting/dashboarding, data governance, dealing with structured and unstructured data, and corresponding infrastructure needs

Responsibilities

• Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals
• Solving complex data problems to deliver insights that helps our business to achieve their goals
• Source data (structured→ unstructured) from various touchpoints (API, DB etc.), format and organize them into an analyzable format
• Creating data products for analytics team members to improve productivity
• Calling of AI services like vision, translation etc. to generate an outcome that can be used in further steps along the pipeline
• Designing and modeling skills for Data warehouses (cloud data warehouse especially)
• Fostering a culture of sharing, re-use, design and operational efficiency of data and analytical solutions
• Preparing data to create a unified database and build tracking solutions ensuring data quality
• Create Production grade analytical assets deployed using the guiding principles of CI/CD

Preferred Qualifications

• Added bonus for working in cloud Data warehouses like Big query or Snowflake
• Certification in any one of the following or equivalent: GCP- Professional Data Engineer, Snowflake- Snowpro core- Data Engineer

Benefits

• Perks, like drinks and snacks, pizza sessions, gaming nights and sensational parties
• Pension scheme
• Great salary
• Work-life balance
• Culture of transparency
• Management team with their ears to the ground
• Remote First policy, hybrid way of working in which you can work from home