Shop Your Way is hiring a
Cloud Data/Systems Engineer in United States

Logo of Shop Your Way
Cloud Data/Systems Engineer
🏢 Shop Your Way
💵 ~$120k-$135k
📍United States
📅 Posted on Jun 10, 2024

Summary

The job is for a Cloud Data/Systems Engineer at Shop Your Way who will be responsible for architecting and modernizing enterprise data solutions on Google Cloud Platform (GCP).

Requirements

  • BS, MS or PhD in Computer Science, Engineering, Economics, Business or Mathematics
  • 3+ years experience in designing and optimizing data models on GCP cloud using GCP data stores such as BigQuery, BigTable
  • 3+ years experience analyzing, re-architecting and re-platforming on-premise data warehouses to data platforms on GCP cloud using GCP/3rd party services
  • 3+ years hands-on experience architecting and designing data lakes on GCP cloud serving analytics, BI application integrations and implementing scalable API solutions at production scale
  • Minimum 3 year of experience in performing detailed assessments of current state data platforms and creating an appropriate transition path to GCP cloud
  • Minimum 3 year of designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture using Java, Python, Scala etc
  • Hands-on experience with Spark, Cloud DataProc, Cloud Dataflow, Apache Beam, BigTable, Cloud BigQuery, Cloud PubSub, Cloud Functions, etc
  • Experience in architecting and implementing metadata management, data governance and security for data platforms on GCP
  • Experience in designing operations architecture and conducting performance engineering for large scale data lakes a production environment
  • Experience architecting and operating large production Hadoop/NoSQL clusters on premise or using Cloud services

Responsibilities

  • Work with implementation teams from concept to operations, providing deep technical subject matter expertise for successfully deploying large scale data solutions in the enterprise, using modern data/analytics technologies on premise and cloud
  • Build and implement a solution architecture, provision infrastructure, secure and reliable data-centric services and application in GCP
  • Work with data team to efficiently use Cloud infrastructure to analyze data, build models, and generate reports/visualizations
  • Integrate massive datasets from multiple data sources for data modeling
  • Design, build, implement and manage APIs and API proxies
  • Organizes and implements all API development processes internally and externally
  • Ensures that API’s are satisfactory to business requirements, including features, infrastructure and systems
  • Troubleshoots and tests all features, systems, and functionality of end products
  • Implement methods for automation of all delivery components to minimize labor in development and production
  • Formulate business problems as technical data problems while ensuring key business drivers are captured in collaboration with product management

Preferred Qualifications

  • Expert knowledge of network, internet and data storage security, software engineering best practices across the development lifecycle, agile methodologies, coding standards, source management, and building processes for testing, and operations
  • Extremely comfortable with communicating with users, other technical teams, and senior management to collect requirements and describe data modeling decisions and data engineering strategy
  • Skilled in communicating with remote teams across different time zones
  • Is accustomed to working with cross-functional teams to troubleshoot and resolve errors
  • Google Cloud Platform certification is a plus
Help us out by mentioning to Shop Your Way that you discovered this job opportunity on JobsCollider. Your support is greatly appreciated. Thank you 🙏
Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.