Lead Data Engineer

Summary

Join Hitachi Digital, a leading digital transformation company, as a Lead Data Engineer. Lead the design, development, and implementation of data engineering solutions using Google BigQuery. Develop and optimize complex SQL queries and data pipelines. Implement and integrate VectorAI and Agent Workspace for Google Gemini. Collaborate with engineers to establish best practices and mentor junior developers. Provide strategic direction and leadership in data engineering and technology adoption. This role requires a Bachelor's or Master's degree, 10+ years of experience in data technologies, and 5+ years of experience migrating data workloads to BigQuery on GCP.

Requirements

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
• 10+ years of experience in data technologies
• 5+ years of extensive experience in migrating data workloads to BigQuery on GCP
• Strong programming skills in languages such as Python, Java, or SQL
• Technical proficiency in BigQuery and other related tools on GCP
• GCP Certifications in the data space
• Knowledge of cloud platforms, particularly Google Cloud Platform (GCP)
• Experience with VectorAI and Agent Workspace for Google Gemini
• Excellent problem-solving skills and the ability to work independently and as part of a team
• Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders
• Proven leadership skills and experience in guiding development projects from conception to deployment

Responsibilities

• Lead the design, development, and implementation of data engineering solutions with a focus on Google BigQuery
• Develop and optimize complex SQL queries and data pipelines in BigQuery
• Implement and integrate VectorAI and Agent Workspace for Google Gemini into data solutions
• Lead the development of high-performance data ingestion processes using modern ETL/ELT practices
• Collaborate with engineers to establish best practices for data system creation, ensuring data quality, integrity, and proper documentation
• Continuously improve reporting and analysis by automating processes and streamlining workflows
• Conduct research and stay updated on the latest advancements in data engineering and technologies
• Troubleshoot and resolve complex issues related to data systems and applications
• Document development processes, methodologies, and best practices
• Mentor junior developers and participate in code reviews, providing constructive feedback to team members
• Provide strategic direction and leadership in data engineering and technology adoption

Preferred Qualifications

• Familiarity with data engineering tools and techniques
• Previous experience in a similar role within a tech-driven company

Benefits

• Industry-leading benefits, support, and services that look after your holistic health and wellbeing
• Flexible arrangements that work for you (role and location dependent)