Python Developer

NTD Software
Summary
Join our team as a highly skilled GCP Python Developer with 4+ years of experience in Python programming and data engineering. You will leverage your expertise in big data technologies (Spark, PySpark, Hadoop, HIVE, BigQuery, and Pub/Sub) to build scalable ETL pipelines. A deep understanding of production-level coding techniques, including testing, OOP, and code optimization is crucial. This role demands strong SQL skills, data modeling, and query optimization capabilities. You will also be responsible for data visualization and dashboarding, troubleshooting complex issues, and collaborating with cross-functional teams. The ideal candidate is passionate about cloud-native solutions and continuously seeks innovative approaches to optimize data engineering processes.
Requirements
- Proficiency in Python programming, with a strong emphasis on data engineering
- Extensive experience with big data technologies: Spark, PySpark, Hadoop, HIVE, BigQuery, and Pub/Sub
- Expertise in SQL, data modeling, and query optimization for large-scale data processing
- Experience in data visualization and dashboarding tools
- Strong debugging and problem-solving skills to resolve complex technical issues
- Ability to work independently, learn new technologies, and prototype innovative solutions
Responsibilities
- Utilize advanced data engineering skills, including expert-level SQL, data modeling, and query optimization, to build efficient ETL pipelines
- Focus on cloud-native solutions with hands-on experience, preferably in Google Cloud Platform (GCP) or Azure environments
- Leverage data visualization and dashboarding techniques to effectively communicate complex data insights to stakeholders
- Debug, troubleshoot, and implement solutions for complex technical problems, ensuring high performance and scalability
- Continuously learn new technologies, prototype solutions, and propose innovative approaches to optimize data engineering processes
- Collaborate with cross-functional teams to integrate data solutions across platforms and services
Preferred Qualifications
Hands-on experience in Google Cloud Platform (GCP) or Azure environments