Senior Data Engineer

Summary

Join Zingtree, a next-gen intelligent process automation platform, as a Senior Data Engineer. You will design, build, and maintain scalable data processing systems and analytics platforms, leading the creation of robust, in-house data infrastructure solutions. This role involves data architecture and system design, pipeline development, technology implementation, cross-team collaboration, performance optimization, data modeling, and documentation. You will also provide technical leadership and mentor junior engineers. Zingtree offers a competitive compensation package, equity stock options, and comprehensive benefits.

Requirements

• Experience: 5+ years in data engineering, with expertise in large-scale systems and data infrastructure design
• Technical Skills: Strong background in database technologies and SQL optimization; experience designing data warehousing solutions; proficiency in building and optimizing data pipelines; knowledge of distributed computing platforms (Spark, Flink, or similar); experience with columnar databases and OLAP systems (like Apache Druid)
• Infrastructure Knowledge: Experience with cloud infrastructure, particularly AWS; understanding of container orchestration with Kubernetes; familiarity with infrastructure-as-code practices
• Analytical Mindset: Strong problem-solving abilities; experience troubleshooting complex data systems; capacity to evaluate and recommend appropriate technologies for specific use cases
• Communication Skills: Ability to explain complex technical concepts to various stakeholders; experience collaborating with cross-functional engineering teams
• Leadership Qualities: Self-motivated with a drive to continuously learn and improve; proactive approach to identifying and addressing technical challenges; experience mentoring junior engineers on data best practices
• Organizational Abilities: Skills to manage multiple projects and priorities; adaptability to evolving technical requirements and business needs

Responsibilities

• Data Architecture & System Design: Design and implement efficient data storage and processing solutions for large-scale datasets; architect a new data processing framework to replace existing third-party solutions
• Pipeline Development: Develop and optimize data pipelines for event data ingestion and processing; implement real-time analytics capabilities for clickstream data
• Technology Implementation: Evaluate and integrate open-source technologies like Apache Druid, Spark, or similar tools based on project requirements and performance needs
• Cross-Team Collaboration: Work closely with backend engineering teams using Go in a Kubernetes environment; participate in architectural decisions for scalable data systems
• Performance Optimization: Optimize query performance and data access patterns for analytics platforms; ensure systems scale efficiently with growing data volumes
• Data Modeling: Design and implement data models that support business intelligence needs and facilitate efficient reporting capabilities
• Documentation & Best Practices: Create comprehensive documentation and establish best practices for data engineering across the organization
• Technical Leadership: Provide architectural direction for data systems and mentor junior engineers on data engineering best practices

Preferred Qualifications

Specialized Expertise: Experience with stream processing and real-time analytics frameworks; knowledge of Go programming a plus; background with event data processing and analytics; familiarity with Kafka or similar message queuing systems

Benefits

• Competitive Compensation - We offer fair compensation packages
• Equity stock options
• Comprehensive health insurance for employees and dependents
• Provident Fund contributions in compliance with EPF guidelines
• Generous Paid Parental Leave - Paid time off for parents to spend time with their new child
• Unlimited PTO - Take the time you need to recharge and bring your best self to work
• Flexible Remote Work - Work from anywhere
• Home Office Stipend - Receive up to $500 to create a great work environment at home, and $100 a month for Internet, phone, etc
• Co-working Reimbursement - Expense up to $200 a month on co-working space