Data Engineer III

Summary

Join our team as a Data Engineer and manage and operate our cloud data platform, utilizing tools such as Tableau, Databricks, and AWS services. You will be responsible for resolving pipeline issues, optimizing performance, and ensuring data security. This role requires strong problem-solving skills, excellent communication, and collaboration with customers and team members. The position offers remote work flexibility and requires a Bachelor's degree in computer science or a related field, along with 8-12 years of relevant experience. You will be responsible for handling user requests, incident management, and aligning resources for on-demand changes. The role involves working rotational shifts (IST) to support 24/7 operations.

Requirements

• Good hands on Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerB I
• Ability to read and write sql and stored procedures
• Good hands on experience in configuring, managing and troubleshooting along with general analytical and problem solving skills
• Excellent written and verbal communication skills
• Ability to communicate technical info and ideas so others will understand
• Ability to successfully work and promote inclusiveness in small groups
• Requires a Bachelor’s degree in computer science or other related field plus 8-12 years of hands-on experience in configuring and mangaing azure data analytics solution
• Schedule flexibility to include working a weekend day regularly and holidays as required by the business for 24/7 operations
• Occasional travel, less than 10%
• Responsible for adhering to company security policies and procedures and any other relevant policies and standards

Responsibilities

• Leads operational coverage
• Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects
• Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix
• Cost / Performance optimization and Audit / Security including any associated infrastructure changes
• Knowledge Management: Create/update Knopwledgebase/ runbooks as needed
• Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources
• Communication: Lead and act as a POC for customer from on-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
• Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
• Request Management: Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
• Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed

Preferred Qualifications

Experience with Azure environment is desired

Benefits

Remote work