Remote Senior Data Engineer

Summary

Join Vericast as a Senior Data Engineer - Datalake to analyze models, design, create, modify, and support complex systems that enable optimal business capabilities.

Requirements

• Bachelor’s degree or equivalent work experience
• 5+ years of experience in Data Engineering or ETL Development role
• Strong experience with PySpark, Python for building solid data pipelines
• Strong experience with Iceberg, Hive, S3, Trino
• Hands-on experience with Hadoop ecosystems, relational databases and SQL queries
• Hands-on experience with Apache Ranger, Rancher/Kubernetes preferred
• Experience with Agile Software Development methodologies
• Experience with GitLab, CI/CD process and ServiceNow etc
• Solid programming skills in object-oriented/functional scripting languages like Python, PySpark for building data pipelines with experience in testing, logging to ensure quality of code and data observability (Required)
• Experience in distributed systems and parallel data processing using big data tools such as Spark, PySpark, Hadoop, Kafka, Hive. (Required)
• Proficiency in querying with relational databases (Required)
• Strong knowledge of Linux/Unix-based computer systems (Required)
• Strong experience with Iceberg, Hive, S3, Trino (Required)
• Experience in building Data Processing pipelines using ETL tools like Talend, SSIS etc.. (Required)

Responsibilities

• Creates Application and System Design Documents and Develops Applications / Reports / Systems / Enterprise Solutions
• Estimates component/application system level and Enterprise solution work efforts
• Creates RFI/RFP requests / responses for vendor product evaluations
• Designs, Develops, and Implements Complex Business Rules
• Responsible for fulfilling end-user requests. Provides on call support as required
• Periodically provides guidance to and assists in training less experienced individuals
• Routinely operates under deadlines and may be subject to extreme workloads
• Delivers personal tasks on time and leads the delivery of tasks for natural or cross-functional workgroup
• Participates on initiatives with deliverables and meets quality standards on time
• Leads cross-functional initiatives with deliverables and meets quality standards on time

Preferred Qualifications

• Hands-on experience with Apache Ranger, Rancher/Kubernetes
• Understanding of Machine Learning models and algorithms interfacing with Data Science team
• Proficiency in data visualization tools to showcase insights using Tableau, matplotlib etc

Benefits

• Medical, dental and vision coverage
• 401K with company match
• Generous PTO allowance
• Life insurance
• Employee assistance
• Pet insurance