Senior Data Engineer

Summary

Join phData, a leading innovator in the modern data stack, partnering with major cloud platforms. We're a remote-first global company committed to helping enterprises solve complex data challenges. As a Sr. Data Engineer, you will design, develop, and implement big data solutions, lead the delivery of database systems, and drive the architecture and deployment of data pipelines. This role requires a Bachelor's degree, 5+ years of relevant experience, and proficiency in various technologies. The position offers a competitive salary, telecommuting benefits, and comprehensive insurance coverage.

Requirements

• At least a Bachelors Degree or foreign equivalent in Computer Science, Computer Engineering, Electrical and Electronics Engineering, or a closely related technical field
• At least five (5) years of post-bachelor’s, progressive experience writing shell scripts; validating data; and engaging in data wrangling
• At least three (3) years of experience debugging data; transforming data into Microsoft SQL server; developing processes to import data into HDFS using Sqoop; and using Java, UNIX Shell Scripts, and Python
• At least one (1) year of experience developing Hive scripts for data transformation on data lake projects; converting Hive scripts to Pyspark applications; automating in Hadoop; and implementing CI/CD pipelines

Responsibilities

• Design, develop, test, and implement Big Data technical solutions
• Recommend the right technologies and solutions for a given use case, from the application layer to infrastructure
• Lead the delivery of compiling and installing database systems, integrating data from a variety of data sources (data warehouse, data marts) utilizing on-prem or cloud-based data structures
• Drive solution architecture and perform deployments of data pipelines and applications
• Author DDL and DML SQL spanning technical tacks
• Develop data transformation code and highly complex provisioning pipelines
• Ingest data from relational databases
• Execute automation strategy

Benefits

• Medical, health, dental and life insurance
• PTO and paid holidays
• Position may include a telecommuting benefit from anywhere in the United States