Senior Data Engineer

Summary

Join phData, a leading innovator in the modern data stack, partnering with major cloud platforms. We're a remote-first global company committed to helping enterprises solve complex data challenges. We offer a casual, exciting work environment with opportunities for autonomy and growth. We're seeking a skilled professional with 4+ years of experience in software or data engineering/analysis. The ideal candidate will possess strong technical skills, excellent communication abilities, and a passion for data. We provide a comprehensive benefits package including remote work, medical insurance, life insurance, wellness allowance, and professional development opportunities.

Requirements

• At least 4+ years experience as a Software Engineer, Data Engineer or Data Analyst
• Programming expertise in Java, Python and/or Scala
• Experience with core cloud data platforms including Snowflake, AWS, Azure, Databricks and GCP
• SQL and the ability to write, debug, and optimize SQL queries
• Client-facing written and verbal communication skills and experience
• 4-year Bachelor's degree in Computer Science or a related field

Responsibilities

• Develop end-to-end technical solutions into production
• Ensure performance, security, scalability, and robust data integration
• Create and deliver detailed presentations
• Create detailed solution documentation (e.g. including POCS and roadmaps, sequence diagrams, class hierarchies, logical system views, etc.)

Preferred Qualifications

• Production experience in core data platforms: Snowflake, AWS, Azure, GCP, Hadoop, Databricks
• Experience with Cloud and Distributed Data Storage: S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra or other NoSQL storage systems
• Experience with Data integration technologies: Spark, Kafka, event/streaming, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica Intelligent Cloud Services (IICS), Google DataProc or other data integration technologies
• Experience with Multiple data sources (e.g. queues, relational databases, files, search, API)
• Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment
• Experience with Automated data transformation and data curation: dbt, Spark, Spark streaming, automated pipelines
• Experience with Workflow Management and Orchestration: Airflow, AWS Managed Airflow, Luigi, NiFi

Benefits

• Remote-First Workplace
• Medical Insurance for Self & Family
• Medical Insurance for Parents
• Term Life & Personal Accident
• Wellness Allowance
• Broadband Reimbursement
• Continuous learning and growth opportunities to enhance your skills and expertise
• Paid certifications
• Professional development allowance
• Bonuses for creating for company-approved content