Remote Data Engineer

Summary

STI is seeking a long-term contract Data Engineer to join their team in Manassas, VA. The candidate should have experience with Azure Databricks, Apache Spark, Scala/Python/Java, and creating data models using various tools and languages. They must also possess excellent communication skills and be familiar with Kafka, Structured Streaming, DataFrame API, SQL, NoSQL Database, and other related technologies.

Requirements

• Experience working in Azure Databricks, Apache Spark
• Proficient programming in Scala/Python/Java
• Creating data models and implementing business logic using tools and languages listed
• Working knowledge in Kafka, Structured Streaming, DataFrame API, SQL, NoSQL Database
• Comfortable with API, Azure Datalake, Git, Notebooks, Spark Cluster, Spark Jobs, Performance tuning
• Excellent communication skills

Responsibilities

Developing and deploying data pipelines for streaming and batch data sources

Preferred Qualifications

• Familiarity with Power BI, Delta Lake, Lambda Architecture, Azure Data Factory, Azure Synapse
• Telecom domain experience not necessary but really helpful