Remote Data Engineer II

Summary

Join Rackspace Technology on our mission to embrace technology, empower customers and deliver the future. We are seeking a Data Engineer with experience in big data technologies, relational databases, and analytics tools.

Requirements

• Demonstrate knowledge and real-world experience on Big data technologies. A successful history of manipulating, processing and extracting value from large datasets
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Strong analytic skills related to working with unstructured datasets
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
• > 3+ years of experience in a Data Engineer role
• Experience using the following software/tools: Hadoop, Spark, Kafka, etc
• Experience with relational SQL databases such as Oracle, SQL Server, MySQL or Postgres
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc
• Experience with stream-processing systems: Storm, Spark-Streaming, etc
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc

Responsibilities

• Collaborate with customer to gather requirements and to understand their business processes
• Create and maintain optimal data pipeline architecture
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Identify, design, and implement internal process improvements: automating manual processes
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, SQL and Azure or AWS data technologies
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
• Use tools to deploy and monitor the performance of the systems in production

Preferred Qualifications

Project management and organizational skills