Consultant

Summary

Join Brillio, a fast-growing digital technology services provider, as a Data Architect in Dallas, TX (remote). This contract role requires experience in data architecture patterns, including building frameworks for data migration, ingestion, and storage using Databricks, AWS, and other technologies. You will develop ETL pipelines using PySpark and/or Spark SQL, ingest data from various sources, and demonstrate a strong understanding of Databricks and Apache Airflow. A conceptual understanding of logical data modeling is also necessary. The hourly rate is $85-$90.

Requirements

• Be experienced in Data architecture patterns including building frameworks for data migration, data ingestion and storage using Databricks, AWS and other technologies available within client EDS landscape
• Be experienced with ETL pipeline development using PySpark and/or Spark SQL
• Be experienced with ingesting various types of data sources (REST API, JDBC/ODBC source) into analytical platforms
• Have a strong understanding of Databricks and Apache Airflow
• Have a conceptual understanding of logical data modeling and/or database modeling

Responsibilities

• Be experienced in Data architecture patterns including building frameworks for data migration, data ingestion and storage using Databricks, AWS and other technologies available within client EDS landscape
• Be experienced with ETL pipeline development using PySpark and/or Spark SQL
• Be experienced with ingesting various types of data sources (REST API, JDBC/ODBC source) into analytical platforms
• Have a strong understanding of Databricks and Apache Airflow
• Have a conceptual understanding of logical data modeling and/or database modeling