Remote Big Data Engineer - Azure Databricks
Nagarro
πRemote - Hungary
Please let Nagarro know you found this job on JobsCollider. Thanks! π
Job highlights
Summary
Join our dynamic team at Nagarro as a Data Engineer, collaborating with cross-functional teams to deliver high-quality data solutions. In this role, you will lead technical planning for data migration, design scalable data pipelines, and ensure data quality and integrity.
Requirements
- Min. 4 years of IT experience
- Min. of 4 years working with Azure Databricks
- Proficiency in Data Modeling and Source System Analysis
- Strong knowledge of PySpark and SQL
- Experience with Azure components: Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL
- Experience with Python for data engineering purposes
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of data flows
- Familiarity with data visualization/exploration tools
Responsibilities
- Lead the technical planning for data migration, including data ingestion, transformation, storage, and access control within Azure Data Factory and Azure Data Lake
- Design and implement scalable, efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks
- Develop reusable frameworks for the ingestion of large datasets
- Ensure data quality and integrity by implementing robust validation and cleansing mechanisms throughout the data pipeline
- Work with event-based/streaming technologies to ingest and process data in real-time
- Provide technical support to the team, resolving challenges during the migration and post-migration phases
- Stay current with the latest advancements in cloud computing, data engineering, and analytics technologies; recommend best practices and industry standards for data lake solutions
Share this job:
Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.
Similar Remote Jobs
- π°$208k-$357kπUnited States
- πIndia
- πRomania
- πWorldwide
- π°$135k-$178kπWorldwide
- πPortugal
- πAustralia
- πWorldwide
- πArgentina
Please let Nagarro know you found this job on JobsCollider. Thanks! π