Software Engineer - Spark

Summary

Join NICE, a global leader in innovative software solutions, as a Data Engineer. You will design, build, and maintain large-scale data systems using Apache Spark, optimizing data workflows and integrating data from various sources. Collaborate with cross-functional teams to deliver data solutions, ensuring data quality and security. Leverage your expertise in big data technologies, ETL frameworks, and cloud platforms like AWS. This role requires 4-7 years of experience in data engineering with a strong focus on Apache Spark. NICE offers a hybrid work model (NICE-FLEX) with opportunities for professional growth and development within a dynamic and collaborative environment.

Requirements

• 4-7 years of experience as a Data Engineer, with a strong focus on Apache Spark and big data technologies
• Expertise in Spark SQL, DataFrames, and RDDs for data processing and analysis
• Proficient in programming languages such as Python, Scala, or Java for data engineering tasks
• Hands-on experience with cloud platforms like AWS, specifically with data processing and storage services (e.g., S3, BigQuery, Redshift, Databricks)
• Experience with ETL frameworks and tools such as Apache Kafka, Airflow, or NiFi
• Strong knowledge of data warehousing concepts and technologies (e.g., Redshift, Snowflake, BigQuery)
• Familiarity with containerization technologies like Docker and Kubernetes
• Knowledge of SQL and relational databases, with the ability to design and query databases effectively
• Solid understanding of distributed computing, data modeling, and data architecture principles
• Strong problem-solving skills and the ability to work with large and complex datasets
• Excellent communication and collaboration skills to work effectively with cross-functional teams

Responsibilities

• Design, implement, and maintain data pipelines using Apache Spark for processing large datasets
• Work with data engineering teams to optimize data workflows for performance and scalability
• Integrate data from various sources, ensuring clean, reliable, and high-quality data for analysis
• Develop and maintain data models, databases, and data lakes
• Build and manage scalable ETL solutions to support business intelligence and data science initiatives
• Monitor and troubleshoot data processing jobs, ensuring they run efficiently and effectively
• Collaborate with data scientists, analysts, and other stakeholders to understand business needs and deliver data solutions
• Implement data security best practices to protect sensitive information
• Maintain a high level of data quality and ensure timely delivery of data to end-users
• Continuously evaluate new technologies and frameworks to improve data engineering processes

Preferred Qualifications

• Knowledge of SQL and relational databases, with the ability to design and query databases effectively
• Solid understanding of distributed computing, data modeling, and data architecture principles
• Strong problem-solving skills and the ability to work with large and complex datasets

Benefits

• Enjoy NICE-FLEX!
• At NICE, we work according to the NICE-FLEX hybrid model, which enables maximum flexibility: 2 days working from the office and 3 days of remote work, each week