Senior Data Engineer

Summary

Join Nearform as a Senior Data Engineer and work remotely from Italy on a permanent, full-time basis. You will design, build, and maintain scalable data platforms and pipelines. This role requires significant experience in data engineering, using technologies like SQL, Python, Spark, and cloud-based solutions. You will collaborate with data scientists, analysts, and clients. Nearform offers a comprehensive benefits package including a company bonus, flexible remote work, paid time off, remote working allowance, training and development allowance, healthcare, pension and insurance.

Requirements

• Significant experience delivering at a Senior Engineer level, specializing in Data engineering
• At least 6 years’ commercial experience
• Practical experience of delivering in an agile environment
• Practical experience and knowledge of developing real-world solutions
• Extensive hands-on experience in some of the following - Databricks, SQL, Python, and Spark for large-scale data processing
• Strong expertise in data warehousing technologies (e.g., Snowflake, Redshift, BigQuery, or similar)
• Experience with distributed data processing frameworks (Spark, Hadoop, or similar)
• Deep understanding of ETL processes, data modeling, and schema design
• Strong experience with cloud-based data solutions (AWS, Azure, GCP) and data lake architectures
• Experience with automation, CI/CD for data pipelines, and Infrastructure as Code (IaC)
• Deep understanding of versioning control tools - e.g. Git
• Experience building software collaboratively using pull requests and code reviews
• Familiarity with data governance, security, and compliance best practices
• Excellent communication and collaboration skills
• Professional proficiency in English

Responsibilities

• Design, build, and maintain scalable data platforms, pipelines, and warehouses using SQL, Python, Spark, and other relevant technologies
• Design, build, and optimize data pipelines and ETL processes for large-scale data ingestion and transformation
• Develop and maintain data platforms and warehousing solutions to support analytics and business intelligence needs
• Implement scalable data storage solutions and ensure high availability and performance
• Enhance performance in data processing workflows for maximum speed and scalability
• Collaborate with data scientists, analysts, and stakeholders to understand business needs and translate them into data engineering solutions
• Ensure data quality, governance, and compliance across all systems
• Support CI/CD processes for data pipeline deployments and implement best practices in DevOps for data workflows
• Conduct code reviews and enforce best practices in version control, automation, and testing
• Assist with defining structured source code management and deployment processes
• Work with and support Technical Leaders in project execution and timely delivery
• Collaborate with client teams

Benefits

• Annual Company Bonus
• Work Remotely and Flexibly
• Paid Time Off Package - 28 days plus public holidays, sick leave, marriage leave
• Remote Working Allowance - €1250 every 2 years
• Training and Development Allowance - €1000
• Healthcare
• Pension & Insurances - state pension + private pension with a match up to 1.55%, and Death in Service cover