Kitrum is hiring a
Middle Big Data Engineer in Brazil

Logo of Kitrum
Middle Big Data Engineer
🏢 Kitrum
💵 ~$46k-$81k
📍Brazil
📅 Posted on Jun 27, 2024

Summary

KITRUM is seeking a Middle Big Data Engineer for an American project on an online reading platform with over 1.5 million users. The candidate should have at least 3 years of experience in data engineering, proficiency in Spark, expertise in Scala and/or Python, fluency with SQL, and an upper-intermediate level of English. Additional skills like experience with Streaming platforms, Terraform, Airflow, AWS services, Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins, and DataBricks are beneficial.

Requirements

  • 3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets
  • Proficiency in Spark
  • Expertise in Scala, and/or Python
  • Fluency with at least one dialect of SQL
  • Level of English: Upper-Intermediate

Responsibilities

  • Manage data quality and integrity
  • Assist with building tools and technology to ensure that downstream customers can have faith in the data they’re consuming
  • Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines
  • Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets

Preferred Qualifications

  • Experience with Streaming platforms, typically based around Kafka
  • Experience in Terraform, Airflow
  • Strong grasp of AWS data platform services and their strengths/weaknesses
  • Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins
  • Experience using DataBricks

Benefits

  • High compensation according to your technical skills
  • Long-term projects (12m+) with great Customers
  • 5-day working week, 8-hour working day, flexible schedule
  • Democratic management style & friendly environment
  • WFH mode
  • Annual Paid vacation
  • 30 b/days + unpaid vacation
  • Paid sick leaves
  • 6 b/days per year
  • Corporate Perks (external training, English course, business speaking club, corporate events/team buildings)
  • Professional and personal growth
Help us out by mentioning to Kitrum that you discovered this job opportunity on JobsCollider. Your support is greatly appreciated. Thank you 🙏
Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.

Similar Jobs