WeatherBug is hiring a
Principal Software Engineer (Data) in India

Summary

The Principal Software Engineer (Data) position at WeatherBug, owned by GroundTruth, involves creating and reviewing system designs and architectures, setting documentation standards, developing analytic pipelines, performing data pre-processing, building key business metrics, providing operational support, and leading efforts across business units. The candidate must have a 4-year degree in Computer Science or related field, 11+ years of software engineering experience, 9+ years of Data Engineering or Data Science experience, 7+ years of Python, SQL, Bash Scripting, AWS Technologies, Looker, and data formats experience. Preferred qualifications include experience in the weather industry, advertising industry, CICD tools, AWS Products, Data Pipeline technologies, other languages, frameworks, and platforms, and various file formats.

Requirements

• 4 year degree in Computer Science or related field
• 11+ years of experience in software engineering
• 9+ years of experience in Data Engineering or Data Science
• 7+ years of experience with Python, SQL, Bash Scripting
• 7+ years of experience in Data Technologies. (ETL, Data Sanitization, Airflow)
• 7+ years of experience in AWS Technologies (S3, Redshift, Glue, DynamoDB, Athena)
• 5+ years of experience in Looker
• 7+ Years of experience working with data formats (JSON, Parquet, CSV, GZIP, files)

Responsibilities

• Create and review system level designs and architectures to ensure consistency and quality
• Design, Develop, and Deploy entire Analytic pipelines to surface metrics
• Perform data pre-processing to clean, eliminate outliers in data and conduct data exploration to detect correlation, trends, and patterns in data
• Translate numerical data into engaging stories using visualization techniques
• Build key business metrics, visualizations, dashboards and reports with Google Looker
• Code solutions for current problems, prototype solutions for upcoming products, and actively look to fix potential issues across the code base before they become a fire
• Provide operational support for any deployments that are in need
• Proactively prevent issues from arising
• Lead efforts across business units, promote what your teams needs, be available for those who need help

Preferred Qualifications

• Experience in building end to end solutions in the weather industry
• Experience in performant, available, cost effective solutions in the advertising industry
• Experience with CICD tools, specifically GitHub, Jenkins, Splunk
• Experience with AWS Products, specifically CloudFormation, Batch, Glue, MWAA, RedShift, Lambda, Step Functions, Sagemaker, Tagging
• Experience with Data Pipeline technologies like Jupyter Notebooks, Google BigQuery
• Experience working with formats like TXT, CSV, MARKDOWN, JSON, YAML, GeoJSON, GZIP, PARQ, PROTOBUF
• Experience with other languages, frameworks, and platforms, specifically Infrastructure as Code, Python, Shell, C#, .NET, NodeJS