Data Analyst, Engineer

Summary

Join our team as a Senior Level Data Engineer/Data Analyst technical lead! This key role requires a proactive individual with excellent communication skills and experience in data analytics, Databricks, Pyspark, and Python. The contract position (3-6 months initially) is remote and based in the UK. You will be responsible for designing and implementing scalable data solutions on AWS, migrating data to the cloud using GenAI, and developing data models. Experience with large language models (LLMs) and data cleaning/transformation is essential. This role demands a high level of autonomy and proficiency in Python and SQL.

Requirements

• 10+ years of experience as Data Analyst/Data Engineer/Data Scientist with Databricks on AWS expertise in designing and implementing scalable, secure, and cost-efficient data solutions on AWS
• Minimum of 10 years of experience as a Data Analyst, Data Engineer, or related role, ideally with a bachelor's degree or higher in a relevant field
• Strong proficiency in Python (Pandas, Scikit-learn, Matplotlib) and SQL, with experience working across various data formats and sources
• Proven ability to automate data workflows, implement code-based best practices, and maintain documentation to ensure reproducibility and scalability

Responsibilities

• Hands-on data analytics experience with Databricks on AWS, Pyspark and Python
• Migrate a data asset to the cloud using a GenAI automation option
• Migrate data from on-premises to AWS
• Develop data models, deliver data-driven insights for business solutions
• Experience in pretraining, fine-tuning, augmenting and optimizing large language models (LLMs)
• Design and implement database solutions
• Develop PySpark applications to extract, transform, and aggregate data, generating insights
• Identify, gather, and consolidate data from diverse sources, including internal databases and spreadsheets ensuring data integrity and relevance
• Apply thorough data quality checks, cleaning processes, and transformations using Python (Pandas) and SQL to prepare datasets
• Develop and maintain scripts that automate repetitive data preparation tasks
• Operate with minimal supervision, demonstrating initiative in problem-solving, prioritizing tasks, and continuously improving the quality and impact of your work
• Manage in tight circumstances, be very proactive with risk & issue management
• Interact directly with colleagues to clarify objectives, challenge assumptions
• Maintain clear, concise documentation of data workflows, coding standards, and analytical methodologies to support knowledge transfer and scalability
• Work closely with colleagues who provide data, raising questions about data validity, sharing insights, and co-creating solutions that address evolving needs
• Excellent communication skills for engaging with colleagues, clarifying requirements, and conveying analytical results in a meaningful, non-technical manner