Social Media Data Crawler

Summary

Join our dynamic team as a Social Media Data Crawler! Design and manage tools to automate data extraction from platforms like LinkedIn, Facebook, and Instagram. You will develop and maintain automated scripts, ensure compliance with platform policies, and analyze collected data to identify key trends. Collaborate with data scientists and marketing teams to deliver valuable insights. Optimize crawling systems for performance and scalability, and stay updated on platform changes. This role requires strong web scraping, data analysis, and API skills.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field
• Proven experience in web crawling, scraping, or data extraction from social media
• Proficiency in programming languages such as Python, Java, or similar
• Familiarity with social media APIs (e.g., LinkedIn API, Facebook Graph API, Twitter API, Instagram API)
• Strong understanding of HTML, CSS, and JavaScript
• Knowledge of data privacy laws and ethical considerations related to data scraping
• Excellent problem-solving skills with keen attention to detail
• Ability to work independently and collaboratively within a team

Responsibilities

• Develop and maintain automated scripts and tools for extracting data from social media platforms, including LinkedIn, Facebook, X, Instagram, and more
• Ensure compliance with the terms of service and privacy policies of each platform
• Continuously monitor and troubleshoot crawling systems to ensure consistent, accurate data collection
• Analyze collected data to identify key trends, insights, and patterns aligned with business goals
• Work closely with data scientists, marketing, and research teams to deliver relevant data for their initiatives
• Optimize crawling systems for performance, scalability, and adaptability to platform changes
• Stay up-to-date with changes in social media platforms and APIs to adjust crawling strategies as needed

Preferred Qualifications

• Experience with big data technologies such as Hadoop or Spark
• Familiarity with data visualization and reporting tools
• Understanding of natural language processing (NLP) techniques

Benefits

• Flexibility, Your Way: Embrace the freedom to work from home or any location of your choice. Create your ideal work environment
• Work-Life Balance at Its Best: Say goodbye to stressful commutes and hello to quality time with loved ones. Achieve a healthy work-life integration to perform at your best