Full Stack Web Scraping Developer (Go)

IMPORTANT: PLEASE DO NOT APPLY WITHOUT THOROUGHLY READING THE JOB DESCRIPTION!

THOSE WHO DO NOT INCLUDE A COVER LETTER WILL BE REJECTED IMMEDIATELY.

Scrape.do has been operating in the web scraping industry for three years. Our goal is to provide API services for collecting data from various websites without getting blocked. In this capacity, we serve over 500 global companies and develop solutions against anti-bot systems with an accuracy rate of over 99%.

Required Qualifications

Essential Requirements:

• Bachelor’s degree in Computer Engineering or related fields

• Minimum of 3 years of experience in software development

• Strong verbal and written communication skills in English

• Experience with web scraping and techniques for bypassing anti-bot measures

• Strong foundation in Golang

• Proficient in JavaScript and TypeScript

• Ability to develop tools quickly using Python

• Interest in complex systems

• Desire to work at low-level HTTP/network levels

• Ability to work with distributed systems

Technology Stack:

• Golang (primary development language)

• JavaScript/TypeScript (for browser automation and debugging)

• Python (for fast scripting)

• Docker & Kubernetes

• CI/CD tools (Jenkins, GitLab CI, GitHub Actions)

• Cloud platforms (AWS/GCP/Azure/DO)

• Linux operating systems

DevOps & Container Technologies:

• Experience in Kubernetes cluster management and deployment strategies

• Docker container configuration and optimization

• Experience with container orchestration in microservice architectures

• Design and implementation of CI/CD pipelines

• Monitoring and logging solutions (Prometheus, Grafana, ELK Stack)

Technical Skills:

• Knowledge of web scraping techniques and best practices

• Experience working with anti-bot systems (Cloudflare, Akamai, Datadome, etc.)

• Familiarity with browser and HTTP/TLS fingerprinting

• Proxy management and IP rotation strategies

• Headless browser automation using JavaScript/TypeScript

• Experience with distributed systems and high-performance scraping architectures

Additional Valuable Qualities:

• Interest in reverse engineering

• Familiarity with test-driven development

• Experience in browser automation (Puppeteer, Playwright, etc.)

• Experience with anti-bot bypass techniques

• Passion for performance optimization

• Experience with service mesh (Istio)

• Knowledge of GitOps principles and tools (ArgoCD, Flux)

Responsibilities:

• Providing solutions for customers in response to challenges posed by target websites and communicating with customers in spoken and written English.
• Development and optimization of the web scraping infrastructure
• Creating solutions against anti-bot systems
• Management and development of the proxy infrastructure
• Development of browser automation tools using JavaScript/TypeScript
• Designing high-performance and scalable systems
• Designing container orchestration and CI/CD pipelines
• Designing and implementing microservice architectures
• Establishing and managing infrastructure monitoring and logging systems

Working Conditions:

• We have a comfortable working environment and prefer not to hold frequent meetings; we resolve everything through chat on Slack.
• Flexible working hours (08:00 - 20:00, within the range you prefer)
• Fully remote
• We provide performance-based bonuses
• Meal card
• We offer a competitive salary in USD
• We provide the latest model Mac device

This job listing has manual verification for description checks. You can build and use the following code in questions:

REVIEW CODE: 550298

Why are we doing this?

Because candidates apply without reading the job postings, and we want to filter out those who do not pay attention to our work and requirements. We want to work with principled individuals who know what they are doing.

Thanks!