爬虫开发工程师
Best Web3
Job Description
岗位职责：
- 设计并实现高效、稳定、可扩展的爬虫系统，确保数据的实时性与完整性
- 深⼊研究各类反爬机制，开发绕过验证码、限流、 IP 封禁等策略，提升爬虫成功率
- 实现代理池、动态 UA、 Cookies 管理、 Session 维持等反爬解决方案
- 提升爬虫性能，优化爬取速度、数据存储结构及请求并发模型
岗位要求：
- 不限学历和专业
- 熟练使用 Python 技术栈： Scrapy、 Playwright、Selenium、Httpx、 Requests 等爬虫框架与库
- 熟悉反爬策略，包括但不限于代理池、 IP 轮换、验证码识别、动态加载页面解析、 JavaScript 渲染页面抓取等
- 有丰富的绕过网页限制经验，掌握如浏览器指纹、 Cookies 仿真、 Session 维持、前端加密破解等技术
- 熟悉异步编程、多进程、分布式爬虫架构，具备大规模数据爬取与存储经验
Miko M
HR ManagerBest Web3
Reply 0 Times Today
Working Location
广州市. 中国广东省广州市
Posted on 26 December 2025
Explore similar jobs
View more similar jobsBack-end Development Engineer
Best Web3₦1.6-2.6M[Monthly]
On-site - China<1 Yr ExpBachelorFull-time
Miko MHR Manager
Back-End Development Engineer
香港链创智联科技有限公司₦4.4-7.3M[Monthly]
On-site - China1-3 Yrs ExpBachelorFull-time
gray chen创始人
Backend Developer
比特鹰₦1.7-3.2M[Monthly]
On-site - China<1 Yr ExpEdu not requiredFull-time
Chen BruceHR Manager
Backend Development
Nftgo₦3.5-5.5M[Monthly]
On-site - China1-3 Yrs ExpBachelorFull-time
daisy yuHR Manager
Go Software Engineer
Sign₦4.4-11.6M[Monthly]
On-site - China5-10 Yrs ExpEdu not requiredFull-time
Jay -人力資源經理
Bossjob Safety Reminder
If the position requires you to work overseas, please be vigilant and beware of fraud.
If you encounter an employer who has the following actions during your job search, please report it immediately
- withholds your ID,
- requires you to provide a guarantee or collects property,
- forces you to invest or raise funds,
- collects illicit benefits,
- or other illegal situations.
