Skip to content

Use the scrapy framework and mysql database to get all the job information of ChinaHR.com.

Notifications You must be signed in to change notification settings

nieweiming/chinahrspider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

chinahrspider

  • 中华英才网全网职位信息,获取招聘职位共计20w条信息;
  • 爬虫部署在云服务器上,下载delay设为0.5s,线程数设为默认值:16; 在此条件下爬取时间大概为50h,带宽占用为0.2Mbps;(建议加快爬取速度);

About

Use the scrapy framework and mysql database to get all the job information of ChinaHR.com.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages