Skip to content

a simple web crawer.It can download web files with specific format. and craw web content that matched key words and write into files.

Notifications You must be signed in to change notification settings

fzu-huang/yspider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

yspider

这是用golang开发的一个爬虫程序,它具有以下几个功能:

1.爬取指定格式的文件; 2.对html中的文本进行关键词匹配,并保存文本信息; 3.并发的广度搜索,可以设置挖掘深度。

About

a simple web crawer.It can download web files with specific format. and craw web content that matched key words and write into files.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages