Skip to content

SURE945/web-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

web-crawler

Crawl articles on wechat public accounts

version: 0.5, add json parser

  1. pdf_printer.py

    source link1

    source link2

  2. url_crawler.py

    source link1

    source link2

  3. file_reader.py

    source - chatgpt

  4. json_parser.py

    source - chatgpt

format example:

{
    "theme": "iot",
    "check_article_num": 50,
    "max_article_num": 50,
    "cookie": "RK=uQmp6z+tS/xxx/record",
    "token": "1434767217"
}

About

Crawl articles on wechat public accounts

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages