Skip to content

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

License

Notifications You must be signed in to change notification settings

Skyline5723/logparser

 
 

Repository files navigation

修改增强:

  • 匹配不同的日志格式:INFO | 2024-01-01 00:00:00 | module: msg
  • 增加错误和警告数到stats.json

先卸载(如已安装)

pip uninstall logparser

再使用git安装:

pip install --upgrade git+https://github.com/Skyline5723/logparser

修改logparser/settings.py配置文件的本地日志路径

SCRAPYD_LOGS_DIR = r'D:\Projects\deploy\logs'

About

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%