Code

Add porto nacional#2

Code

Open

ogecece wants to merge 229 commits intomainogecece/querido-diario:mainfrom

add-porto-nacionalogecece/querido-diario:add-porto-nacionalCopy head branch name to clipboard

Commits

Commits on Mar 10, 2022

• Add Sumare-SP spider (#514)

  Show description for 4a3bc48
  

  mgiovani

  and

  ogecece

  authored
  4a3bc48

  Copy full SHA for 4a3bc48

• Adding spider for Jaboatão dos Guararapes, PE (#227)

  Show description for f373d42
  

  3 peopleauthored
  f373d42

  Copy full SHA for f373d42

Commits on Mar 18, 2022

• Add ma_caxias spider (#504)

  Show description for cb70067
  

  alenvieira

  and

  ogecece

  authored
  cb70067

  Copy full SHA for cb70067

Commits on Mar 23, 2022

• Adiciona raspador para Recife e adapta antigo (#541)

  Show description for 1261449
  ogecece

  authored
  1261449

  Copy full SHA for 1261449

• Remove variáveis e reverse desnecessários

  ogecece

  committed
  7ac3ef6

  Copy full SHA for 7ac3ef6

• Merge pull request #543 from giuliocc/corrige-sumare

  Show description for 9719568
  ogecece

  authored
  9719568

  Copy full SHA for 9719568

• Adiciona 4 cidades em produção

  ogecece

  committed
  c6c5bb0

  Copy full SHA for c6c5bb0

• Merge pull request #544 from giuliocc/add-prod

  Show description for 503ef5e
  ogecece

  authored
  503ef5e

  Copy full SHA for 503ef5e

Commits on Apr 28, 2022

• Upgrade all libraries to their latest versions

  rennerocha

  committed
  0c538ca

  Copy full SHA for 0c538ca

• Send notification to Telegram only on failures

  Show description for 5c772e1
  rennerocha

  committed
  5c772e1

  Copy full SHA for 5c772e1

• Update João Pessoa-PB spider after website changed

  Show description for 62c25ad
  rennerocha

  committed
  62c25ad

  Copy full SHA for 62c25ad

Commits on May 9, 2022

• Atualiza dependências

  ogecece

  committed
  52249a1

  Copy full SHA for 52249a1

• Merge pull request #553 from giuliocc/update-deps

  Show description for aaddac6
  ogecece

  authored
  aaddac6

  Copy full SHA for aaddac6

• Adapta Porto Alegre (RS) para produção

  ogecece

  committed
  da6c5d6

  Copy full SHA for da6c5d6

• Merge pull request #552 from giuliocc/new-spiders-prod

  Show description for 8e6bd04
  ogecece

  authored
  8e6bd04

  Copy full SHA for 8e6bd04

• Atualiza dependências com Python 3.9

  ogecece

  committed
  dd7e625

  Copy full SHA for dd7e625

• Merge branch 'update-deps'

  ogecece

  committed
  8e12819

  Copy full SHA for 8e12819

• Adapta Curitiba (PR) para produção

  ogecece

  committed
  74f1301

  Copy full SHA for 74f1301

• Merge pull request #554 from giuliocc/curitiba-prod

  Show description for b205c3c
  ogecece

  authored
  b205c3c

  Copy full SHA for b205c3c

• Adapta Araguaína (TO) para produção

  ogecece

  committed
  91123db

  Copy full SHA for 91123db

• Merge pull request #555 from giuliocc/araguaina-prod

  Show description for 67ee490
  ogecece

  authored
  67ee490

  Copy full SHA for 67ee490

• Adapta Jundiaí (SP) para produção

  ogecece

  committed
  db9153a

  Copy full SHA for db9153a

• Merge pull request #556 from giuliocc/jundiai-prod

  Show description for b288ec4
  ogecece

  authored
  b288ec4

  Copy full SHA for b288ec4

• Adapta Petrolina (PE) (DOEM) para produção

  ogecece

  committed
  5aebe88

  Copy full SHA for 5aebe88

• Merge pull request #557 from giuliocc/petrolina-prod

  Show description for 33560ad
  ogecece

  authored
  33560ad

  Copy full SHA for 33560ad

• Adapta Mossoró (RN) para produção

  ogecece

  committed
  7efedfa

  Copy full SHA for 7efedfa

• Merge pull request #558 from giuliocc/mossoro-prod

  Show description for 343994f
  ogecece

  authored
  343994f

  Copy full SHA for 343994f

• Refactor ms_campo_grande spider to new website

  

  Giulio Carvalho

  authored and

  ogecece

  committed
  071a499

  Copy full SHA for 071a499

• Merge pull request #457 from giuliocc/fix_ms_campo_grande

  Show description for 1b41e3a
  ogecece

  authored
  1b41e3a

  Copy full SHA for 1b41e3a

Commits on Jun 12, 2022

• Update end date parameter to allow filter by period

  Show description for 623580e
  rennerocha

  committed
  623580e

  Copy full SHA for 623580e

• Start using end_date parameter to filter by period

  Show description for 4aa7a88
  rennerocha

  committed
  4aa7a88

  Copy full SHA for 4aa7a88

• Update end date parameter to allow filter by period

  Show description for 7bc1989
  rennerocha

  committed
  7bc1989

  Copy full SHA for 7bc1989

Commits on Jun 14, 2022

• Merge pull request #567 from rennerocha/sigpub-end-date-fix

  Show description for 50d77d8
  ogecece

  authored
  50d77d8

  Copy full SHA for 50d77d8

• Merge pull request #569 from rennerocha/rj-rio-de-janeiro-end-date-fix

  Show description for 6abe315
  ogecece

  authored
  6abe315

  Copy full SHA for 6abe315

• Merge pull request #568 from rennerocha/to_palmas_end_date_fix

  Show description for f799876
  ogecece

  authored
  f799876

  Copy full SHA for f799876

Commits on Jun 26, 2022

• fix typeError in Campo Grande-MS spider

  

  wesleyolvr

  authored and

  rennerocha

  committed
  ec1a626

  Copy full SHA for ec1a626

• fix checks if object data in response is

  

  wesleyolvr

  authored and

  rennerocha

  committed
  5b418ec

  Copy full SHA for 5b418ec

• if the value is false, returns empty list.

  

  wesleyolvr

  authored and

  rennerocha

  committed
  0dcd70f

  Copy full SHA for 0dcd70f

• remove import collections

  

  wesleyolvr

  authored and

  rennerocha

  committed
  da8372a

  Copy full SHA for da8372a

Commits on Jun 28, 2022

• Fix pagination infinite loop

  Show description for 8bc6a3a
  rennerocha

  committed
  8bc6a3a

  Copy full SHA for 8bc6a3a

Commits on Jul 4, 2022

• Adapta Sobral (CE) para produção

  

  ogecece

  authored and

  rennerocha

  committed
  855dcf1

  Copy full SHA for 855dcf1

• Collect gazettes older than 06/02/2017 for Sobral-CE

  Show description for 534572f
  rennerocha

  committed
  534572f

  Copy full SHA for 534572f

Commits on Jul 5, 2022

• Adapta Guarulhos (SP) para produção

  

  ogecece

  authored and

  rennerocha

  committed
  c6c0d43

  Copy full SHA for c6c0d43

• Ignore gazettes from dates outside desired period

  Show description for a9b95be
  rennerocha

  committed
  a9b95be

  Copy full SHA for a9b95be

• Update Scrapy Cloud project key

  rennerocha

  committed
  d3efa12

  Copy full SHA for d3efa12

• Adapta Nova Iguaçu (RJ) para produção

  

  ogecece

  authored and

  rennerocha

  committed
  5c8b87c

  Copy full SHA for 5c8b87c

Commits on Jul 12, 2022

• Adapta Londrina (PR) para produção

  

  ogecece

  authored and

  rennerocha

  committed
  12bd622

  Copy full SHA for 12bd622

• Fix Londrina-PR spider

  Show description for 91a6068
  rennerocha

  committed
  91a6068

  Copy full SHA for 91a6068

Commits on Jul 18, 2022

• Adiciona raspador DOSP de Uberaba (MG)

  

  ogecece

  authored and

  rennerocha

  committed
  79ebeae

  Copy full SHA for 79ebeae

• Adapta raspador de acervo de Uberaba (MG) para produção

  

  ogecece

  authored and

  rennerocha

  committed
  29fbbb4

  Copy full SHA for 29fbbb4

• Update Uberaba-MG to have just one spider for all gazettes available

  Show description for 7862656
  rennerocha

  committed
  7862656

  Copy full SHA for 7862656

Commits on Jul 19, 2022

• Adapta Vila Velha (ES) para produção

  

  ogecece

  authored and

  rennerocha

  committed
  2383c63

  Copy full SHA for 2383c63

Commits on Jul 30, 2022

• Bump scrapy from 2.6.1 to 2.6.2 in /data_collection

  Show description for 82c943b
  

  dependabot[bot]

  authored and

  rennerocha

  committed
  82c943b

  Copy full SHA for 82c943b

• Bump lxml from 4.8.0 to 4.9.1 in /data_collection

  Show description for c686626
  

  dependabot[bot]

  authored and

  rennerocha

  committed
  c686626

  Copy full SHA for c686626

Commits on Aug 29, 2022

• Add Spider for Valinhos/SP

  

  Bruno Bertolani

  authored and

  rennerocha

  committed
  22be56d

  Copy full SHA for 22be56d

• fix end of line

  

  Bruno Bertolani

  authored and

  rennerocha

  committed
  0498c23

  Copy full SHA for 0498c23

• fix black

  

  Bruno Bertolani

  authored and

  rennerocha

  committed
  c604d51

  Copy full SHA for c604d51

• Move Valinhos-SP spider into new location

  rennerocha

  committed
  94afda6

  Copy full SHA for 94afda6

• Update Valinhos-SP spider

  Show description for 22b10c6
  rennerocha

  committed
  22b10c6

  Copy full SHA for 22b10c6

• refactor: Group pagination requests in private method

  Show description for 459714e
  rennerocha

  committed
  459714e

  Copy full SHA for 459714e

• Update Valinhos-SP spider

  Show description for 2a0e15c
  rennerocha

  committed
  2a0e15c

  Copy full SHA for 2a0e15c

• Added Spider for Vinhedo - SP

  

  aassumpcao

  authored and

  rennerocha

  committed
  8c29909

  Copy full SHA for 8c29909

• up

  

  aassumpcao

  authored and

  rennerocha

  committed
  ec8e695

  Copy full SHA for ec8e695

• Update CITIES.md

  

  aassumpcao

  authored and

  rennerocha

  committed
  d1b0f90

  Copy full SHA for d1b0f90

• Move Vinhedo-SP spider to new location

  rennerocha

  committed
  92b8a8f

  Copy full SHA for 92b8a8f

• Update Vinhedo-SP spider

  Show description for e97e0d3
  rennerocha

  committed
  e97e0d3

  Copy full SHA for e97e0d3

Commits on Aug 31, 2022

• Enable Cuiaba-MT to production

  rennerocha

  committed
  8be6484

  Copy full SHA for 8be6484

Commits on Sep 12, 2022

• Add Discord notification when monitor fails

  Show description for 84cbffc
  rennerocha

  committed
  84cbffc

  Copy full SHA for 84cbffc

Commits on Sep 20, 2022

• Do not raise SQLAlchemyError as errors in job logs

  Show description for e49e72e
  rennerocha

  committed
  e49e72e

  Copy full SHA for e49e72e

Commits on Sep 26, 2022

• Update selector to get gazette date

  rennerocha

  committed
  d3e711e

  Copy full SHA for d3e711e

• Add user-agent to requests to avoid blocking

  Show description for abd43d8
  rennerocha

  committed
  abd43d8

  Copy full SHA for abd43d8

• Fix download file URL selector

  rennerocha

  committed
  76eb281

  Copy full SHA for 76eb281

• Add user-agent to requests to avoid blocking

  Show description for 6e80f28
  rennerocha

  committed
  6e80f28

  Copy full SHA for 6e80f28

Commits on Oct 3, 2022

• Add Serra-ES spider

  Show description for a74b06d
  

  Alexandre Harano

  authored and

  rennerocha

  committed
  a74b06d

  Copy full SHA for a74b06d

• Add query param to return gazettes of right city

  Show description for 74e65b4
  rennerocha

  committed
  74e65b4

  Copy full SHA for 74e65b4

• Add edition number to results

  Show description for 5ce3557
  rennerocha

  committed
  5ce3557

  Copy full SHA for 5ce3557

• Enable Serra-ES spider in production

  rennerocha

  committed
  7dc6362

  Copy full SHA for 7dc6362

Commits on Oct 4, 2022

• Issue Joinville-SC #631, adding start and end date filter

  

  gbonesso

  authored and

  rennerocha

  committed
  1a8eed0

  Copy full SHA for 1a8eed0

• Issue Aparecida de Goiânia-GO #633, adding start and end date filter

  

  gbonesso

  authored and

  rennerocha

  committed
  4b93d89

  Copy full SHA for 4b93d89

• Retornando Joinville ao original

  

  gbonesso

  authored and

  rennerocha

  committed
  daa5b02

  Copy full SHA for daa5b02

• Retornando Joinville ao original

  

  gbonesso

  authored and

  rennerocha

  committed
  2d7c4c9

  Copy full SHA for 2d7c4c9

• Update Aparecida de Goiania spider

  Show description for 020fa26
  rennerocha

  committed
  020fa26

  Copy full SHA for 020fa26

• Enable Aparecida de Goiania-GO spider in production

  rennerocha

  committed
  5104395

  Copy full SHA for 5104395

• Contagem-MG #625 (#653)

  Show description for 81a0fe3
  

  gbonesso

  and

  rennerocha

  authored
  81a0fe3

  Copy full SHA for 81a0fe3

• Enable Contagem-MG spider in production

  rennerocha

  committed
  d04b95c

  Copy full SHA for d04b95c

Commits on Oct 6, 2022

• Creating a new PR template

  rennerocha

  authored
  40e9c3b

  Copy full SHA for 40e9c3b

Commits on Oct 10, 2022

• Upgrade all libraries to their latest versions

  Show description for cf94970
  

  Alexandre Harano

  authored and

  rennerocha

  committed
  cf94970

  Copy full SHA for cf94970

• Caxias do Sul-RS #634 (#651)

  Show description for 9a8fc60
  

  gbonesso

  and

  rennerocha

  authored
  9a8fc60

  Copy full SHA for 9a8fc60

• Enable Caxias do Sul-RS in production

  rennerocha

  committed
  957b010

  Copy full SHA for 957b010

• Implementação de Marília/SP (#652)

  Show description for 0c0a00f
  

  gbonesso

  and

  rennerocha

  authored
  0c0a00f

  Copy full SHA for 0c0a00f

• Enable Marilia-SP in production

  rennerocha

  committed
  e739bf0

  Copy full SHA for e739bf0

• Santo André-SP #619 (#655)

  Show description for 42ce58e
  

  gbonesso

  and

  rennerocha

  authored
  42ce58e

  Copy full SHA for 42ce58e

• Enable Santo André-SP in production

  rennerocha

  committed
  65c82b6

  Copy full SHA for 65c82b6

Commits on Oct 12, 2022

• Issue Joinville-SC #631, adding start and end date filter #649 (#657)

  Show description for e9bf8e6
  

  gbonesso

  and

  rennerocha

  authored
  e9bf8e6

  Copy full SHA for e9bf8e6

• Enable Joinville-SC in production

  rennerocha

  committed
  831d0aa

  Copy full SHA for 831d0aa

Commits on Oct 13, 2022

• Ignore W503 on flake8 due to black and flake8 conflicts

  Show description for da15f3f
  ayharano

  authored
  da15f3f

  Copy full SHA for da15f3f

Commits on Oct 18, 2022

• Add Belford Roxo-RJ spider

  Show description for a3dd905
  

  Alexandre Harano

  authored and

  rennerocha

  committed
  a3dd905

  Copy full SHA for a3dd905

• Update Belford Roxo-RJ spider

  Show description for 1689bc3
  rennerocha

  committed
  1689bc3

  Copy full SHA for 1689bc3

• Fixing sp_campinas spyder

  

  danielfireman

  authored and

  rennerocha

  committed
  9db13a6

  Copy full SHA for 9db13a6

• Evitando coletar páginas desnecessárias

  

  danielfireman

  authored and

  rennerocha

  committed
  8782658

  Copy full SHA for 8782658

• Improving sp_campinas

  

  danielfireman

  authored and

  rennerocha

  committed
  8c1f164

  Copy full SHA for 8c1f164

• Update Campinas-SP spider

  Show description for 926d951
  rennerocha

  committed
  926d951

  Copy full SHA for 926d951

• Adicionando raspador de Acajutiba BA

  

  e-costalmeida

  authored and

  rennerocha

  committed
  e8177de

  Copy full SHA for e8177de

Commits on Oct 19, 2022

• Allow download a file even if Content-Length is not correct

  Show description for 2c37f19
  rennerocha

  committed
  2c37f19

  Copy full SHA for 2c37f19

• Enable spiders in production

  Show description for 01db6e1
  rennerocha

  committed
  01db6e1

  Copy full SHA for 01db6e1

• working on mt_rondonopolis

  

  lucasocarvalhos

  authored and

  rennerocha

  committed
  e0bbded

  Copy full SHA for e0bbded

• paginacao

  

  lucasocarvalhos

  authored and

  rennerocha

  committed
  beb6374

  Copy full SHA for beb6374

• added pagination

  

  lucas de oliveira carvalho

  authored and

  rennerocha

  committed
  ce2d083

  Copy full SHA for ce2d083

• http 404 error fixed

  

  lucas de oliveira carvalho

  authored and

  rennerocha

  committed
  e6e9caa

  Copy full SHA for e6e9caa

• Add MT-Rondonopolis #696

  

  lucasocarvalhos

  authored and

  rennerocha

  committed
  d3c5c2b

  Copy full SHA for d3c5c2b

• Update Rondonopolis-MT spider

  Show description for cc50844
  rennerocha

  committed
  cc50844

  Copy full SHA for cc50844

• Enable Rondonopolis-MT in production

  rennerocha

  committed
  679e75d

  Copy full SHA for 679e75d

• Merge pull request #729 from ayharano/ignore-flake8-W503

  Show description for 03049d1
  ogecece

  authored
  03049d1

  Copy full SHA for 03049d1

Commits on Oct 28, 2022

• Add Santana-AP spider

  

  Jobe Diego Dylbas dos Santos

  authored and

  rennerocha

  committed
  5427bb8

  Copy full SHA for 5427bb8

• Add any exception

  

  jobedylbas

  authored and

  rennerocha

  committed
  6384932

  Copy full SHA for 6384932

• Correct import order

  

  jobedylbas

  authored and

  rennerocha

  committed
  5949ec3

  Copy full SHA for 5949ec3

• Correct import order

  

  jobedylbas

  authored and

  rennerocha

  committed
  12410d3

  Copy full SHA for 12410d3

• Update Santana-AP spider removing bare exception

  rennerocha

  committed
  970982d

  Copy full SHA for 970982d

• Enable Santana-AP spider to producttion

  rennerocha

  authored
  517bc5e

  Copy full SHA for 517bc5e

Commits on Nov 8, 2022

• chore: Upgrade project dependencies

  rennerocha

  committed
  9010268

  Copy full SHA for 9010268

Commits on Nov 9, 2022

• chore: Upgrade project dependencies

  rennerocha

  committed
  b14e020

  Copy full SHA for b14e020

Commits on Nov 24, 2022

• Reverte dependências dos projetos

  

  ogecece

  authored and

  rennerocha

  committed
  c44cf99

  Copy full SHA for c44cf99

• Atualiza dependências do projeto, exceto as relacionadas com storage

  Show description for b7b5d63
  rennerocha

  committed
  b7b5d63

  Copy full SHA for b7b5d63

• Create command to schedule all enable spiders with a start date

  Show description for 7e54452
  rennerocha

  committed
  7e54452

  Copy full SHA for 7e54452

Commits on Nov 28, 2022

• Fix warning message when already downloaded item is stored in DB

  rennerocha

  committed
  3df8d80

  Copy full SHA for 3df8d80

Commits on Nov 29, 2022

• Fix Macapa Parser

  

  vikitor566

  authored and

  rennerocha

  committed
  15d9447

  Copy full SHA for 15d9447

• Fix Macapa AP Spider

  

  vikitor566

  authored and

  rennerocha

  committed
  ce822f0

  Copy full SHA for ce822f0

• Atualização do spider de Macapá-AP

  Show description for 1127368
  rennerocha

  committed
  1127368

  Copy full SHA for 1127368

• Fix Macapá-AP and enable it in production

  rennerocha

  committed
  4ae2fdf

  Copy full SHA for 4ae2fdf

Commits on Nov 30, 2022

• Adiciona raspador "aplus" para cidades do Maranhão

  Show description for a2202c5
  

  LuccaBortoloso

  authored and

  ogecece

  committed
  a2202c5

  Copy full SHA for a2202c5

• Habilita raspadores em produção

  ogecece

  committed
  8db4a1f

  Copy full SHA for 8db4a1f

• Merge pull request #749 from LuccaBortoloso/ma-base-spider

  Show description for 4eb776e
  ogecece

  authored
  4eb776e

  Copy full SHA for 4eb776e

Commits on Dec 14, 2022

• Use real User Agent in project requests

  rennerocha

  committed
  3f1beed

  Copy full SHA for 3f1beed

Commits on Dec 19, 2022

• Adjust Juazeiro-BA spider

  Show description for 11a27a1
  ayharano

  committed
  11a27a1

  Copy full SHA for 11a27a1

• Adjust Alagoinhas-BA spider

  Show description for 1fe3c0e
  ayharano

  committed
  1fe3c0e

  Copy full SHA for 1fe3c0e

• Adjust Campo Formoso-BA spider

  Show description for 4c94ab3
  ayharano

  committed
  4c94ab3

  Copy full SHA for 4c94ab3

• Adjust Senhor do Bonfim-BA spider

  Show description for dea1dea
  ayharano

  committed
  dea1dea

  Copy full SHA for dea1dea

Commits on Dec 21, 2022

• Add Jaboticabal-SP Spider

  rafaelgottsfritz-luizalabs

  committed
  b4b4b95

  Copy full SHA for b4b4b95

Commits on Dec 22, 2022

• Adjust Nova Serrana-MG spider

  Show description for 3238987
  

  ayharano

  authored and

  trevineju

  committed
  3238987

  Copy full SHA for 3238987

• Adjust Itaúna-MG spider

  Show description for 2752741
  

  ayharano

  authored and

  trevineju

  committed
  2752741

  Copy full SHA for 2752741

• Adjust Campo Belo-MG spider

  Show description for bf3a573
  

  ayharano

  authored and

  trevineju

  committed
  bf3a573

  Copy full SHA for bf3a573

• Habilita spiders em produção

  trevineju

  committed
  4e1cdb3

  Copy full SHA for 4e1cdb3

• Merge branch 'ayharano-some_mg_spiders_adjustments' into main

  trevineju

  committed
  35911b6

  Copy full SHA for 35911b6

• Fixed spider rs_camaqua

  

  marcospscruz

  authored and

  trevineju

  committed
  41a78ec

  Copy full SHA for 41a78ec

• Merge PR #804 into main

  trevineju

  committed
  78e0e2b

  Copy full SHA for 78e0e2b

• Merge pull request #803 from rafaelgotts/sp_jaboticabal

  Show description for e045255
  trevineju

  authored
  e045255

  Copy full SHA for e045255

• Merge pull request #800 from ayharano/some_ba_spiders_adjustments

  Show description for 624fa3f
  trevineju

  authored
  624fa3f

  Copy full SHA for 624fa3f

• Habilita cidades em produção

  trevineju

  committed
  0011714

  Copy full SHA for 0011714

• Fix Arraial do Cabo-RJ

  

  LuccaBortoloso

  authored and

  trevineju

  committed
  d469f84

  Copy full SHA for d469f84

• Habilita arraial do cabo (rj) em produção

  trevineju

  committed
  72ea76a

  Copy full SHA for 72ea76a

• Merge pull request #805 from LuccaBortoloso/rj_arraial_do_cabo

  Show description for 622af65
  trevineju

  authored
  622af65

  Copy full SHA for 622af65

• Atualiza spider ms_inocencia

  

  trevineju

  authored and

  ogecece

  committed
  4b6a0aa

  Copy full SHA for 4b6a0aa

• Atualiza spider ms_maracaju

  

  trevineju

  authored and

  ogecece

  committed
  7f9c530

  Copy full SHA for 7f9c530

• Atualiza spider pr_sao_mateus_do_sul

  

  trevineju

  authored and

  ogecece

  committed
  89cd2a4

  Copy full SHA for 89cd2a4

• Habilita cidades em produção

  

  trevineju

  authored and

  ogecece

  committed
  13d559b

  Copy full SHA for 13d559b

• Merge pull request #806 from okfn-brasil/adiciona_cidades_instar

  Show description for dfea148
  ogecece

  authored
  dfea148

  Copy full SHA for dfea148

• Fix Ibitinga-SP Spider

  

  rafaelgotts

  authored and

  trevineju

  committed
  c965bb5

  Copy full SHA for c965bb5

• Habilita Ibitinga em produção

  trevineju

  committed
  981dd96

  Copy full SHA for 981dd96

• Merge pull request #802 from rafaelgotts/sp_ibitinga

  Show description for 5312e73
  trevineju

  authored
  5312e73

  Copy full SHA for 5312e73

Commits on Dec 23, 2022

• Enable Zyte Smart Proxy Manager in project for selected spiders

  rennerocha

  committed
  be7d00e

  Copy full SHA for be7d00e

• Update Scrapy CLoud project to OKBR account

  rennerocha

  committed
  6f2d727

  Copy full SHA for 6f2d727

• Get Smart Proxy API Key from Github Secrets

  rennerocha

  committed
  f895b5e

  Copy full SHA for f895b5e

• Add docs explaining when to enable Smart Proxy

  rennerocha

  committed
  7c77204

  Copy full SHA for 7c77204

Commits on Dec 26, 2022

• Enable Zyte Smart Proxy to avoid blocking

  rennerocha

  committed
  a3f8b67

  Copy full SHA for a3f8b67

• Fix URLs of documents

  rennerocha

  committed
  a8678f4

  Copy full SHA for a8678f4

Commits on Jan 2, 2023

• Do not raise error if no gazette is returned

  Show description for 006f345
  rennerocha

  committed
  006f345

  Copy full SHA for 006f345

Commits on Jan 3, 2023

• Improve regex to identify extra editions

  rennerocha

  committed
  9fd6efa

  Copy full SHA for 9fd6efa

• Increase number of days allowed without gazettes

  Show description for 09d1f21
  rennerocha

  committed
  09d1f21

  Copy full SHA for 09d1f21

• Add monitor failure description to Discord notification

  Show description for 3840f61
  rennerocha

  committed
  3840f61

  Copy full SHA for 3840f61

• Update pre-commit rules and versions

  rennerocha

  committed
  f1d2843

  Copy full SHA for f1d2843

• Take num of items returned in current job for days with no gazette monitor

  Show description for 440ecaf
  rennerocha

  committed
  440ecaf

  Copy full SHA for 440ecaf

• Weekly schedule of all enabled spiders

  Show description for 43e7cb6
  rennerocha

  committed
  43e7cb6

  Copy full SHA for 43e7cb6

Commits on Jan 24, 2023

• Do not encode query params in initial request

  rennerocha

  committed
  c064fb2

  Copy full SHA for c064fb2

• Fix month formatting that was preventing return items from one-digit months

  rennerocha

  committed
  5b9e486

  Copy full SHA for 5b9e486

Commits on Feb 13, 2023

• Use HTTPS as initial URL to reduce unnecessary redirects

  rennerocha

  committed
  3ff45cd

  Copy full SHA for 3ff45cd

Commits on Feb 14, 2023

• Remove unnecessary requests

  Show description for 22e7904
  rennerocha

  committed
  22e7904

  Copy full SHA for 22e7904

• Desabilitar Bacabal-MA

  Show description for a1449ac
  rennerocha

  authored
  a1449ac

  Copy full SHA for a1449ac

• Run all entire month

  rennerocha

  committed
  f34e1d2

  Copy full SHA for f34e1d2

• Allow more days without gazettes

  Show description for dce40e5
  rennerocha

  authored
  dce40e5

  Copy full SHA for dce40e5

• add ma_aldeias_altas spider

  

  alenvieira

  authored and

  rennerocha

  committed
  d1f76f0

  Copy full SHA for d1f76f0

• Finish Aldeias Altas - MA

  rennerocha

  committed
  287ae84

  Copy full SHA for 287ae84

Commits on Feb 15, 2023

• Atualiza documentação do repositório e versões em inglês

  trevineju

  committed
  c9751b0

  Copy full SHA for c9751b0

• remove CITIES.md

  trevineju

  committed
  c152aa7

  Copy full SHA for c152aa7

• Merge pull request #605 from trevineju/atualiza-documentação

  Show description for 144f97a
  ogecece

  authored
  144f97a

  Copy full SHA for 144f97a

Commits on Feb 16, 2023

• Fix Aldeias Altas-MA spider

  rennerocha

  committed
  34217fc

  Copy full SHA for 34217fc

Commits on Mar 3, 2023

• Corrige problema no isort

  Show description for 7bc5fdc
  trevineju

  committed
  7bc5fdc

  Copy full SHA for 7bc5fdc

• Adiciona proxy em df_brasilia

  trevineju

  committed
  d52b108

  Copy full SHA for d52b108

• Corrige df_brasilia (#831)

  Show description for 90e581e
  trevineju

  authored
  90e581e

  Copy full SHA for 90e581e

Commits on Mar 8, 2023

• Update pre-commit hooks and execute it against project

  rennerocha

  committed
  9e60497

  Copy full SHA for 9e60497

• Run pre-commit hooks to check linting and formatting

  rennerocha

  committed
  ab88f9f

  Copy full SHA for ab88f9f

• Remove command not used

  rennerocha

  committed
  4e8e347

  Copy full SHA for 4e8e347

• Pre commit update (#832)

  Show description for f307db2
  rennerocha

  authored
  f307db2

  Copy full SHA for f307db2

Commits on Apr 14, 2023

• [Revisão retroativa] Maringa-PR

  Winzen

  committed
  99cf371

  Copy full SHA for 99cf371

Commits on Apr 22, 2023

• ajusta data de inicio

  bmortella

  committed
  1e01aeb

  Copy full SHA for 1e01aeb

Commits on May 8, 2023

• Adiciona templates para issues

  

  bmortella

  authored and

  trevineju

  committed
  e3a4158

  Copy full SHA for e3a4158

• Templates para issues (#838)

  trevineju

  authored
  df49851

  Copy full SHA for df49851

Commits on May 16, 2023

• Update sp_santos.py

  Show description for e293455
  rennerocha

  authored
  e293455

  Copy full SHA for e293455

• Update sp_santos.py

  Show description for 5b8c2ba
  rennerocha

  authored
  5b8c2ba

  Copy full SHA for 5b8c2ba

• Habilitar Santos-SP em produção

  Show description for 289c7ea
  rennerocha

  authored
  289c7ea

  Copy full SHA for 289c7ea

• Converter como data

  Show description for 1105b47
  rennerocha

  authored
  1105b47

  Copy full SHA for 1105b47

• Ajusta data de inicio para sp_santos (#851)

  Show description for c7c3635
  rennerocha

  authored
  c7c3635

  Copy full SHA for c7c3635

• Melhoria na extração do número da edição

  Show description for b80e1bc
  rennerocha

  authored
  b80e1bc

  Copy full SHA for b80e1bc

• Habilitando Maringa-PR em produção

  Show description for 94863f7
  rennerocha

  authored
  94863f7

  Copy full SHA for 94863f7

• Acesso a URL com SSL para evitar redirecionamento

  Show description for 24273b3
  rennerocha

  authored
  24273b3

  Copy full SHA for 24273b3

• [Revisão retroativa] Maringa-PR (#850)

  Show description for b486991
  rennerocha

  authored
  b486991

  Copy full SHA for b486991

Commits on May 19, 2023

• Update pr_maringa.py

  Show description for 6901226
  trevineju

  authored
  6901226

  Copy full SHA for 6901226

• Habilita smart_proxy para PR_Maringa (#854)

  trevineju

  authored
  93e0f3a

  Copy full SHA for 93e0f3a

Commits on May 22, 2023

• Fix rn_mossoro, resolves #835

  

  bmortella

  authored and

  trevineju

  committed
  3faf687

  Copy full SHA for 3faf687

• Separa rn_mossoro em dois raspadores, por site vigente

  trevineju

  committed
  79614cb

  Copy full SHA for 79614cb

• Fix rn_mossoro (#836)

  Show description for 521fe94
  trevineju

  authored
  521fe94

  Copy full SHA for 521fe94

Commits on May 23, 2023

• Permitir a execução de spiders em uma faixa de datas

  rennerocha

  committed
  f093e5d

  Copy full SHA for f093e5d

• Permitir a execução de spiders em uma faixa de datas (#857)

  rennerocha

  authored
  39d7c02

  Copy full SHA for 39d7c02

• Permitir a execução de spiders em uma faixa de datas

  rennerocha

  committed
  ead20d1

  Copy full SHA for ead20d1

• Permitir a execução de spiders em uma faixa de datas (#858)

  rennerocha

  authored
  6a93176

  Copy full SHA for 6a93176

• Nova action para agendar spiders em um período de tempo

  rennerocha

  committed
  201f6ff

  Copy full SHA for 201f6ff

• Nova action para agendar spiders em um período de tempo (#859)

  rennerocha

  authored
  f7bd4d4

  Copy full SHA for f7bd4d4

• Adicionar comando para agendar spiders mais generalista

  rennerocha

  committed
  3a29b0f

  Copy full SHA for 3a29b0f

• Adicionar comando para agendar spiders mais generalista (#860)

  rennerocha

  authored
  c4e5536

  Copy full SHA for c4e5536

Commits on Jun 5, 2023

• Adiciona o spider do município Varzea da Palma - MG

  Show description for 5cf372c
  

  Kaio Duarte Costa

  authored and

  trevineju

  committed
  5cf372c

  Copy full SHA for 5cf372c

• Habilita MG-Varzea de Palma em produção

  trevineju

  committed
  01e7140

  Copy full SHA for 01e7140

• Add Várzea da Palma - MG (#865)

  trevineju

  authored
  6baf712

  Copy full SHA for 6baf712

Commits on Jun 6, 2023

• Update pull_request_template.md

  Show description for 2cb6792
  trevineju

  committed
  2cb6792

  Copy full SHA for 2cb6792

• Atualiza README com dicas de execução (#867)

  Show description for 215e16a
  trevineju

  authored
  215e16a

  Copy full SHA for 215e16a

• Adiciona raspador para Taiobeiras - MG

  Show description for 182bed1
  

  Kaio Duarte Costa

  authored and

  trevineju

  committed
  182bed1

  Copy full SHA for 182bed1

• Habilita Taiobeiras - MG em produção

  trevineju

  committed
  5dbb06b

  Copy full SHA for 5dbb06b

• Add Taiobeiras (MG) (#866)

  trevineju

  authored
  2348c6f

  Copy full SHA for 2348c6f

Commits on Jun 14, 2023

• Desabilita Peritoro-MA de produção

  trevineju

  committed
  86239f9

  Copy full SHA for 86239f9

• Desabilita Peritoro-MA de produção (#880)

  trevineju

  authored
  7bab59d

  Copy full SHA for 7bab59d

Commits on Jun 16, 2023

• Adiciona Porto Nacional (TO)

  ogecece

  committed
  ce481b6

  Copy full SHA for ce481b6