-
Notifications
You must be signed in to change notification settings - Fork 4
/
changelog
2550 lines (1723 loc) · 86.6 KB
/
changelog
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
scap (4.134.0)
* kubernetes.py: Only call _get_total_expected_replicas when needed
* kubernetes: add safeties around replica check
* fakeApiserver.js: Add change_infos to all backport jobs
* Fix fake job change info (v2)
* fakeApiserver.js: Fix fake job change info
* spiderpig: backport: Store basic info about changes
* gerrit.py: Add some type declarations
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 17 Dec 2024 14:02:59 -0800
scap (4.133.0)
* JobCard.vue: Fix statusChipMessage logic
* fakeApiServer/fakeBackport: Make job signalling work.
* spiderpig/api.py: Return interaction info in GET /api/jobs
* install-world: follow-up to recent rework
* scap prep: set pushInsteadOf in the submodules config
* Clear stdin before reading user input (take 2)
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 16 Dec 2024 09:34:27 -0800
scap (4.132.0)
* install-world: rework installer
-- Jaime Nuche <jnuche@wikimedia.org> Tue, 03 Dec 2024 13:21:23 +0100
scap (4.131.0)
* Revert "Clear stdin before reading user input"
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 02 Dec 2024 09:48:24 -0800
scap (4.130.0)
* Remove check for agreement between all.dblist and wikiversions.json
* Clear stdin before reading user input
* Fix scap install-world -l behavior
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 02 Dec 2024 08:26:42 -0800
scap (4.129.0)
* scap clean: first delete branch from superproject
-- Antoine Musso <hashar@free.fr> Mon, 25 Nov 2024 17:17:16 +0100
scap (4.128.0)
* scap clean: delete branches as gerrit_push_user
* web: improve main page UI
* web/src/api.js: Remove unused testmodeData slot
* .gitlab-ci.yml: Only run *-docs jobs on main repo
* requirements.txt: Bump pydantic-core to >= 2.27.1
* install_world.py: Fix rsync source bug
* spiderpig api: Add job history pagination support
-- Antoine Musso <hashar@free.fr> Mon, 25 Nov 2024 12:25:10 +0100
scap (4.127.0)
* mwscript.py: Fix WMF_DATACENTER handling
* requirements.txt: Bump pydantic-core to 2.27.0
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 20 Nov 2024 13:53:36 -0800
scap (4.126.0)
* mwscript.py: Bind-mount host SSL cert directories
* jobrunner: Set suitable job status when awaiting user interaction
* Navigation.vue: Fix computed title for job viewer page
* fakeApiserver.js: Initialize job history with 20 fake jobs
* scap.spiderpig.engine(): Support connect_args parameter
* fakeApiserver.js: Update getJobrunnerStatus
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 20 Nov 2024 11:33:06 -0800
scap (4.125.0)
* mwscript: Set WMF_DATACENTER to cfg["wmf_realm"]
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 18 Nov 2024 09:22:58 -0800
scap (4.124.0)
* Reduce the cardinality of scap timers/statsd metrics (phase 2)
* tests/scap/test_log.py: Add tests for log.Timer() with name=None
* web: Convert components to Composition API
* Reduce the cardinality of scap timers/statsd metrics (phase 1)
* web: Get rid of remaining eslint warning
* log.py: Update docstring after removal of `mark` method
* log.py: Remove unused `Timer.mark()` method
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 15 Nov 2024 10:32:55 -0800
scap (4.123.0)
* mwscript: Don't set WMF_MAINTENANCE_OFFLINE when --network is used
* spiderpig ui: Allow sensitive log information to be revealed
* tox.ini: Modify shellcheck and flake8 filters
* Web: Add basic .editorconfig
* web/.eslintignore: Add dist/
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 12 Nov 2024 08:24:50 -0800
scap (4.122.0)
* interaction.py: Add docstring to UserIOBase.output_line()
* Web: Add ESLint and enforce WMF coding conventions
* api.py: Add include_sensitive parameter for /api/jobs/{job_id}/log
* jobrunner: Record job log in JSONlines format
* Spiderpig: Add output_line interaction with sensitive flag
* web: Rename fakeJobrunner to fakeApiserver
* kubernetes: Support deployment of image flavours
* spiderpig/api.py: Consolidate Vue routes into a single handler function
* spiderpig/api.py: Pass entire scap config to fastapi worker
* utils.py: Add string_to_base64_string utility function
* jobrunner.py: Record user who responded in job log
* spiderpig: Remove "Start train" button from overview page
* web: Add support for VITE_APISERVER_URL
* api.js: Fix isTestMode()
* Test mode improvements
-- Dan Duvall <dduvall@wikimedia.org> Thu, 07 Nov 2024 11:58:38 -0800
scap (4.121.0)
* AbstractSync: run 'mwscript eval.php --wiki testwiki' with network access
* Remove unreferenced fakejoboutput.js
* Backport.vue: Revise how patch chips are constructed
* spiderpig api.py: searchPatch: Handle gerrit errors
-- Jaime Nuche <jnuche@wikimedia.org> Tue, 05 Nov 2024 11:20:04 +0100
scap (4.120.0)
* Codex components part 1
* spiderpig api.js: Add searchPatch()
* spiderpig: Add Gerrit search API endpoint
* spiderpig-otp: Increase time interval, report expiration
* Report Restarting php-fpm status
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 01 Nov 2024 11:02:28 -0700
scap (4.119.4)
* spiderpig/api.py: Run fastapi from same dir as scap (v2)
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 31 Oct 2024 15:24:50 -0700
scap (4.119.3)
* deploy_promote.py: Report status when waiting for patch to merge
* spiderpig/api.py: Run fastapi from same dir as scap
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 31 Oct 2024 13:37:10 -0700
scap (4.119.2)
* Revise spiderpig UI building (part 2)
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 31 Oct 2024 12:49:47 -0700
scap (4.119.1)
* Revise spiderpig UI building
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 31 Oct 2024 12:31:21 -0700
scap (4.119.0)
* apiserver: Serve web ui
* jobrunner: Use a lockfile to ensure a single jobrunner
* lock.py: Allow timeout to be 0
* Clarify uses of cli.Application.lock context manager
* Set job status for major scap backport operations
* spiderpig/api.py: Remove hard-coded train-dev hack
* Add support for multiple check commands
* Add report_status() stuff
* install_world.py: Fix a type declaration
* spiderpig: Improve HTTP efficiency
* testmode work
* api.js: Default to NOT test mode
* requirements.txt: Bump fastapi to 0.115.4
* SpiderPig API server
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 31 Oct 2024 11:20:28 -0700
scap (4.118.0)
* update-interwiki-cache: Give some output on success
* Spiderpig Web UI
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 25 Oct 2024 07:58:14 -0700
scap (4.117.0)
* scap train: Fix bug in final visualization
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 22 Oct 2024 14:36:11 -0700
scap (4.116.0)
* build-images: Support `--latest-tag` argument
* prep: Support `--reference` argument for user-supplied git reference dir
* remove plugins abstraction from Scap
-- Dan Duvall <dduvall@wikimedia.org> Tue, 22 Oct 2024 11:51:01 -0700
scap (4.115.0)
* mwscript: Containerize MediaWiki script execution
* deploy_promote.py: Improve _get_special_version error reporting
-- Dan Duvall <dduvall@wikimedia.org> Mon, 21 Oct 2024 10:45:44 -0700
scap (4.114.0)
* Revert "mwscript: Containerize MediaWiki script execution"
* Change the interactions interface
* jobrunner.py: Shutdown improvements.
* spiderpig/model.py: Misc updates
* interaction.py: Fix generate_prompt_text and its use
* Drop spiderpig-testclient
* tests/scap/test_cli.py: Fix test_announce
* git.py: Don't run version() at module top level
-- Jaime Nuche <jnuche@wikimedia.org> Mon, 21 Oct 2024 10:34:17 +0200
scap (4.113.0)
* mwscript: Containerize MediaWiki script execution
* move spiderpig files
-- Dan Duvall <dduvall@wikimedia.org> Fri, 18 Oct 2024 10:05:34 -0700
scap (4.112.0)
* kubernetes: drop older DeploymentsConfig support
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 17 Oct 2024 11:58:12 -0700
scap (4.111.0)
* scap deploy --init: allow on non-primary deployment servers
* kubernetes.py: Fix handling of exception during rollback
* build_wheels.sh: Build wheels a more modern way
* Drop -1 from version string
* scap deploy --init: Don't ask for justification
* Consolidate uses of "with log.Timer" pattern
* tasks.py: Minor sync_* function tweaks for consistency
* spiderpig: Add "status" field to Job
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 17 Oct 2024 11:32:03 -0700
scap (4.110.0)
* Don't load plugins from user's home directory or current directory
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 10 Oct 2024 08:29:44 -0700
scap (4.109.0)
* build-images: Skip JSON/MD5 l10n generation
-- Dan Duvall <dduvall@wikimedia.org> Thu, 03 Oct 2024 11:53:44 -0700
scap (4.108.0)
* scap/__init__.py: Remove cruft
* kubernetes: generalize deployments configuration
* Revert "mwscript: Containerize MediaWiki script execution"
* Makefile: Bump DEFAULT_VARIANT to bullseye
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 02 Oct 2024 08:09:50 -0700
scap (4.107.0)
* prep: Support glob pattern in `--copy-private-settings` src
-- Dan Duvall <dduvall@wikimedia.org> Thu, 26 Sep 2024 15:24:15 -0700
scap (4.106.0)
* Fix l10n CDB file handling on secondary masters
-- Dan Duvall <dduvall@wikimedia.org> Thu, 26 Sep 2024 13:41:15 -0700
scap (4.105.0)
* mwscript: Containerize MediaWiki script execution
* Establish a table for storing jobrunner status
* Makefile: Don't pass --quiet when building the verify-deps image
* Drop Response class. Not needed.
-- Dan Duvall <dduvall@wikimedia.org> Thu, 26 Sep 2024 09:21:44 -0700
scap (4.104.0)
* Remove Docker image pulling functionality
* test-requirements.txt: Add pytest-subtests
* gerrit.py: Handle plain change number in GerritSession.change_number_from_url
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 19 Sep 2024 10:38:00 -0700
scap (4.103.0)
* cli: Define common methods for locking in `cli.Application`
* kubernetes: Provide `build-images` subcommand
-- Dan Duvall <dduvall@wikimedia.org> Mon, 16 Sep 2024 15:48:08 -0700
scap (4.102.1)
* setup.py: Include scap.spiderpig package
* Change Job.add() interface
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 16 Sep 2024 13:15:08 -0700
scap (4.102.0)
* deploy: Prompt for log message if not supplied on command line
* backport.py: Only accept change numbers consisting of ASCII digits
* jobrunner: Mention default polling interval
* Initial spiderpig jobrunner implementation and data model
* sync_common(): Exclude <stagedir>/scap/ directory from rsync
* Mediawiki Deployment history: Drop scap-prep-point tag, use git merge-base
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 16 Sep 2024 09:50:08 -0700
scap (4.101.3)
* wheels: Include up-to-date pip along with other wheels
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 05 Sep 2024 14:47:38 -0700
scap (4.101.2)
* install_local_version.sh: Upgrade pip to latest version
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 05 Sep 2024 13:39:02 -0700
scap (4.101.1)
* Ensure history.db is group-writable
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 05 Sep 2024 09:32:54 -0700
scap (4.101.0)
* Store scap sync-world history in a SQLite database
* cli.py: add scap version to fatal error messages for better logging
* scap prep: Make mediawiki cache dir world writable immediately after cloning
* history: Drop 'synced' flag. Just use 'completed'
* history.py: A couple more type declarations
* history.py: Add return type info to some methods
* Revise use of deployment history
* Add spiderpig.png to project
* git.py: Add get_branch() function
* git.py: tag(): Default location to ".".
* git.py: Add `tag` function, use it for `tag_repo`
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 05 Sep 2024 08:29:15 -0700
scap (4.100.0)
* cli: require_tty_multiplexer support
* release-scripts/update-scap-in-beta: Update deploy hostname
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 26 Aug 2024 07:39:33 -0700
scap (4.99.0)
* test_deploy.py: Add check for proper handling of check overrides
* checks.py: Discard blank checks
* sync-world: Announce end of operation when --stop-before-sync is used
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 20 Aug 2024 14:57:06 -0700
scap (4.98.0)
* k8s: Pass the list of live mediawiki versions to build-images.py
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 19 Aug 2024 12:47:03 -0700
scap (4.97.0)
* kubernetes: Use new way to invoke container image build
* Change "Finished scap:" to "Finished scap sync-world:"
* Revert "kubernetes: Use new way to invoke container image build"
* kubernetes: Use new way to invoke container image build
* development.rst: Replace scap-vagrant with train-dev
* deploy.py: Handle missing keyholder key with clear error logging
-- Tyler Cipriani <tcipriani@wikimedia.org> Tue, 13 Aug 2024 11:16:02 -0600
scap (4.96.0)
* kubernetes.py: Use new image build report file
* install_world: remove deploy master from list to install only if present
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 05 Aug 2024 11:44:59 -0700
scap (4.95.0)
* install_world: use wheels to install scap on secondary deployment servers
-- Jaime Nuche <jnuche@wikimedia.org> Tue, 30 Jul 2024 13:40:47 +0200
scap (4.94.0)
* backport: pass argument to correct git command
* Make default history_log follow stage_dir
* cli.py: Change default path of mediawiki sync lockfile
* utils.py: Handle "next" version
* utils.py: parse_wmf_version: Handle branch_cut_pretest
* prep.py: _select_reference_directory() improvements
-- Jaime Nuche <jnuche@wikimedia.org> Mon, 29 Jul 2024 15:47:44 +0200
scap (4.93.0)
* deploy_promote.py: Revise commit message summary
* utils.py: read_wikiversions handle FORCE_MW_VERSION
* Ask for confirmation instead of aborting if Train task status is no good
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 18 Jul 2024 12:01:23 -0700
scap (4.92.0)
* train: allow for the Phab train task status to also be "In Progress"
* sync: Refactor deployment stages
* sync-world: Reformat --k8s-only
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 16 Jul 2024 10:51:16 -0700
scap (4.91.0)
* install-world: Apply -x and -l options to masters list too
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 01 Jul 2024 12:08:18 -0700
scap (4.90.0)
* blubber.yaml: Use blubber/buildkit:v0.24.0
* sync: Prompt for log message if not supplied on command line
* backport: Use interaction.input_line
* interaction: Add input_line()
* Change "Started scap:" to "Started scap sync-world:"
* kubernetes: Make k8s deployment failures fatal
* scap backport: Also allow /r/c/ change URLs
* scap clean: Add --dry-run mode
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 01 Jul 2024 09:28:38 -0700
scap (4.89.0)
* Move logstash checker code into scap
* scap bin: Use /usr/bin/env python3
* kubernetes: Always use replicas:1 in traindev
* kubernetes: Ensure progress reporter is always notified
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 24 Jun 2024 08:44:46 -0700
scap (4.88.0)
* ci: Use experimental-native-llb version of blubber
* deploy-local: Remove "symlink is current" check
* utils.py: write_file_if_needed, temp_to_permanent_file, get_umask
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 18 Jun 2024 11:47:19 -0700
scap (4.87.0)
* deploy: set umask followup
* Set umask at beginning of sync-*, backport, and deploy
* pause_after_testserver_sync: Use commas to separate usernames
* test_backport.py: Revised setup_depends_on_included_in()
* Rename utils.move_symlink to utils.update_symlink
* scap deploy: Fail gracefully if run outside of a git repository
* blubber.yaml: Update 'build-docs' target
* blubber.yaml: Use blubber/buildkit v0.23.0
* git.py: Make is_dir() work for submodule directories (v2)
* test_backport.py: Make "unusual submodule" tests more reliable
* git.py: set_env_vars_for_user: Only set env vars when needed
* backport --revert: Use gerrit_push_user to push revert commit to Gerrit
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 10 Jun 2024 10:19:07 -0700
scap (4.86.1)
* Revert "git.py: Make is_dir() work for submodule directories"
* test_backport.py: Use ssh for Gerrit operations that require auth
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 06 Jun 2024 09:17:02 -0700
scap (4.86.0)
* cli: allow restricted scap commands to run from the releases Jenkins
* backport.py: _create_reverts() tweaks
* git.py: Define remote_set_url and remote_get_url
* git.py: Make is_dir() work for submodule directories
* backport.py: Restore included_in branches check
-- Jaime Nuche <jnuche@wikimedia.org> Wed, 05 Jun 2024 17:02:47 +0200
scap (4.85.0)
* Restrict some scap subcommands to deploy servers only
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 04 Jun 2024 08:07:56 -0700
scap (4.84.0)
* kubernetes: Image build errors are now fatal
* Use version_argument_parser for scap apply-patches
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 03 Jun 2024 07:57:48 -0700
scap (4.83.0)
* scap clean auto: Tweak old version selection logic
* Don't write ANSI reset sequence when terminating if not colorized
* scap clean: Validate branch argument before operating
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 09 May 2024 08:15:48 -0700
scap (4.82.0)
* wikiverisons-on-disk: handle edgecases
* Revise scap clean implementation
* Remove non-running git-fat test
* Makefile: test and test-all targets
* Update dependency versions
* Update tox to new location for build-docs
* .pipeline/blubber.yaml: Revise how test variant is built
* tox.ini: Add 'reformat' environment
* Add test coverage for significant scap clean functions
* Remove unused tasks.get_old_wikiversions()
* CI: Generate and collect test and coverage reports
* tests/scap/plugins/backport.py -> tests/scap/plugins/test_backport.py
* Allow cli.all_commands() to be called more than once.
* test_cli.py: remove useless test_run_as()
* Revive tox.ini. Drop scripts/check
* test_lint.py: Skip two tests if 'php' is not available
* Remove unused subplot test stuff
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 06 May 2024 14:10:13 -0700
scap (4.81.0)
* perform-release: sanity_checks fix
* stage-train: Remove clean stage
* Rewrite release-scripts/perform-release in Python
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 01 May 2024 07:36:50 -0700
scap (4.80.1)
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 26 Apr 2024 13:00:59 -0700
scap (4.80.0)
* Simple k8s deployment progress reporting
* Optionally collect, display, and confirm helmfile diffs
* Very minor fix to ProgressReporter.finish()
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 26 Apr 2024 10:01:38 -0700
scap (4.79.0)
* backport: Fix bad behavior if nonexistent change number is supplied
* release-scripts/generate-changelog: Require user.name and user.email
* backport: Fix capitalization on confirmation prompts
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 24 Apr 2024 07:49:26 -0700
scap (4.78.0)
* Fix: scap backport check prevents using it to fix an about-to-be-live branch
* Allow tests to run on a system that has an /etc/scap.cfg file
* tox.ini: Make 'testenv' useful
* Fix backport tests
-- Sandeep Singh <sandeep.singh@wikimedia.org> Thu, 18 Apr 2024 08:44:43 -0400
scap (4.77.0)
* Add manage_mediawiki_php_symlink config flag
* Consolidate user interactions into interaction.py
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 16 Apr 2024 11:25:32 -0700
scap (4.76.0)
* Run testserver checks in --k8s-only mode
* Support --pause-after-testserver-sync in --k8s-only mode
* Remove unnecessary call to _reset_workspace
* Use Box Drawing unicode chars in scap.history
* Use Box Drawing unicode chars in scap backport
* Add a test-backport command
* test-train table use "=" which look like a track
* Add a test-train command
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 15 Apr 2024 07:59:04 -0700
scap (4.75.0)
* kubernetes: fix helm release in all known pending-* states
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 05 Apr 2024 07:50:43 -0700
scap (4.74.0)
* Support FORCE_COLOR
* deploy-promote: add timeout to loop waiting for version update patch
* Remove FancyProgressReporter
* Stop honoring fancy_progress configuration
-- Antoine Musso <hashar@free.fr> Fri, 05 Apr 2024 15:53:40 +0200
scap (4.73.2)
* prep: fix filter branch in `_select_reference_directory`
* Remove obsolete defaults for git_server
* test: use newish assert_called()
-- Jaime Nuche <jnuche@wikimedia.org> Tue, 26 Mar 2024 10:56:58 +0100
scap (4.73.1)
* prep: filter out pretest branch from candidates for reference clone
* Do not debug log a command exits 0
* test_backport.py: Fix repo name
* Scap Backport: fix scap hang on patches marked with -2
-- Jaime Nuche <jnuche@wikimedia.org> Fri, 22 Mar 2024 10:12:09 +0100
scap (4.73.0)
* sync_masters before k8s deployment
* test_backport.py: Clean up .gitmodules before starting tests.
* test_backport.py: Ensure expected termination message is seen
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 19 Mar 2024 09:33:05 -0700
scap (4.72.0)
* patches: support notifications during the branch cut process
* backport.py: minor refactor
* prep: remove deleted submodules from working tree
* prompt_for_approval_or_exit: Don't announce cancelled operations
-- Jaime Nuche <jnuche@wikimedia.org> Fri, 15 Mar 2024 15:51:57 +0100
scap (4.71.0)
* patches: do not notify security tasks about git failures
* sync-world: Include wikiversions.php in testservers/canaries sync
-- Jaime Nuche <jnuche@wikimedia.org> Mon, 11 Mar 2024 16:30:27 +0100
scap (4.70.1)
* patches: fix patch path for patch failure notifications
-- Jaime Nuche <jnuche@wikimedia.org> Fri, 08 Mar 2024 11:24:39 +0100
scap (4.70.0)
* test-backport: fix extension tests
* scap sync-world: Add support for testserver checks
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 07 Mar 2024 07:54:16 -0800
scap (4.69.0)
* patches: add support for notifying failing security patches
-- Jaime Nuche <jnuche@wikimedia.org> Wed, 06 Mar 2024 13:14:54 +0100
scap (4.68.0)
* Fix "scap lock" for mediawiki
* scap deploy: Remove git-lfs autodetection
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 04 Mar 2024 15:26:24 -0800
scap (4.67.0)
* deploy: Fix git-lfs support (submodules)
* k8s: fix behavior when `--force` flag is supplied to `sync-world`
* Fix longstanding bug in git.next_deploy_tag()
* deploy: Fix git-lfs support
* deploy-local: Initialize self.server_url early
* Handle logstash timeouts separately from spikes in errors reported by logstash
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 28 Feb 2024 08:07:09 -0800
scap (4.66.0)
* Check bare metal and mw-on-k8s canaries
* scap deploy: Remove comment about .scaprc
* canary_checks: Improve format of Waiting for canary traffic message
* Mention how long we're waiting for canary traffic
* Makefile: add 'reformat' target
* scap wikiversions-inuse and wikiversions-compile: Always use the staging directory
* scap update-wikiversions: Add --no-update-php-symlink flag
* git plugin: get url of all git plugins
* backport: improve user feedback when no suitable dep can be found
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 22 Feb 2024 08:20:22 -0800
scap (4.65.3)
* backport: limit what Depends-On changes are considered appropriate
* Fix casing of MediaWiki
-- jnuche <jnuche@wikimedia.org> Mon, 05 Feb 2024 13:16:50 +0100
scap (4.65.2)
* prune old inactive branches as first step of staging a train
-- jnuche <jnuche@wikimedia.org> Fri, 19 Jan 2024 10:09:34 +0100
scap (4.65.1)
* Rephrase k8s disablement message
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 02 Jan 2024 09:21:58 -0800
scap (4.65.0)
* scap backport: Clarify prompt when unexpected commits are pulled
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 01 Dec 2023 07:52:48 -0800
scap (4.64.0)
* Ensure no security patches is an error condition for MediaWiki deploys
* Tests: Always run shellcheck, pytest, flake8, black, and sphinx-build
* Add 'black' to test-requirements.txt
* Reformat sources using black
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 29 Nov 2023 07:48:29 -0800
scap (4.63.0)
* scap: shorten 'synced to testservers' message
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 27 Sep 2023 08:24:49 -0700
scap (4.62.0)
* scap prep auto: Reset mtime of patched files when reapplying patches
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 25 Sep 2023 14:33:31 -0700
scap (4.61.1)
* deploy: backward compatibility for stage 'restart_service'
* update-scap-in-beta: Set umask to 0002
-- jnuche <jnuche@wikimedia.org> Mon, 18 Sep 2023 18:06:49 +0200
scap (4.61.0)
* Add bookworm support
* .gitlab-ci.yml: Factor out the list of supported distros
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 12 Sep 2023 07:46:27 -0700
scap (4.60.0)
* backport tests: add test for concurrent backports
* backport: serialize concurrent backports
-- jnuche <jnuche@wikimedia.org> Mon, 11 Sep 2023 17:15:07 +0200
scap (4.59.0)
* backport: make multiple attempts to continue
* install-world: fix help text for the `--batch` cli argument
-- Jeena Huneidi <jhuneidi@wikimedia.org> Thu, 07 Sep 2023 15:08:39 -0700
scap (4.58.0)
* blubber: pin tox version in `verify-deps` variant
* deploy: disable configured `service_name` on secondary target hosts
-- jnuche <jnuche@wikimedia.org> Thu, 17 Aug 2023 16:49:25 +0200
scap (4.57.0)
* Announce to IRC when "continue with sync" is approved
* utils: drop support for alternative init systems
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 27 Jul 2023 09:38:32 -0700
scap (4.56.0)
* scap prep: Quote path used in update_update_strategy
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 24 Jul 2023 12:57:49 -0700
scap (4.55.0)
* scap prep: Make auto mode usable when a single branch is specified
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 18 Jul 2023 09:17:31 -0700
scap (4.54.0)
* Mention k8s mw-debug deployment if --pause-after-testserver-sync
* backport: add tests for extra commits
* Refactor scap backport tests
* docs/requirements.txt: Pin Pillow to 9.4.0 to work around error
* startup: stop checking for a Python venv
* Update suggested pytest command line
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 17 Jul 2023 08:07:01 -0700
scap (4.53.0)
* backport: Check for updated patch when merging
* backport: fix some bugs from refactor
* scripts/check: Loosen `black` requirements
* Include timestamp on successful stage completion
* scap backport: major refactor
-- jnuche <jnuche@wikimedia.org> Thu, 15 Jun 2023 18:48:08 +0200
scap (4.52.3)
* install_local_version.sh: retry failed venv creation once
* docs: use `docpub` to publish Scap documentation
* backport: Use "warning" instead of "warn"
* scap backport: integration tests
* backport: Don't print git status
-- jnuche <jnuche@wikimedia.org> Fri, 26 May 2023 11:15:12 +0200
scap (4.52.2)
* kubernetes: turn a failed tools-release repo update into a soft error
* deploy-promote: make version matching regex less brittle
-- jnuche <jnuche@wikimedia.org> Tue, 16 May 2023 11:15:29 +0200
scap (4.52.1)
* deploy-promote: fix parsing of non-self closing tag with wiki version
* deploy-promote: improve logging on page version check
* install_local_version.sh: fix bug when restoring installation
* update-scap-in-beta: make script work again
-- jnuche <jnuche@wikimedia.org> Tue, 09 May 2023 17:56:46 +0200
scap (4.52.0)
* Call git submodule sync before git submodule update
* scap train: Include part of train version in image
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 01 May 2023 12:32:10 -0700
scap (4.51.0)
* lock: improve use feedback
* Revert "Exclude deploy servers from target list if /srv/mediawiki is a symlink"
-- jnuche <jnuche@wikimedia.org> Fri, 28 Apr 2023 10:39:19 +0200
scap (4.50.0)
* scap train command
* update-wikiversions: Allow more than one dblist/version pair
* requirements.txt: packaging==23.1
* .gitreview: Convert to gerritlab format
* Revise tasks.get_wikiversions_ondisk()
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 25 Apr 2023 08:19:11 -0700
scap (4.49.0)
* lock: refactored + improved user feedback
* block_execution: do not block all scap commands on host
* Remove sync-pull-masters step
-- jnuche <jnuche@wikimedia.org> Tue, 11 Apr 2023 16:22:40 +0200
scap (4.48.0)
* utils: make `get_current_train_version_from_gerrit` more robust
* rework scap locks
* config: new value to disable Scap execution
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 04 Apr 2023 08:43:12 -0700
scap (4.47.1)
* Fix indentation of build_and_push_images
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 21 Mar 2023 11:58:35 -0700
scap (4.47.0)
* rework K8s deployment workflow
* Fix load-sensitive tests
* .gitlab-ci.yml: reduce number of pipelines when publishing scap images
-- jnuche <jnuche@wikimedia.org> Tue, 21 Mar 2023 10:52:27 +0100
scap (4.46.0)
* Exclude deploy servers from target list if /srv/mediawiki is a symlink
* kubernetes.py: Extract HELM_* env vars from /etc/profile.d/kube-env.sh if available
* Remove an obsolete comment
-- Ahmon Dancy <adancy@wikimedia.org> Mon, 13 Mar 2023 10:00:40 -0700
scap (4.45.0)
* Remove l10nupdate support
-- Ahmon Dancy <adancy@wikimedia.org> Fri, 10 Mar 2023 08:02:33 -0800
scap (4.44.0)
* fix typo
* install-world: add `exclude-hosts` regex argument
* targets: add convenience `exclude_hosts` regex argument
* cleanup: remove leftover PyInstaller code
-- jnuche <jnuche@wikimedia.org> Wed, 08 Mar 2023 18:30:14 +0100
scap (4.43.0)
* Check for PHP notices during mwscript mergeMessageFileList.php
* Make scap pull exit if /srv/mediawiki is a symlink
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 28 Feb 2023 11:45:48 -0800
scap (4.42.0)
* self-installer: overhaul installation mechanism
-- jnuche <jnuche@wikimedia.org> Tue, 28 Feb 2023 10:30:01 +0100
scap (4.41.0)
* .gitlab-ci.yml: fix name of published images
-- jnuche <jnuche@wikimedia.org> Fri, 24 Feb 2023 10:34:10 +0100
scap (4.40.0)
* .gitlab-ci.yml: fix matrix of `publish-dist` job
-- jnuche <jnuche@wikimedia.org> Thu, 23 Feb 2023 17:46:30 +0100
scap (4.39.0)
* binary distributions: use Python wheels to distribute Scap
-- jnuche <jnuche@wikimedia.org> Thu, 23 Feb 2023 16:03:21 +0100
scap (4.38.0)
* Discard stderr noise generated by helm/helmfile
-- Ahmon Dancy <adancy@wikimedia.org> Tue, 21 Feb 2023 10:19:19 -0800
scap (4.37.0)
* Scap backport: Request dependencies for a specific change
* Remove support for deprecated DOLOGMSGNOLOG env var
-- Jeena Huneidi <jhuneidi@wikimedia.org> Thu, 16 Feb 2023 15:50:59 -0800
scap (4.36.0)
* Attempt to autorecover from interrupted helm deployments
-- Ahmon Dancy <adancy@wikimedia.org> Thu, 16 Feb 2023 10:40:08 -0800
scap (4.35.0)
* Don't transmit "aborted" message to IRC if no prior announcement has been made
* scap say: Fix longstanding handling of COLUMNS env var
* Perform k8s deployment before proxies/apaches
* Load section config when host has a trailing dot
* Improve scap.config test coverage
* tox: add a virtualenv for local testing
-- Ahmon Dancy <adancy@wikimedia.org> Wed, 15 Feb 2023 13:06:06 -0800