Skip to content
Build and check Erlang/OTP

ct: Allow running tests more silently / improve ct_run's terminal output #12149

Sign in to view logs

ct: Allow running tests more silently / improve ct_run's terminal output

ct: Allow running tests more silently / improve ct_run's terminal output #12149

Triggered via pull request August 11, 2023 09:25
@jchristgitjchristgit
synchronize #7375
jchristgit:more-silent-tests
Status Failure
Total duration 2h 44m 44s
Artifacts 14

main.yaml

on: pull_request
Build Erlang/OTP (64-bit)
18m 1s
Build Erlang/OTP (64-bit)
Event File
1s
Event File
Matrix: Test Erlang/OTP
Build and check documentation
9m 32s
Build and check documentation
Build Erlang/OTP (macOS)
11m 48s
Build Erlang/OTP (macOS)
Build Erlang/OTP (iOS)
10m 34s
Build Erlang/OTP (iOS)
Build Erlang/OTP (Windows)
20m 7s
Build Erlang/OTP (Windows)
Build Erlang/OTP (Types and Flavors)
13m 54s
Build Erlang/OTP (Types and Flavors)
Run static analysis
10m 20s
Run static analysis
Matrix: Build Erlang/OTP
Test Erlang/OTP (system)
14m 52s
Test Erlang/OTP (system)
Release Erlang/OTP
0s
Release Erlang/OTP
Fit to window
Zoom out
Zoom in

Annotations

4 errors, 90 warnings, and 2 notices
Build and check documentation
Process completed with exit code 2.
Run static analysis
Process completed with exit code 2.
Test Erlang/OTP (kernel)
Process completed with exit code 2.
Test Erlang/OTP (common_test)
Process completed with exit code 2.
test_server_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_parallel01_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_conf02_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_conf01_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_skip_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_shuffle01_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_break_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_cover_SUITE failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
test_server_unicode failed: lib/common_test/test/test_server_SUITE.erl#L236
artifacts/Unit Test Results/common_test_junit.xml
pre_init_per_testcase failed: lib/common_test/test/ct_util_SUITE.erl#L172
artifacts/Unit Test Results/common_test_junit.xml
unicode_atoms_SUITE failed: lib/common_test/test/ct_unicode_SUITE.erl#L98
artifacts/Unit Test Results/common_test_junit.xml
start_separate failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L102
artifacts/Unit Test Results/common_test_junit.xml
start_join failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L110
artifacts/Unit Test Results/common_test_junit.xml
incl_separate1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L118
artifacts/Unit Test Results/common_test_junit.xml
incl_separate2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L123
artifacts/Unit Test Results/common_test_junit.xml
incl_join1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L131
artifacts/Unit Test Results/common_test_junit.xml
incl_join2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L136
artifacts/Unit Test Results/common_test_junit.xml
incl_both1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L144
artifacts/Unit Test Results/common_test_junit.xml
incl_both2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L149
artifacts/Unit Test Results/common_test_junit.xml
incl_both_and_join1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L157
artifacts/Unit Test Results/common_test_junit.xml
incl_both_and_join2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L162
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_separate1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L170
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_separate2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L175
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_join1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L183
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_join2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L188
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_separate_join1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L197
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_separate_join2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L202
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_join_separate1 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L211
artifacts/Unit Test Results/common_test_junit.xml
rec_incl_join_separate2 failed: lib/common_test/test/ct_testspec_3_SUITE.erl#L216
artifacts/Unit Test Results/common_test_junit.xml
testcase_many_groups failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_tests_many_dirs_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_tests_many_suites_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_suites_many_dirs_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_groups_many_dirs_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_groups_many_suites_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_tests_many_dirs failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_tests_many_suites failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_suites_many_dirs failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_groups_many_dirs failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_groups_many_suites failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_tests_many_suites_with_skip_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
order_of_tests_many_suites_with_skip failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
all_plus_one_tc_no_merge_tests failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
all_plus_one_tc failed: lib/common_test/test/ct_testspec_1_SUITE.erl#L665
artifacts/Unit Test Results/common_test_junit.xml
ts_if_1 failed: lib/common_test/test/ct_test_server_if_1_SUITE.erl#L98
artifacts/Unit Test Results/common_test_junit.xml
All 4 runs failed: faulty_regexp: lib/common_test/test/ct_telnet_SUITE.erl#L169
artifacts/Unit Test Results/common_test_junit.xml artifacts/Unit Test Results/common_test_junit.xml artifacts/Unit Test Results/common_test_junit.xml artifacts/Unit Test Results/common_test_junit.xml
All 2 runs failed: timetrap: lib/common_test/test/ct_telnet_SUITE.erl#L169
artifacts/Unit Test Results/common_test_junit.xml artifacts/Unit Test Results/common_test_junit.xml
repeat failed: lib/common_test/test/ct_tc_repeat_SUITE.erl#L78
artifacts/Unit Test Results/common_test_junit.xml
repeat_cs_until_any_ok failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_gr_until_any_ok failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_cs_until_any_fail failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_gr_until_any_fail failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_cs_until_all_ok failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_gr_until_all_ok failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_cs_until_all_fail failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_gr_until_all_fail failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_seq_until_any_fail failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
repeat_shuffled_seq_until_any_fail failed: lib/common_test/test/ct_repeat_1_SUITE.erl#L158
artifacts/Unit Test Results/common_test_junit.xml
beam_me_up failed: lib/common_test/test/ct_misc_1_SUITE.erl#L109
artifacts/Unit Test Results/common_test_junit.xml
failed_sequence failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
update_result_cth failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
fail_post_init_tc_cth failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
illegal_values_all failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
bad_return_all failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
bad_return_groups failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
crash_all failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
crash_groups failed: lib/common_test/test/ct_hooks_SUITE.erl#L513
artifacts/Unit Test Results/common_test_junit.xml
simple_group_opt failed: lib/common_test/test/ct_groups_spec_SUITE.erl#L121
artifacts/Unit Test Results/common_test_junit.xml
override_with_all failed: lib/common_test/test/ct_groups_spec_SUITE.erl#L121
artifacts/Unit Test Results/common_test_junit.xml
override_with_spec failed: lib/common_test/test/ct_groups_spec_SUITE.erl#L121
artifacts/Unit Test Results/common_test_junit.xml
timetrap_all failed: lib/common_test/test/ct_group_info_SUITE.erl#L176
artifacts/Unit Test Results/common_test_junit.xml
timetrap_group failed: lib/common_test/test/ct_group_info_SUITE.erl#L176
artifacts/Unit Test Results/common_test_junit.xml
timetrap_group_case failed: lib/common_test/test/ct_group_info_SUITE.erl#L176
artifacts/Unit Test Results/common_test_junit.xml
timetrap_all_no_ips failed: lib/common_test/test/ct_group_info_SUITE.erl#L176
artifacts/Unit Test Results/common_test_junit.xml
timetrap_all_no_ipg failed: lib/common_test/test/ct_group_info_SUITE.erl#L176
artifacts/Unit Test Results/common_test_junit.xml
results failed: lib/common_test/test/ct_event_handler_SUITE.erl#L149
artifacts/Unit Test Results/common_test_junit.xml
cfg_error failed: lib/common_test/test/ct_error_SUITE.erl#L108
artifacts/Unit Test Results/common_test_junit.xml
lib_error failed: lib/common_test/test/ct_error_SUITE.erl#L127
artifacts/Unit Test Results/common_test_junit.xml
no_compile failed: lib/common_test/test/ct_error_SUITE.erl#L146
artifacts/Unit Test Results/common_test_junit.xml
timetrap_end_conf failed: lib/common_test/test/ct_error_SUITE.erl#L164
artifacts/Unit Test Results/common_test_junit.xml
timetrap_normal failed: lib/common_test/test/ct_error_SUITE.erl#L185
artifacts/Unit Test Results/common_test_junit.xml
timetrap_extended failed: lib/common_test/test/ct_error_SUITE.erl#L208
artifacts/Unit Test Results/common_test_junit.xml
timetrap_fun failed: lib/common_test/test/ct_error_SUITE.erl#L247
artifacts/Unit Test Results/common_test_junit.xml
timetrap_fun_group failed: lib/common_test/test/ct_error_SUITE.erl#L265
artifacts/Unit Test Results/common_test_junit.xml
timetrap_with_float_mult failed: lib/common_test/test/ct_error_SUITE.erl#L287
artifacts/Unit Test Results/common_test_junit.xml
1 out of 2 runs failed: misc_errors: lib/common_test/test/ct_error_SUITE.erl#L305
artifacts/Unit Test Results/common_test_junit.xml
config_restored failed: lib/common_test/test/ct_error_SUITE.erl#L324
artifacts/Unit Test Results/common_test_junit.xml
ac_flag failed: lib/common_test/test/ct_auto_compile_SUITE.erl#L95
artifacts/Unit Test Results/common_test_junit.xml
ac_spec failed: lib/common_test/test/ct_auto_compile_SUITE.erl#L124
artifacts/Unit Test Results/common_test_junit.xml
1 out of 2 runs failed: app_file: lib/common_test/test/ct_SUITE.erl#L47
artifacts/Unit Test Results/common_test_junit.xml
65 skipped tests found
There are 65 skipped tests, see "Raw output" for the full list of skipped tests.
1909 tests found
There are 1909 tests, see "Raw output" for the full list of tests.

Artifacts

Produced during runtime
Name Size
Event File Expired
32.9 KB
Unit Test Results Expired
1.16 MB
common_test_test_results Expired
603 MB
debug_test_results Expired
256 KB
emulator_test_results Expired
16.8 MB
ios_framework_aarch64-apple-ios Expired
4.51 MB
kernel_test_results Expired
21.8 MB
otp_doc_html Expired
35.7 MB
otp_doc_man Expired
1.67 MB
otp_git_archive Expired
60.8 MB
otp_prebuilt Expired
233 MB
otp_prebuilt_macos_x86-64 Expired
58.8 MB
otp_win32_installer Expired
77.3 MB
test_results Expired
721 MB