performance report

[Cylix]

test/performance/test_perf_result contains performance of each test file

test/performance/test_perf.rb is run only for PR and will do the following:

• checkout test_perf_result from master branch
• run each test file and compare execution time
• report major changes (increase or decrease) by commenting on the PR
• commit the updated report and push to the PR

Unfortunately, seems there is not some 3rd part services to provide better ways for such report.
We can decide wether or not it is worth keeping this mechanism or not.

[Cylix]

Performance degradation report

../../build/bin/responses_were_addresses_spent_from_test: was 0.0, now 0.002673413 (+Inf%)
../../build/bin/core_get_trytes_test: was 0.0, now 0.074619049 (+Inf%)
../../build/bin/core_get_transactions_to_approve_test: was 0.0, now 0.052522042 (+Inf%)
../../build/bin/core_get_balances_test: was 0.0, now 0.030051051 (+Inf%)
../../build/bin/extended_send_transfer_test: was 0.0, now 15.595613762 (+Inf%)
../../build/bin/models_transfer_test: was 0.0, now 0.00297322 (+Inf%)
../../build/bin/responses_get_node_info_test: was 0.0, now 0.00253447 (+Inf%)
../../build/bin/utils_stop_watch_test: was 0.0, now 14.003987851 (+Inf%)
../../build/bin/extended_initiate_transfer_test: was 0.0, now 0.147724112 (+Inf%)
../../build/bin/responses_get_tips_test: was 0.0, now 0.002230168 (+Inf%)
../../build/bin/requests_get_inclusion_states_test: was 0.0, now 0.002160395 (+Inf%)
../../build/bin/responses_add_neighbors_test: was 0.0, now 0.002024402 (+Inf%)
../../build/bin/responses_send_transfer_test: was 0.0, now 0.00203437 (+Inf%)
../../build/bin/core_get_node_info_test: was 0.0, now 0.017016791 (+Inf%)
../../build/bin/core_were_addresses_spent_from_test: was 0.0, now 0.05861448 (+Inf%)
../../build/bin/extended_is_reattachable_test: was 0.0, now 3.434427288 (+Inf%)
../../build/bin/errors_illegal_state_test: was 0.0, now 0.002237674 (+Inf%)
../../build/bin/extended_get_transactions_objects_test: was 0.0, now 0.036048461 (+Inf%)
../../build/bin/core_interrupt_attaching_to_tangle_test: was 0.0, now 4.023164518 (+Inf%)
../../build/bin/models_tag_test: was 0.0, now 0.002586472 (+Inf%)
../../build/bin/extended_get_latest_inclusion_test: was 0.0, now 0.051134751 (+Inf%)
../../build/bin/responses_get_transactions_to_approve_test: was 0.0, now 0.002579033 (+Inf%)
../../build/bin/extended_is_promotable_test: was 0.0, now 0.045838763 (+Inf%)
../../build/bin/models_seed_test: was 0.0, now 0.002818129 (+Inf%)
../../build/bin/requests_get_neighbors_test: was 0.0, now 0.002317921 (+Inf%)
../../build/bin/models_neighbor_test: was 0.0, now 0.002360679 (+Inf%)
../../build/bin/errors_generic_test: was 0.0, now 0.002276989 (+Inf%)
../../build/bin/responses_get_balances_test: was 0.0, now 0.00232869 (+Inf%)
../../build/bin/responses_get_balances_and_format_test: was 0.0, now 0.002480821 (+Inf%)
../../build/bin/requests_check_consistency_test: was 0.0, now 0.002302962 (+Inf%)
../../build/bin/requests_get_trytes_test: was 0.0, now 0.002287192 (+Inf%)
../../build/bin/requests_base_test: was 0.0, now 0.002208943 (+Inf%)
../../build/bin/responses_get_trytes_test: was 0.0, now 0.002103742 (+Inf%)
../../build/bin/responses_get_transfers_test: was 0.0, now 0.002068923 (+Inf%)
../../build/bin/extended_send_trytes_test: was 0.0, now 4.248804643 (+Inf%)
../../build/bin/extended_bundles_from_addresses_test: was 0.0, now 0.308622726 (+Inf%)
../../build/bin/responses_check_consistency_test: was 0.0, now 0.002088344 (+Inf%)
../../build/bin/extended_find_transaction_objects_by_bundle_test: was 0.0, now 0.061152426 (+Inf%)
../../build/bin/crypto_pow_test: was 0.0, now 8.125748669 (+Inf%)
../../build/bin/responses_get_account_data_test: was 0.0, now 0.002368888 (+Inf%)
../../build/bin/requests_get_balances_test: was 0.0, now 0.002037807 (+Inf%)
../../build/bin/requests_add_neighbors_test: was 0.0, now 0.001962252 (+Inf%)
../../build/bin/core_store_transactions_test: was 0.0, now 2.063053968 (+Inf%)
../../build/bin/extended_get_transfers_test: was 0.0, now 0.500654961 (+Inf%)
../../build/bin/core_broadcast_transactions_test: was 0.0, now 2.064208122 (+Inf%)
../../build/bin/models_address_test: was 0.0, now 0.002783341 (+Inf%)
../../build/bin/core_neighbors_test: was 0.0, now 0.05454215 (+Inf%)
../../build/bin/requests_get_tips_test: was 0.0, now 0.002321864 (+Inf%)
../../build/bin/responses_get_new_addresses_test: was 0.0, now 0.00234684 (+Inf%)
../../build/bin/crypto_curl_test: was 0.0, now 0.009824984 (+Inf%)
../../build/bin/core_get_inclusions_states_test: was 0.0, now 0.058152284 (+Inf%)
../../build/bin/responses_find_transactions_test: was 0.0, now 0.002415209 (+Inf%)
../../build/bin/core_get_tips_test: was 0.0, now 0.016515135 (+Inf%)
../../build/bin/crypto_signing_test: was 0.0, now 0.00270949 (+Inf%)
../../build/bin/models_transaction_test: was 0.0, now 0.007840742 (+Inf%)
../../build/bin/responses_remove_neighbors_test: was 0.0, now 0.00428531 (+Inf%)
../../build/bin/extended_get_new_addresses_test: was 0.0, now 0.30295796 (+Inf%)
../../build/bin/extended_get_account_data_test: was 0.0, now 0.799443023 (+Inf%)
../../build/bin/responses_base_test: was 0.0, now 0.002369885 (+Inf%)
../../build/bin/crypto_kerl_test: was 0.0, now 0.002272641 (+Inf%)
../../build/bin/requests_find_transactions_test: was 0.0, now 0.002468121 (+Inf%)
../../build/bin/extended_prepare_transfers_test: was 0.0, now 0.559005646 (+Inf%)
../../build/bin/responses_get_bundle_test: was 0.0, now 0.002204882 (+Inf%)
../../build/bin/crypto_multi_signing_test: was 0.0, now 0.028989643 (+Inf%)
../../build/bin/responses_get_neighbors_test: was 0.0, now 0.00224885 (+Inf%)
../../build/bin/extended_get_balances_and_format_test: was 0.0, now 0.032527705 (+Inf%)
../../build/bin/requests_interrupt_attaching_to_tangle_test: was 0.0, now 0.002199682 (+Inf%)
../../build/bin/requests_store_transactions_test: was 0.0, now 0.001986044 (+Inf%)
../../build/bin/models_signature_test: was 0.0, now 0.002157005 (+Inf%)
../../build/bin/core_attach_to_tangle_test: was 0.0, now 6.174935276 (+Inf%)
../../build/bin/extended_get_bundle_test: was 0.0, now 0.13890563 (+Inf%)
../../build/bin/extended_replay_bundle_test: was 0.0, now 2.10854185 (+Inf%)
../../build/bin/errors_bad_request_test: was 0.0, now 0.002255862 (+Inf%)
../../build/bin/requests_remove_neighbors_test: was 0.0, now 0.00194235 (+Inf%)
../../build/bin/responses_replay_bundle_test: was 0.0, now 0.001901126 (+Inf%)
../../build/bin/errors_network_test: was 0.0, now 0.001898647 (+Inf%)
../../build/bin/requests_get_transactions_to_approve_test: was 0.0, now 0.001977679 (+Inf%)
../../build/bin/errors_crypto_test: was 0.0, now 0.0018472 (+Inf%)
../../build/bin/core_check_consistency_test: was 0.0, now 0.043053724 (+Inf%)
../../build/bin/requests_get_node_info_test: was 0.0, now 0.002219457 (+Inf%)
../../build/bin/requests_were_addresses_spent_from_test: was 0.0, now 0.002148877 (+Inf%)
../../build/bin/core_find_transactions_test: was 0.0, now 0.050835434 (+Inf%)
../../build/bin/extended_find_transactions_test: was 0.0, now 0.04339799 (+Inf%)
../../build/bin/crypto_keccak384_test: was 0.0, now 0.002274911 (+Inf%)
../../build/bin/types_trinary_test: was 0.0, now 0.002403102 (+Inf%)
../../build/bin/extended_get_inputs_test: was 0.0, now 0.16328698 (+Inf%)
../../build/bin/extended_add_remainder_test: was 0.0, now 0.281219814 (+Inf%)
../../build/bin/extended_find_transaction_objects_test: was 0.0, now 0.064035028 (+Inf%)
../../build/bin/extended_broadcast_and_store_test: was 0.0, now 4.077830567 (+Inf%)
../../build/bin/errors_internal_server_error_test: was 0.0, now 0.002134477 (+Inf%)
../../build/bin/models_bundle_test: was 0.0, now 0.028806677 (+Inf%)
../../build/bin/extended_traverse_bundle_test: was 0.0, now 0.085511965 (+Inf%)
../../build/bin/errors_unrecognized_test: was 0.0, now 0.002120729 (+Inf%)
../../build/bin/requests_attach_to_tangle_test: was 0.0, now 0.001955771 (+Inf%)
../../build/bin/errors_unauthorized_test: was 0.0, now 0.002027241 (+Inf%)
../../build/bin/responses_get_inclusion_states_test: was 0.0, now 0.001831769 (+Inf%)
../../build/bin/responses_attach_to_tangle_test: was 0.0, now 0.001852293 (+Inf%)
../../build/bin/requests_broadcast_transactions_test: was 0.0, now 0.001973562 (+Inf%)