Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog and this project adheres to Semantic Versioning.

API

The API consists of all public Java types from com.atlassian.performance.tools.jiraperformancetests.api and its subpackages:

source compatibility
binary compatibility
behavioral compatibility with behavioral contracts expressed via Javadoc

Unreleased

[2.0.2] - 2018-12-18 🎂

Fixed

Timeline for OnPremisePerformanceTest. Resolve JPERF-309.

2.0.1 - 2018-12-17 🎄

Fixed

Enable diagnostics for OnPremisePerformanceTest. Resolve JPERF-232.

2.0.0 - 2018-12-03

Added

Allow JPT to instantiate different browsers which resolves JPERF-169.
Add support for virtual-users:3.3.4.
Add support for infrastructure:4.
Add support for aws-infrastructure:2 which resolves JPERF-280.

Removed

Drop deprecated classes AppRegressionTest,AwsPluginTester and BtfJiraPerformanceMeter.
Drop support of virtual-users:2.
Drop support of infrastructure:2.
Drop support of aws-infrastructure:1.
Remove Kotlin data-class generated methods from API.

1.3.0 - 2018-10-31

Added

Expose setAllowInsecureConnections in OnPremisePerformanceTest. Work around JPERF-196.

1.2.1 - 2018-10-16

Deprecated

Deprecate the intermediate app test APIs. Promote the high-level API and low-level API instead.

1.2.0

Added

Add an option to test on premise Jira with custom test scenario, which resolves JPERF-84.
Accept any AppSource in AppImpactTest. Work around JPERF-93.
Support testing locally built apps. Work around JPERF-93.

Fixed

Works around JPERF-83.

1.1.0

Added

Add a way to test on premise Jira instance which resolves JPERF-16

1.0.0

0.1.2

Changed

Use stable APIs.

Added

Added AwsHousekeeping to the API.

0.1.1

Added

Allow throttling virtual user diagnostics.

Changed

Define the public API.

0.1.0

Changed

Reshape JiraPerformanceTest into AppImpactTest.

Added

Choose deployment for Jira and number of nodes for DC.

Fixed

Expect a correct report count.
Force updating snapshots when running testRefApp.
Hint how to customize the AppImpactTest.
Depend on a stable version of APT infrastructure.
Depend on a stable version of APT report.

0.0.3

Added

Allow running performance tests without extra Jira apps installed.
Generate charts in app tests. JPERF-9.
Explain contribution guidelines.

Fixed

Correctly label the experiment test cohort.
Distinguish between cohorts even if we test the same version of a plugin. JPERF-7.
Allow tests to consume custom datasets created within the same task.
Fix scanner errors in log. See JPERF-10.
Print a full stack trace when ref app fails. JPERF-8.

0.0.2 - 2018-08-08

Fixed

Add the missing virtual users main class. See JPERF-2.

0.0.1 - 2018-08-07

Added

Migrate high-level test API from JPT submodule.
Add README.md.
Add this changelog.
Enable Bitbucket Pipelines.