Skip to content

Commit

Permalink
Updated CHANGELOG, README, and version for 0.3.1 release
Browse files Browse the repository at this point in the history
  • Loading branch information
dmjoy committed Mar 18, 2024
1 parent a0b77d0 commit c9c2b2a
Show file tree
Hide file tree
Showing 3 changed files with 37 additions and 43 deletions.
20 changes: 20 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,26 @@
This changelog follows the specifications detailed in: [Keep a Changelog](https://keepachangelog.com/en/1.0.0/).
This project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html), although we have not yet reached a `1.0.0` release.

## 0.3.1

### Added

* Added new Random ADM (action based; chooses random action and action parameters)
* Added additional metrics evaluation candidate ADM configs
* Added logging for final scenario state (alignment scores are provided there in the unstructured field)

### Changed

* Changed the TA3ActionBased interface class to accept a list of scenario IDs to work through (rather than an individual scenario ID)
* No longer restricting the SITREP action based on unvisited and conscious characters

### Fixed

* Fixed issue where Llama2SingleKDMAADM tagging selection could choose an invalid tag
* Not allowing actions that require a character ID to be taken when no characters exist
* Handling rare corner case where generic APPLY_TREATMENT action could be repeated forever
* Fixed mentions of "continuation of care" in maximization prompts

## 0.3.0

### Added
Expand Down
58 changes: 16 additions & 42 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -170,62 +170,36 @@ run_simplified_align_system LocalFiles \

## Metrics Evaluation ADM Invocations

### Aligned ADM for ADEPT scenarios
### Baseline ADM

```
run_action_based_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/single_kdma_adm_adept.yml \
--username single_kdma_aligned_adm_adept \
--align-to-target \
--session-type adept
```

### Aligned Hybrid Kaleido ADM for ADEPT scenarios

```
run_action_based_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/hybrid_kaleido.yml \
--username hybrid_kaleido_aligned_adm_adept \
--align-to-target \
--session-type adept
```

### Baseline ADM for ADEPT scenarios

```
run_action_based_align_system TA3ActionBased \
run_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/single_kdma_adm_baseline.yml \
--username single_kdma_baseline_adm_adept \
--session-type adept
--username kitware-single-kdma-adm-baseline \
--session-type eval \
--api_endpoint "http://127.0.0.1:8080" # URL for TA3 Server
```

### Aligned ADM for SoarTech scenarios
### Aligned ADM 1 (Single KDMA ADM No Negatives)

```
run_action_based_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/single_kdma_adm_soartech.yml \
--username single_kdma_aligned_adm_soartech \
run_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/single_kdma_adm_adept.yml \
--username kitware-single-kdma-adm-aligned-no-negatives \
--align-to-target \
--session-type soartech
--session-type eval \
--api_endpoint "http://127.0.0.1:8080" # URL for TA3 Server
```

### Aligned Hybrid Kaleido ADM for SoarTech scenarios
### Aligned ADM 2 (Hybrid Kaleido ADM)

```
run_action_based_align_system TA3ActionBased \
run_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/hybrid_kaleido.yml \
--username hybrid_kaleido_aligned_adm_soartech \
--username kitware-hybrid-kaleido-aligned \
--align-to-target \
--session-type soartech
```

### Baseline ADM for SoarTech scenarios

```
run_action_based_align_system TA3ActionBased \
--adm-config adm_configs/metrics-evaluation/delivered/single_kdma_adm_baseline.yml \
--username single_kdma_baseline_adm_soartech \
--session-type soartech
--session-type eval \
--api_endpoint "http://127.0.0.1:8080" # URL for TA3 Server
```


Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "align-system"
version = "0.3.0"
version = "0.3.1"
description = ""
authors = ["David Joy <10147749+dmjoy@users.noreply.github.com>"]
readme = "README.md"
Expand Down

0 comments on commit c9c2b2a

Please sign in to comment.