Skip to content

Releases: m-lab/etl

Add hop annotations for paris-traceroute

03 Feb 21:22
84187df
Compare
Choose a tag to compare

Add hopannotation1 to paris traceroute (#1047)

Diff prod-v2.13.0...prod-v2.14.0

Metric renaming and delete extra appengine services

18 Jan 18:34
8a7deb0
Compare
Choose a tag to compare

fix file size bins (#1036)
Rename metric to etl_task_total (#1040)
Add script to delete extra appengine services (#1042)
Do not prompt for user feedback (#1043)

Diff prod-v2.12.0...v2.13.0

Support annotation & hopannotation1 exports

08 Dec 20:52
6b71af1
Compare
Choose a tag to compare

Do not append to local-mode files (#1027)
Allow parsing third-party archives (#1029)
First step in expanding pcap parser (#1031)
Add hopannotation1 schema to legacy ndt/traceroute table schema (#1030)

Diff prod-v2.11.0...prod-v2.12.0

Add scamper1 parser changes

27 Oct 15:52
f611371
Compare
Choose a tag to compare

Add changes for scamper1 schema definition (#1020)
Update and clean up dependencies (#1023)
Add parser for scamper1 datatype (#1021)
Remove hopannotation1 schema stub (#1024)

Diff prod-v2.9.2...prod-v2.11.0

Add parser for hopannotation1 and decrease number of parser replicas

25 Aug 20:27
336637c
Compare
Choose a tag to compare

Add missing filename to ParseInfo for tcpinfo (#1017)
Decrease number of parser replicas to 4 (#1018)
Add parser for hopannotation1 datatype (#1015)

Diff prod-v2.9.1...prod-v2.9.2

Update pcap parser processing rate to 1 in 10 archives and add flag to Dockerfile

19 Aug 18:27
59eacd2
Compare
Choose a tag to compare

Update pcap parser processing rate to 1 in 10 archives (#1014)
add --allow-releaseinfo-change flag to update (#1016)

prod-v2.8.0...prod-v2.9.1

Update pcap parser processing rate to 1 in 10 archives

19 Aug 18:13
81507c8
Compare
Choose a tag to compare

Update pcap parser processing rate to 1 in 10 archives (#1014)

prod-v2.8.0...prod-v2.9.0

Add PCAP index and increase reprocessing rate in legacy pipeline

05 Aug 14:08
c7c6ced
Compare
Choose a tag to compare

Add schema for pcap index (#1009)
Increase legacy batch processing (#1010)
Upload archive to mlab-testing before integration testing (#1011) …
Add parser for pcap index (#1012)
Increase number of parser replicas to 6 (#1013)

Diff prod-v2.7.0...prod-v2.8.0

Changes for annotation export and GitCommit field

20 Jul 15:20
7dfac2f
Compare
Choose a tag to compare

Add support for storage.LocalWriter (#991)
Add method for GCS Path for DataPath type (#993)
Add handler for local output mode (#994)
Update annotation-service to latest (#995)
Add siteinfo reloading (#996)
Update annotation-service version to include fix (#997)
Add synthetic UUIDs for legacy datatypes (#998)
Add ServerX and ClientX annotation fields to ndt.web100 schema and parser (#999)
Add ServerX and ClientX annotation fields to sidestream schema and parser (#1000)
Add NormalizeIP to sidestream parsing (#1001)
Add annotation_url flag for local development (#1002)
Set ServerX fields for Site and Machine (#1003)
Add ServerX and ClientX annotation records to tcpinfo and traceroute schemas (#1004)
Add parser.GitCommit field into ParseInfo struct (#1005)
NormalizeIP for traceroute parser (#1006)
Complete unit tests for ServerX and ClientX records in tcpinfo and pt parsers (#1007)

List of changes prod-v2.6.0...prod-v2.7.0

Update prior to schema changes

03 May 20:21
b5ab8e8
Compare
Choose a tag to compare

This release should represent the last prod release using the older schemas prior to the schema expansion for the annotation-service.

Remove use of go-bindata for etl schema descriptions (#968) …
Create go.mod and move appengine/queue_pusher to a dedicated repository (#969)
Get rid of the extra double-quotes in JSON string values (#971)
Prepare for cloudbuild migration 1 of 2 (#972)
Complete etl deployment migration to cloudbuild.yaml 2 of 2 (#973)
Start parsing ".json" files (#976)
Improve package test function names (#975)
remove etl-schema submodule (#979)
Sandbox opt gomod (#980)
Adjust K8S parsers to use 15 cpus (#981)
Sandbox dead code (#977)
Add support for retired sites' annotations (#982)
Add sidestream to BQ update-schema (#987)
Add NDTWeb100 struct to mirror current BQ schema (#988)