0.7.0

• PR #546 cmd/task/create: fix stdin pipe
• PR #544 tes: add task hash
• PR #542 web/dashboard: fix task list name overflow
• PR #540 cmd/run: remove "extra" args
• PR #535 webdash: fix syslog parser regex
• PR #533 cmd/task/create: read tasks from stdin
• PR #532 storage/swift: default chunk size of 500MB
• PR #530 config: handle error from ToYaml
• PR #529 config: fix duration flag parsing
• PR #528 config: use time.ParseDuration for duration strings
• PR #526 cmd: add completion command for bash completion
• PR #522 webdash: update url with filter params and keep after reload

Docker images

• docker pull ohsucompbio/funnel:0.7.0

---

Automated with GoReleaser
Built with go version go1.10 darwin/amd64

0.6.2

• PR #521 webdash: fix nextPage button; cleanup

Docker images

• docker pull ohsucompbio/funnel:0.6.2

---

Automated with GoReleaser
Built with go version go1.10 darwin/amd64

0.6.1

• PR #519 webdash: fixed elapsedTime calculation

Docker images

• docker pull ohsucompbio/funnel:0.6.1

---

Automated with GoReleaser
Built with go version go1.10 darwin/amd64

0.6.0

• PR #514 build: fix release notes command
• PR #513 Webdash upgrades
• PR #512 worker/docker: log container metadata
• PR #511 Unexport
• PR #510 build: goreleaser, 0.6.0, github release notes gen
• PR #508 fix for stdout/err log tail collection
• PR #507 auth: update default config and website docs
• PR #506 storage: use an io.Reader that utilizes context
• PR #505 server: configurable user for basic auth
• PR #502 databases: fix for task log metadata overwrite
• PR #501 worker: parallelize downloads and uploads
• PR #500 worker: always mount to /tmp in container
• PR #499 batch: fix nil panic when no resources are requested
• PR #498 Server run event writer initialization bug fix
• PR #492 dynamodb/datastore: syslogs in full task view
• PR #491 worker: more config options around stdout/err logging
• PR #489 server/elastic: fix tag filter to use keyword
• PR #488 compute/batch: fix panic when resources are requested
• PR #487 databases: added Init method to interface
• PR #486 api/cancel: handle event in compute backend first to allow for state check
• PR #483 api/tes: validate tags, require non-empty key
• PR #482 upgraded the databases to handle concurrent task state updates
• PR #471 api/tes: ListTask tag filters
• PR #469 use goimports to 'tidy' and 'lint' commands
• PR #467 webdash: debug/dev script
• PR #465 events/pubsub: google pub/sub event writer
• PR #464 compute/scheduler: fix node task cleanup restart edge case
• PR #461 storage: bug fixes
• PR #460 webdash: render newline in system logs
• PR #458 webdash: add all task fields
• PR #457 fix signal handling delay for cancelling the entrypoint context
• PR #455 compute/scheduler: fix nil panic on error log
• PR #454 logger/grpc: set most grpc logs to debug
• PR #453 api/tes: ListTasks state filter
• PR #446 server: correctly handle cancel event for manual backend
• PR #443 storage/local: directories were not downloaded correctly
• PR #441 build: remove unused github token
• PR #440 compute: reconcile task states with external queues
• PR #439 compute: cancel queued tasks; log failed Compute.Submit calls
• PR #438 Entrypoint cleanup; return an error from Worker.Run
• PR #437 grpc: less logging
• PR #436 test Scheduler.ReadQueue sort oder
• PR #435 mongo: ensure sort order; tests: check sort order
• PR #434 Vendor upgrade
• PR #431 worker/rpc: close rpc clients

Docker images

• docker pull ohsucompbio/funnel:0.6.0

---

Automated with GoReleaser
Built with go version go1.10 darwin/amd64

0.5.0

Changes: 0.4.1...0.5.0
Milestone: https://github.com/ohsu-comp-bio/funnel/milestone/3?closed=1

• Breaking changes
  • Configuration
    • The configuration file structure has been refactored to simplify, remove large duplicated blocks and deep nesting. Most structures live at the root level now.
    • Added some basic config validation to catch misspelled or unknown fields, a common source of issues.
• Failure tolerance
  • Added retries with exponential backoff and jitter to database and RPC clients.
• Databases
  • Added Google Cloud Datastore database backend.
• Events
  • Added “task created” event type.
  • Added full support for writing events to Kafka.
  • Added storage of system log events.
• Web dashboard
  • Display per-task system logs.
  • Tweaked display of large text fields such as stdout/err and input content.
• Storage
  • Ensure all file handles are closed consistently.
  • Added retries to Swift storage.
  • Produce warning on empty directory download.
  • Better defaults for chunk size in Swift backend.
  • Added generic S3 (i.e. not Amazon S3) storage backend/client, based on the Minio client library.
  • Also added the ability to configure/enable multiple, separate S3 backends simultaneously.
  • Added HTTP storage backend, which currently supports read-only operations (write/put is not supported).
• Removed the autoscaler code. This code was getting old and outdated, and nobody seemed to be using it. A fresh version will be rewritten in the future.
• Lots of other bugfixes.

0.4.1

Changes: 0.4.0...0.4.1
Milestone: https://github.com/ohsu-comp-bio/funnel/milestone/4?closed=1

Notes:

• Fix for regression in Elasticsearch scheduler database backend.

0.4.0

Changes: 0.3.0...0.4.0
Milestone: https://github.com/ohsu-comp-bio/funnel/milestone/2?closed=1

Notes:

• Upgrade task API to TES v0.3
• Added MongoDB support.
• Added Kafka event stream support.
• Bug fix for OutputFileLog path.
• Rewrote TES HTTP client to match gRPC client.
• Web dashboard cleanup and fixes: style cleanup, pagination fixes.
• Scheduler performance and scalability improvements, concurrency fixes.
• Pagination support in CLI and clients.
• Executor stdout/err tail performance and scalability improvements.
• Remove network inspection and logging of host IP and docker ports.
  Remove port requests. Part of TES v0.3.
• cmd/task/create bugfix, couldn't read task input file.
• Website and docs rewrite.
• Swift configuration automatically loaded from environment variables.

0.3.0

Changes: 0.2.0...0.3.0
Milestone: https://github.com/ohsu-comp-bio/funnel/milestone/1?closed=1

Notes:

• Added AWS DynamoDB, Batch, and S3 support.
• Added Elasticsearch database.
• Added Swift object storage client.
• Added task events schema.
• Web dashboard sorting, auto refresh, page size, and lots of other improvements.
• Run docker pull before docker run on each task to ensure the local images
  are up-to-date.
• Improved scalability and performance of scheduler and database.
• CLI tweaks and fixes
  • Use FUNNEL_SERVER environment variable to set funnel server URL.
  • funnel run now wraps command in a shell by default.
    Use funnel run --exec to bypass this.
  • Added funnel version
  • funnel wait moved to funnel task wait

0.2.0

Changes: 0.1.0...0.2.0

Notes:

• Added/improved Google Cloud Compute autoscaling support and deployment scripts.
• Implemented pagination for ListTasks endpoint, in server only.
• Added basic auth. support

0.1.0

0.1.0