v0.9.65

What's Changed

• trt-llm 0.17 -> initial versions by @michaelfeil in #1416
• Release 0.9.65 by @basetenbot in #1421

Full Changelog: v0.9.64...v0.9.65

v0.9.65rc1

What's Changed

• trt-llm 0.17 -> initial versions by @michaelfeil in #1416

Full Changelog: v0.9.64...v0.9.65rc1

v0.9.64

What's Changed

• draft external for truss extension by @michaelfeil in #1402
• Add is_websocket_endpoint to truss config by @marius-baseten in #1403
• Sunset truss-utils package. by @marius-baseten in #1404
• Remove is_trusted argument from APIs by @marius-baseten in #1405
• Hide AWS_PROFILE also. by @squidarth in #1406
• Missed return in websocket code path by @nnarayen in #1407
• Revert "Hide AWS_PROFILE also." by @squidarth in #1408
• Config refactor: Remove gemm_plugin from config, add quantization config with calibration size by @michaelfeil in #1398
• Require min python 3.9 by @marius-baseten in #1409
• Fix trusted deprecation warning. by @marius-baseten in #1412
• Support python 3.8 in server code formatting. by @marius-baseten in #1411
• Pass TrussUserEnv in API calls by @marius-baseten in #1410
• Bump briton to add custom health check support by @bdubayah in #1413
• Release 0.9.64 by @basetenbot in #1415

Full Changelog: v0.9.63...v0.9.64

v0.9.64rc002

What's Changed

• Require min python 3.9 by @marius-baseten in #1409
• Fix trusted deprecation warning. by @marius-baseten in #1412
• Support python 3.8 in server code formatting. by @marius-baseten in #1411
• Pass TrussUserEnv in API calls by @marius-baseten in #1410
• Bump briton to add custom health check support by @bdubayah in #1413

Full Changelog: v0.9.64rc001...v0.9.64rc002

v0.9.64rc001

What's Changed

• draft external for truss extension by @michaelfeil in #1402
• Add is_websocket_endpoint to truss config by @marius-baseten in #1403
• Sunset truss-utils package. by @marius-baseten in #1404
• Remove is_trusted argument from APIs by @marius-baseten in #1405
• Hide AWS_PROFILE also. by @squidarth in #1406
• Missed return in websocket code path by @nnarayen in #1407
• Revert "Hide AWS_PROFILE also." by @squidarth in #1408
• Config refactor: Remove gemm_plugin from config, add quantization config with calibration size by @michaelfeil in #1398

Full Changelog: v0.9.63...v0.9.64rc001

v0.9.63

What's Changed

• Enables trt-llm config for lookahead decoding by @michaelfeil in #1391
• bump rc version for release by @michaelfeil in #1392
• Fix release script, derive current version from pypi by @nnarayen in #1393
• Update trt_llm_config.py by @michaelfeil in #1395
• update briton to 0.4.3 by @michaelfeil in #1396
• Restore previous control logging behavior. by @marius-baseten in #1397
• Release 0.9.63 by @basetenbot in #1401

Full Changelog: v0.9.62...v0.9.63

v0.9.63rc002

What's Changed

• Fix release script, derive current version from pypi by @nnarayen in #1393
• Update trt_llm_config.py by @michaelfeil in #1395

Full Changelog: v0.9.63rc001...v0.9.63rc002

v0.9.63rc001

What's Changed

• Enables trt-llm config for lookahead decoding by @michaelfeil in #1391
• bump rc version for release by @michaelfeil in #1392

Full Changelog: v0.9.62...v0.9.63rc001

v0.9.62

What's Changed

• Revert back to 0.9.60rc006 after broken release by @nnarayen in #1377
• Various refactors to model wrapper + truss server by @nnarayen in #1379
• update truss transfer by @michaelfeil in #1383
• Mf/v2 truss transfer by @michaelfeil in #1385
• Modify truss release workflow to be more automated by @nnarayen in #1382
• Introduce websocket passthrough for truss server by @nnarayen in #1378
• fix max mem by @michaelfeil in #1386
• CLI exists with code 1 in case of exception raised by @marius-baseten in #1387
• Remove cat by @squidarth in #1388
• Release 0.9.62 by @basetenbot in #1390

Full Changelog: v0.9.60...v0.9.62

v0.9.61rc001

What's Changed

• Revert back to 0.9.60rc006 after broken release by @nnarayen in #1377
• Various refactors to model wrapper + truss server by @nnarayen in #1379
• update truss transfer by @michaelfeil in #1383
• Mf/v2 truss transfer by @michaelfeil in #1385
• Modify truss release workflow to be more automated by @nnarayen in #1382
• Introduce websocket passthrough for truss server by @nnarayen in #1378

Full Changelog: v0.9.60...v0.9.61rc001