BentoML - v1.0.10

🍱 BentoML v1.0.10 is released to address a recurring broken pipe reported by the community. Also included in this release, is a list of improvements we’d like to share with the community.

• Fixed an aiohttp.client_exceptions.ClientOSError caused by asymmetrical keep alive timeout settings between the API Server and Runner.

  aiohttp.client_exceptions.ClientOSError: [Errno 32] Broken pipe

• Added multi-output support for ONNX and TensorFlow frameworks.

• Added from_sample support to all IO Descriptors in addition to just bentoml.io.NumpyNdarray and the sample is reflected in the Swagger UI.

  # Pandas Example
  @svc.api(
      input=PandasDataFrame.from_sample(
          pd.DataFrame([1,2,3,4])
      ),
  	output=PandasDataFrame(),
  )
  
  # JSON Example
  @svc.api(
      input=JSON.from_sample(
          {"foo": 1, "bar": 2}
      ),
      output=JSON(),
  )

  

💡 We continue to update the documentation and examples on every release to help the community unlock the full power of BentoML.

• Check out the updated multi-model inference graph guide and example to learn how to compose multiple models in the same Bento service.
• Did you know BentoML support OpenTelemetry tracing out-of-the-box? Checkout the Tracing guide for tracing support for OTLP, Jaeger, and Zipkin.

What's Changed

• feat(cli): log conditional environment variables by @aarnphm in #3156
• fix: ensure conda not use pipefail and unset variables by @aarnphm in #3171
• fix(templates): ensure to use python3 and pip3 by @aarnphm in #3170
• fix(sdk): montioring log output by @bojiang in #3175
• feat: make quickstart batchable by @sauyon in #3172
• fix: lazy check for stubs via path when install local wheels by @aarnphm in #3180
• fix(openapi): remove summary field under Info by @aarnphm in #3178
• docs: Inference graph example by @ssheng in #3183
• docs: remove whitespaces in migration guides by @wellshs in #3185
• fix(build_config): validation when NoneType by @aarnphm in #3187
• fix(docs): indentation in migration.rst by @aarnphm in #3186
• doc(example): monitoring example for classification tasks by @bojiang in #3176
• refactor(sdk): separate default monitoring impl by @bojiang in #3189
• fix(ssl): provide default values in configuration by @aarnphm in #3191
• fix: don't ignore logging conf by @sauyon in #3192
• feat: tensorflow multi outputs support by @larme in #3115
• docs: cleanup whitespace and typo by @aarnphm in #3195
• chore: cleanup deadcode by @aarnphm in #3196
• fix(runner): set uvicorn keep-alive by @sauyon in #3198
• perf: refine onnx implementation by @larme in #3166
• feat: from_sample for IO descriptor by @aarnphm in #3143

New Contributors

• @wellshs made their first contribution in #3185

Full Changelog: v1.0.8...v1.0.9

What's Changed

• fix: from_sample override logic by @aarnphm in #3202

Full Changelog: v1.0.9...v1.0.10