Skip to content

Commit

Permalink
updated max client body size to 64mb, this was blocking multimodal in…
Browse files Browse the repository at this point in the history
…puts (base64 encoded images for multimodal models in vllm
  • Loading branch information
dsingal0 committed Oct 30, 2024
1 parent fb5ce87 commit 948843d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions truss/contexts/image_builder/serving_image_builder.py
Original file line number Diff line number Diff line change
Expand Up @@ -308,6 +308,7 @@ def generate_docker_server_nginx_config(build_dir, config):
readiness_endpoint=config.docker_server.readiness_endpoint,
liveness_endpoint=config.docker_server.liveness_endpoint,
server_port=config.docker_server.server_port,
client_max_body_size='64M'
)
nginx_filepath = build_dir / "proxy.conf"
nginx_filepath.write_text(nginx_content)
Expand Down

0 comments on commit 948843d

Please sign in to comment.