Skip to content

Conversation

Xunzhuo
Copy link
Member

@Xunzhuo Xunzhuo commented Sep 28, 2025

What type of PR is this?

project: add license checker

Signed-off-by: bitliu <bitliu@tencent.com>
Copy link

netlify bot commented Sep 28, 2025

Deploy Preview for vllm-semantic-router ready!

Name Link
🔨 Latest commit 56134ee
🔍 Latest deploy log https://app.netlify.com/projects/vllm-semantic-router/deploys/68d8fe4b077a0a000888044f
😎 Deploy Preview https://deploy-preview-261--vllm-semantic-router.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned:

📁 Root Directory

Owners: @rootfs, @Xunzhuo
Files changed:

  • .licenserc.yaml
  • .github/workflows/pre-commit.yml
  • .pre-commit-config.yaml
  • .prowlabels.yaml
  • CONTRIBUTING.md
  • Makefile
  • docker-compose.yml
  • examples/semanticroute/complex-filter-chain.yaml
  • examples/semanticroute/comprehensive-example.yaml
  • examples/semanticroute/multiple-routes.yaml
  • examples/semanticroute/simple-intent-routing.yaml
  • examples/semanticroute/tool-selection-example.yaml
  • examples/semanticroute/weighted-routing.yaml
  • scripts/entrypoint.sh

📁 bench

Owners: @yuezhu1, @Xunzhuo
Files changed:

  • bench/benchmark_comparison.sh
  • bench/build_and_test.sh
  • bench/comprehensive_bench.sh
  • bench/pyproject.toml
  • bench/router_reason_bench.py
  • bench/setup.py
  • bench/vllm_semantic_router_bench/__init__.py
  • bench/vllm_semantic_router_bench/bench_plot.py
  • bench/vllm_semantic_router_bench/cli.py
  • bench/vllm_semantic_router_bench/dataset_factory.py
  • bench/vllm_semantic_router_bench/dataset_implementations/__init__.py
  • bench/vllm_semantic_router_bench/dataset_implementations/arc_dataset.py
  • bench/vllm_semantic_router_bench/dataset_implementations/commonsenseqa_dataset.py
  • bench/vllm_semantic_router_bench/dataset_implementations/gpqa_dataset.py
  • bench/vllm_semantic_router_bench/dataset_implementations/hellaswag_dataset.py
  • bench/vllm_semantic_router_bench/dataset_implementations/mmlu_dataset.py
  • bench/vllm_semantic_router_bench/dataset_implementations/truthfulqa_dataset.py
  • bench/vllm_semantic_router_bench/dataset_interface.py
  • bench/vllm_semantic_router_bench/router_reason_bench_multi_dataset.py

📁 candle-binding

Owners: @rootfs
Files changed:

  • candle-binding/Cargo.toml
  • candle-binding/semantic-router.go
  • candle-binding/semantic-router_test.go
  • candle-binding/src/bert_official.rs
  • candle-binding/src/lib.rs
  • candle-binding/src/modernbert.rs
  • candle-binding/src/unified_classifier.rs

📁 config

Owners: @rootfs
Files changed:

  • config/cache/milvus.yaml
  • config/config.e2e.yaml
  • config/config.testing.yaml
  • config/config.yaml
  • config/envoy-docker.yaml
  • config/envoy.yaml
  • config/examples/generic_categories.yaml
  • config/grafana/dashboards.yaml
  • config/grafana/datasource.yaml
  • config/prometheus.yaml

📁 deploy

Owners: @rootfs, @Xunzhuo
Files changed:

  • deploy/kubernetes/config.yaml
  • deploy/kubernetes/crds/vllm.ai_semanticroutes.yaml
  • deploy/kubernetes/deployment.yaml
  • deploy/kubernetes/kustomization.yaml
  • deploy/kubernetes/namespace.yaml
  • deploy/kubernetes/pvc.yaml
  • deploy/kubernetes/service.yaml

📁 e2e-tests

Owners: @yossiovadia
Files changed:

  • e2e-tests/00-client-request-test.py
  • e2e-tests/01-envoy-extproc-test.py
  • e2e-tests/02-router-classification-test.py
  • e2e-tests/04-cache-test.py
  • e2e-tests/llm-katan/demo-embed.html
  • e2e-tests/llm-katan/llm_katan/__init__.py
  • e2e-tests/llm-katan/llm_katan/cli.py
  • e2e-tests/llm-katan/llm_katan/config.py
  • e2e-tests/llm-katan/llm_katan/model.py
  • e2e-tests/llm-katan/llm_katan/server.py
  • e2e-tests/llm-katan/pyproject.toml
  • e2e-tests/llm-katan/terminal-demo.html
  • e2e-tests/run_all_tests.py
  • e2e-tests/start-llm-katan.sh
  • e2e-tests/test_base.py

📁 src

Owners: @rootfs, @Xunzhuo, @wangchen615
Files changed:

  • src/semantic-router/cmd/main.go
  • src/semantic-router/pkg/api/server.go
  • src/semantic-router/pkg/api/server_test.go
  • src/semantic-router/pkg/apis/vllm.ai/v1alpha1/doc.go
  • src/semantic-router/pkg/apis/vllm.ai/v1alpha1/filter_helpers.go
  • src/semantic-router/pkg/apis/vllm.ai/v1alpha1/filter_types.go
  • src/semantic-router/pkg/apis/vllm.ai/v1alpha1/register.go
  • src/semantic-router/pkg/apis/vllm.ai/v1alpha1/types.go
  • src/semantic-router/pkg/apis/vllm.ai/v1alpha1/zz_generated.deepcopy.go
  • src/semantic-router/pkg/cache/cache.go
  • src/semantic-router/pkg/cache/cache_factory.go
  • src/semantic-router/pkg/cache/cache_interface.go
  • src/semantic-router/pkg/cache/cache_test.go
  • src/semantic-router/pkg/cache/eviction_policy.go
  • src/semantic-router/pkg/cache/eviction_policy_test.go
  • src/semantic-router/pkg/cache/inmemory_cache.go
  • src/semantic-router/pkg/cache/inmemory_cache_integration_test.go
  • src/semantic-router/pkg/cache/milvus_cache.go
  • src/semantic-router/pkg/config/config.go
  • src/semantic-router/pkg/config/config_reset_test.go
  • src/semantic-router/pkg/config/config_test.go
  • src/semantic-router/pkg/config/mmlu_categories_test.go
  • src/semantic-router/pkg/config/parse_configfile_test.go
  • src/semantic-router/pkg/config/validation.go
  • src/semantic-router/pkg/config/validation_test.go
  • src/semantic-router/pkg/consts/consts.go
  • src/semantic-router/pkg/extproc/caching_test.go
  • src/semantic-router/pkg/extproc/edge_cases_test.go
  • src/semantic-router/pkg/extproc/endpoint_selection_test.go
  • src/semantic-router/pkg/extproc/error_metrics_test.go
  • src/semantic-router/pkg/extproc/extproc_test.go
  • src/semantic-router/pkg/extproc/metrics_integration_test.go
  • src/semantic-router/pkg/extproc/model_selector.go
  • src/semantic-router/pkg/extproc/processor.go
  • src/semantic-router/pkg/extproc/reason_mode_config_test.go
  • src/semantic-router/pkg/extproc/reason_mode_selector.go
  • src/semantic-router/pkg/extproc/reason_mode_selector_test.go
  • src/semantic-router/pkg/extproc/reasoning_integration_test.go
  • src/semantic-router/pkg/extproc/request_handler.go
  • src/semantic-router/pkg/extproc/request_processing_test.go
  • src/semantic-router/pkg/extproc/response_handler.go
  • src/semantic-router/pkg/extproc/router.go
  • src/semantic-router/pkg/extproc/security_test.go
  • src/semantic-router/pkg/extproc/server.go
  • src/semantic-router/pkg/extproc/stream_handling_test.go
  • src/semantic-router/pkg/extproc/test_utils_test.go
  • src/semantic-router/pkg/extproc/testing_helpers_test.go
  • src/semantic-router/pkg/extproc/utils.go
  • src/semantic-router/pkg/metrics/metrics.go
  • src/semantic-router/pkg/metrics/metrics_test.go
  • src/semantic-router/pkg/observability/logging.go
  • src/semantic-router/pkg/services/classification.go
  • src/semantic-router/pkg/services/classification_test.go
  • src/semantic-router/pkg/tools/tools.go
  • src/semantic-router/pkg/utils/classification/classifier.go
  • src/semantic-router/pkg/utils/classification/classifier_test.go
  • src/semantic-router/pkg/utils/classification/generic_category_mapping_test.go
  • src/semantic-router/pkg/utils/classification/mapping.go
  • src/semantic-router/pkg/utils/classification/model_discovery.go
  • src/semantic-router/pkg/utils/classification/model_discovery_test.go
  • src/semantic-router/pkg/utils/classification/unified_classifier.go
  • src/semantic-router/pkg/utils/classification/unified_classifier_test.go
  • src/semantic-router/pkg/utils/entropy/entropy.go
  • src/semantic-router/pkg/utils/entropy/entropy_test.go
  • src/semantic-router/pkg/utils/http/response.go
  • src/semantic-router/pkg/utils/pii/policy.go
  • src/training/classifier_model_fine_tuning/ft.py
  • src/training/classifier_model_fine_tuning/ft_linear.py
  • src/training/classifier_model_fine_tuning/test_classifier_python.py
  • src/training/classifier_model_fine_tuning/test_linear_classifier.go
  • src/training/dual_classifier/data_generator.py
  • src/training/dual_classifier/dual_classifier.py
  • src/training/dual_classifier/example.py
  • src/training/dual_classifier/test_dual_classifier.py
  • src/training/dual_classifier/test_dual_classifier_system.py
  • src/training/dual_classifier/test_existing_model.py
  • src/training/dual_classifier/train_example.py
  • src/training/dual_classifier/trainer.py
  • src/training/model_eval/arc_challenge_vllm_eval.py
  • src/training/model_eval/mmlu_pro_vllm_eval.py
  • src/training/model_eval/plot_category_accuracies.py
  • src/training/model_eval/result_to_config.py
  • src/training/multitask_bert_fine_tuning/multitask_bert_training.py
  • src/training/pii_model_fine_tuning/pii_bert_finetuning.py
  • src/training/pii_model_fine_tuning/pii_classifier_verifier.go
  • src/training/prompt_guard_fine_tuning/jailbreak_bert_finetuning.py
  • src/training/prompt_guard_fine_tuning/jailbreak_classifier_verifier.go
  • src/training/training_lora/classifier_model_fine_tuning_lora/ft_linear_lora.py
  • src/training/training_lora/classifier_model_fine_tuning_lora/ft_linear_lora_verifier.go
  • src/training/training_lora/classifier_model_fine_tuning_lora/train_cpu_optimized.sh
  • src/training/training_lora/common_lora_utils.py
  • src/training/training_lora/pii_model_fine_tuning_lora/pii_bert_finetuning_lora.py
  • src/training/training_lora/pii_model_fine_tuning_lora/pii_bert_finetuning_lora_verifier.go
  • src/training/training_lora/pii_model_fine_tuning_lora/train_cpu_optimized.sh
  • src/training/training_lora/prompt_guard_fine_tuning_lora/jailbreak_bert_finetuning_lora.py
  • src/training/training_lora/prompt_guard_fine_tuning_lora/jailbreak_bert_finetuning_lora_verifier.go
  • src/training/training_lora/prompt_guard_fine_tuning_lora/train_cpu_optimized.sh

📁 tools

Owners: @yuluo-yx, @rootfs, @Xunzhuo
Files changed:

  • tools/linter/codespell/.codespell.skip
  • tools/linter/markdown/markdownlint.yaml
  • tools/make/build-run-test.mk
  • tools/make/common.mk
  • tools/make/docs.mk
  • tools/make/envoy.mk
  • tools/make/envs.mk
  • tools/make/golang.mk
  • tools/make/linter.mk
  • tools/make/milvus.mk
  • tools/make/models.mk
  • tools/make/pre-commit.mk
  • tools/make/rust.mk
  • tools/mock-vllm/Dockerfile
  • tools/mock-vllm/app.py

vLLM

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.

@Xunzhuo
Copy link
Member Author

Xunzhuo commented Sep 28, 2025

/hold after some major improves merged

@github-actions github-actions bot added the hold label Sep 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants