Skip to content

Conversation

@MeiyuZhong
Copy link
Collaborator

Add a new 'http-filter' demo that runs entirely over HTTP without MCP

@adilhafeez
Copy link
Contributor

@MeiyuZhong I do see that request ids are consistent,

➜  http_filter git:(http-filter-demo) docker compose logs plano -f | grep access_logs
...

plano-1  | [access_logs] [2026-01-12T22:24:34.776Z] "POST /v1/chat/completions HTTP/1.1" 200 - 1101 369 1437 1287 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "api.openai.com" "162.159.140.245:443" "openai"
plano-1  | [access_logs]
plano-1  | [access_logs] ==> /var/log/access_agent.log <==
plano-1  | [access_logs] [2026-01-12T22:24:34.572Z] "POST /v1/chat/completions HTTP/1.1" 200 - 158 53738 7628 3908 "-" "curl/8.7.1" "3396c608-5783-9919-b1fa-4aba1b8e0471" "localhost" "0.0.0.0:9091"
plano-1  | [access_logs]
plano-1  | [access_logs] ==> /var/log/access_internal.log <==
plano-1  | [access_logs] [2026-01-12T22:24:38.479Z] "POST /v1/chat/completions HTTP/1.1" 200 - 1769 53738 3720 2 "-" "curl/8.7.1" "3396c608-5783-9919-b1fa-4aba1b8e0471" "rag-agents" "172.19.0.5:10505" "rag_agent"
plano-1  | [access_logs]
plano-1  | [access_logs] ==> /var/log/access_llm.log <==
plano-1  | [access_logs] [2026-01-12T22:24:34.768Z] "POST /v1/chat/completions HTTP/1.1" 200 - 1101 369 1452 1450 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "localhost" "0.0.0.0:9091" "bright_staff"
plano-1  | [access_logs] [2026-01-12T22:24:36.343Z] "POST /v1/chat/completions HTTP/1.1" 200 - 578 404 993 906 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "api.openai.com" "162.159.140.245:443" "openai"
plano-1  | [access_logs] [2026-01-12T22:24:36.336Z] "POST /v1/chat/completions HTTP/1.1" 200 - 578 404 1002 1001 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "localhost" "0.0.0.0:9091" "bright_staff"
plano-1  | [access_logs] [2026-01-12T22:24:37.455Z] "POST /v1/chat/completions HTTP/1.1" 200 - 4257 345 1010 940 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "api.openai.com" "162.159.140.245:443" "openai"
plano-1  | [access_logs] [2026-01-12T22:24:37.448Z] "POST /v1/chat/completions HTTP/1.1" 200 - 4257 345 1023 1022 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "localhost" "0.0.0.0:9091" "bright_staff"
plano-1  | [access_logs] [2026-01-12T22:24:38.605Z] "POST /v1/chat/completions HTTP/1.1" 200 - 2282 74302 3587 856 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "api.openai.com" "172.66.0.243:443" "openai"
plano-1  | [access_logs] [2026-01-12T22:24:38.598Z] "POST /v1/chat/completions HTTP/1.1" 200 - 2282 74302 3599 980 "-" "AsyncOpenAI/Python 2.13.0" "3396c608-5783-9919-b1fa-4aba1b8e0471" "localhost" "0.0.0.0:9091" "bright_staff"

MeiyuZhong and others added 11 commits January 13, 2026 13:33
* fix demo with travel agent

* Update .gitignore

* remove sse chunk rendering
* ensure that request id is consistent

* remove test debug/info statements
* adding support for signals

* reducing false positives for signals like positive interaction

* adding docs. Still need to fix the messages list, but waiting on PR #621

* Improve frustration detection: normalize contractions and refine punctuation

* Further refine test cases with longer messages

* minor doc changes

* fixing echo statement for build

* fixing the messages construction and using the trait for signals

* update signals docs

* fixed some minor doc changes

* added more tests and fixed docuemtnation. PR 100% ready

* made fixes based on PR comments

* Optimize latency

1. replace sliding window approach with trigram containment check
2. add code to pre-compute ngrams for patterns

* removed some debug statements to make tests easier to read

* PR comments to make ObservableStreamProcessor accept optonal Vec<Messagges>

* fixed PR comments

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>
Co-authored-by: MeiyuZhong <mariazhong9612@gmail.com>
Co-authored-by: nehcgs <54548843+nehcgs@users.noreply.github.com>
* tweaks to web and docs to align to 0.4.2

* made our release banner clickable

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>
@MeiyuZhong MeiyuZhong merged commit 6a29f83 into main Jan 13, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants