Add Rust vortex framework by yp3y5akh0v · Pull Request #10833 · TechEmpower/FrameworkBenchmarks

yp3y5akh0v · 2026-03-02T03:21:37Z

New Rust framework with all endpoints.

github-actions · 2026-03-02T17:52:44Z

The following frameworks were updated, pinging maintainers:
vortex: @yp3y5akh0v

joanhey · 2026-03-02T17:57:42Z

frameworks/Rust/vortex/crates/vortex-http/src/date.rs

+    /// Pre-built complete JSON response (rebuilt once/sec).
+    json_response: [u8; 160],
+    json_len: usize,


I think than this is not permitted.
Could you explain ?

Sure, I will fix it

msmith-techempower

The crates directory feels like it should be hosted elsewhere. It looks like it's the actual framework being exercised and we wouldn't expect an end-user (e.g., a developer) to have that included in their project.

yp3y5akh0v · 2026-03-02T18:54:11Z

@msmith-techempower Didn't know that, thanks. Will move it to a separate repo.

… per-request

yp3y5akh0v · 2026-03-02T19:26:51Z

@joanhey @msmith-techempower I pushed the fixes

msmith-techempower · 2026-03-02T21:39:04Z

frameworks/Rust/vortex/src/profgen.rs

+    // - JSON: high volume
+    // - DB/queries/updates JSON: medium volume
+    // - Fortunes HTML: lower volume
+    for i in 0..500_000u32 {


This is very confusing to me - can you explain to me how (and where to look in the code) the json test is implemented? I see the comment // Single JSON response below, but I don't see any allocations.

Also, this loop has me confused as well.

@msmith-techempower This is just a PGO build tool, not the server. The actual code is in the framework repo here

I'm still extremely confused. I'm not sure where the disconnect is, but the only code I would expect to see in this pull request to our repo is application code for starting your framework, declaring and implementing your routes and logic, and a Dockerfile and benchmark_config.json.

Basically, if someone said "I'm looking to start a Vortex project" you could point them to this directory and it should be clear what they need to copy/build.

I see your point. I will make PR cleaner.

joanhey · 2026-03-02T22:18:38Z

frameworks/Rust/vortex/src/profgen.rs

+    // Realistic fortune data (matches TFB schema)
+    let fortunes: Vec<(i32, String)> = vec![
+        (1, "fortune: No such file or directory".into()),
+        (2, "A computer scientist is someone who fixes things that aren't broken.".into()),
+        (3, "After enough decimal places, nobody gives a damn.".into()),
+        (4, "A bad random number generator: 1, 1, 1, 1, 1, 4.33e+67, 1, 1, 1".into()),
+        (5, "A computer program does what you tell it to do, not what you want it to do.".into()),
+        (6, "Emacs is a nice operating system, but I prefer UNIX. \u{2014} Tom Christensen".into()),
+        (7, "Any program that runs right is obsolete.".into()),
+        (8, "A list is only as strong as its weakest link. \u{2014} Donald Knuth".into()),
+        (9, "Feature: A bug with seniority.".into()),
+        (10, "Computers make very fast, very accurate mistakes.".into()),
+        (11, "<script>alert(\"This should not be displayed in a browser alert box.\");</script>".into()),
+        (12, "\u{30D5}\u{30EC}\u{30FC}\u{30E0}\u{30EF}\u{30FC}\u{30AF}\u{306E}\u{30D9}\u{30F3}\u{30C1}\u{30DE}\u{30FC}\u{30AF}".into()),
+    ];


What is this ?

PD: https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#fortunes

@joanhey I already replied to @msmith-techempower (see comment above).

¯＼(º_o)/¯

@joanhey @msmith-techempower I removed that file, should be cleaner now. Let me know if anything else looks off.

I'll ask again.
What is this ?
https://github.com/yp3y5akh0v/vortex/blob/master/techempower/src/profgen.rs#L44-L58

PD: https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#fortunes

Using an ORM, all Fortune objects must be fetched from the Fortune table, and placed into a list data structure. Tests that do not use an ORM will be classified as "raw" meaning they use the platform's raw database connectivity.

The list data structure must be a dynamic-size or equivalent and should not be dimensioned using foreknowledge of the row-count of the database table.

And precisely the code for the bench need to be in this repo (not in your repo).

And where is the code that connect to the database? and execute the SQL ?

EDIT: I found the db code.

That's a build-time PGO profiling tool - it runs once during docker build to generate compiler optimization data, then gets thrown away. The hardcoded fortune strings are just dummy input for the profiler. At runtime, fortunes are fetched from the database on every request, no caching. You can see the server code here: https://github.com/yp3y5akh0v/vortex/blob/master/crates/vortex-server/src/server.rs

OK.
But use dummy input, not the same from the database and not exactly a 12 list, as the list size and the content is unknown.

@joanhey This is done

yp3y5akh0v · 2026-03-03T20:50:07Z

@joanhey @msmith-techempower Hi, just checking in — all feedback has been addressed. Let me know if anything else is needed.

joanhey · 2026-03-04T00:24:23Z

For me is not OK.
The code of the benchmark need to be in this repo. But not the code for the platform.
@msmith-techempower will explain you.

yp3y5akh0v · 2026-03-04T11:38:56Z

@joanhey @msmith-techempower benchmark code is now in this repo, got it sorted already

yp3y5akh0v · 2026-03-06T00:12:07Z

@joanhey @msmith-techempower any update on this? Benchmark code is in this PR now as requested, and framework code is in my repo.

volyrique · 2026-03-06T00:36:28Z

Benchmark code is in this PR now as requested...

No, it isn't. How do you explain the fact that your benchmark code does not contain the string Hello, World! at all?

yp3y5akh0v · 2026-03-06T04:08:20Z

@volyrique @joanhey @msmith-techempower I have addressed the issues, should be good now. lmk if all good now with this PR

joanhey · 2026-03-06T09:54:17Z

frameworks/Rust/vortex/src/app.rs

+const PLAINTEXT_CT: &[u8] = b"text/plain";
+const PLAINTEXT_BODY: &[u8] = b"Hello, World!";
+const JSON_CT: &[u8] = b"application/json";
+const JSON_BODY: &[u8] = b"{\"message\":\"Hello, World!\"}";


https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#json-serialization

For each request, an object mapping the key message to Hello, World! must be instantiated.

@joanhey JSON serialization is now done per request. Please review when you get a chance.

Add Rust vortex framework

8f1fc52

joanhey suggested changes Mar 2, 2026

View reviewed changes

msmith-techempower requested changes Mar 2, 2026

View reviewed changes

msmith-techempower added the PR: Please Update label Mar 2, 2026

Fix review comments: move framework to separate repo, build responses…

f3649a8

… per-request

msmith-techempower reviewed Mar 2, 2026

View reviewed changes

This comment was marked as duplicate.

Sign in to view

joanhey reviewed Mar 2, 2026

View reviewed changes

Clean up vortex submission

c7e0a72

Refactor server into reusable app interface, performance optimizations

1c978a0

Use generic StaticResponse, build from local source

09d5c2f

Update README

66cf24f

joanhey suggested changes Mar 6, 2026

View reviewed changes

Per-request JSON serialization

a69d10c

Conversation

yp3y5akh0v commented Mar 2, 2026

Uh oh!

github-actions bot commented Mar 2, 2026

Uh oh!

joanhey Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

msmith-techempower left a comment

Choose a reason for hiding this comment

Uh oh!

yp3y5akh0v commented Mar 2, 2026

Uh oh!

yp3y5akh0v commented Mar 2, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

This comment was marked as duplicate.

Uh oh!

joanhey Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

joanhey Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

joanhey Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

joanhey Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

yp3y5akh0v commented Mar 3, 2026

Uh oh!

joanhey commented Mar 4, 2026

Uh oh!

yp3y5akh0v commented Mar 4, 2026

Uh oh!

yp3y5akh0v commented Mar 6, 2026

Uh oh!

volyrique commented Mar 6, 2026

Uh oh!

yp3y5akh0v commented Mar 6, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

joanhey Mar 2, 2026 •

edited

Loading

joanhey Mar 2, 2026 •

edited

Loading

joanhey Mar 2, 2026 •

edited

Loading

joanhey Mar 2, 2026 •

edited

Loading

joanhey Mar 2, 2026 •

edited

Loading