Skip to content

Conversation

@scoopex
Copy link
Contributor

@scoopex scoopex commented May 25, 2025

The openstack flavor manager fetches the flavor definitions from the conformance test.
These definitions contain a "mandatory" and a "recommended" section.

I think it would be a good idea to have a set of default flavors in this file with the larger amounts of memory described, because in my opinion there is a high probability that something like this will be used very often (e.g. for database page caches). On the other hand, I don't think that variations of larger numbers of CPUs (apart from the existing ones) are needed very, because huge cpu workloads are often better distributed by multiple virtual machines (i.e. by using kubernetes).

I therefore advocate that we make flavors with larger amounts of RAM available in the recommended section of that file, as otherwise there will be more variants or SCS users will have to contact their provider every time.

From my point of view, it is very useful for SCS users if they can also expect larger flavors from different suppliers.

@scoopex scoopex force-pushed the add_larger_flavors branch from 102b0a9 to 1647fa7 Compare May 25, 2025 16:31
@scoopex scoopex marked this pull request as draft May 25, 2025 16:35
@scoopex scoopex self-assigned this May 25, 2025
@scoopex scoopex requested a review from mbuechse May 25, 2025 16:36
@scoopex scoopex marked this pull request as ready for review May 25, 2025 16:37
@fkr
Copy link
Member

fkr commented May 26, 2025

As discussed on Matrix (https://matrix.to/#/!xlFjWCAoQenuOeIVQw:matrix.org/$2bVMQjnP0QpGkOVtlVSusyt4gTQfaoGybYPkBUn2u2M?via=matrix.org&via=regio.chat&via=matrix.uhurutec.com) and suggested by @mbuechse: this is a good candidate to being discussed in the next Lean Coffee. The next Lean SCS Operator Coffee is on June 12.

@depressiveRobot
Copy link
Contributor

As discussed in the Lean SCS Operator Coffee on June 12, a survey of the SCS members and market analysis may be a good way to find out which additional (larger) default flavors are needed.

@garloff recommended to add the new flavors as recommended first and make them mandatory later to give providers time to adapt.

@mbuechse mbuechse force-pushed the add_larger_flavors branch from 68ff3c9 to 93d61aa Compare June 25, 2025 11:08
@mbuechse mbuechse marked this pull request as draft June 25, 2025 11:09
@mbuechse
Copy link
Contributor

Converted this to draft because this is mainly a point for organizing the discussion. If the larger flavors are to be added, then the file(s) to be changed would be a little different.

@scoopex scoopex marked this pull request as ready for review June 26, 2025 06:35
@scoopex scoopex marked this pull request as draft June 26, 2025 06:36
@horazont
Copy link
Member

horazont commented Jun 30, 2025

Hello there.

I ran some statistics:

COUNT   RAM     VCPUS  RATIO
    144 4096    2      2:1
    109 1024    1      1:1
     64 8192    4      2:1
     52 65536   16     4:1
     40 2048    1      2:1
     39 16384   8      2:1
     38 32768   8      4:1
     31 16384   4      4:1
     28 4096    1      4:1
     27 32768   16     2:1
     22 8192    2      4:1
     16 512     1      0.5:1

This is our current use in the currently most relevant one of our public cloud sites. Grouped by ratio:

COUNT    RATIO
    314  2:1
    171  4:1
    109  1:1
     16  0.5:1

Not sure if I can make it to this week's standardisation SIG, but there we go.

All these flavors are dedicated thread (not dedicated core and not shared core).

Needless to say, this cloud is not SCS compliant, also because of the flavors. And obviously, this is biased, as our customers can only use what we offer. Hence, there cannot be any usage of >=8:1 flavors or of flavors with more than 64 GiB of RAM in this particular site.

(We are working on renewing the public cloud offering and are of course looking into the general direction of SCS flavors for inspiration of how we build it.)

@scoopex scoopex changed the title add larger memory flavors Add larger memory flavors Jun 30, 2025
@depressiveRobot
Copy link
Contributor

depressiveRobot commented Jul 11, 2025

Further discussion in SIG Std/Cert meeting on 2025-07-10 with the following suggestion:

  • add larger memory flavors as "recommended" with 64 and 128 GiB of RAM for CPU/RAM ratios 1:2, 1:4, 1:8
  • brief explanation what "recommended" means

What would be the best place to add a brief explanation of what we mean by “recommended”?

@berendt
Copy link
Contributor

berendt commented Jul 11, 2025

If you want to offer flavors only for specific memory sizes (e.g. 32 GB), you should include all recommended flavors for this specific memory size.

"Recommended" does not mean that you should use all available flavors from the entire list. Instead, the recommendation only refers to the flavors for your desired configuration (e.g. 32 GB).

Example: If you want to offer 32 GB instances, only include the flavors recommended for 32 GB - not all flavors from 2 GB to 128 GB that might be available in total.

@depressiveRobot
Copy link
Contributor

If you want to offer flavors only for specific memory sizes (e.g. 32 GB), you should include all recommended flavors for this specific memory size.

"Recommended" does not mean that you should use all available flavors from the entire list. Instead, the recommendation only refers to the flavors for your desired configuration (e.g. 32 GB).

Example: If you want to offer 32 GB instances, only include the flavors recommended for 32 GB - not all flavors from 2 GB to 128 GB that might be available in total.

Thank you for the short and precise explanation.

Another thing which popped into my head: Are SCS-32V-64, SCS-32V-128 and SCS-64V-128 even desired flavors?

@mbuechse mbuechse marked this pull request as ready for review September 11, 2025 15:29
@mbuechse mbuechse requested a review from garloff September 11, 2025 15:29
@garloff
Copy link
Member

garloff commented Oct 26, 2025

From my perspective this is good to go.

@fkr fkr force-pushed the add_larger_flavors branch from 4f77b09 to eac1fd8 Compare November 18, 2025 13:04
@fkr
Copy link
Member

fkr commented Nov 18, 2025

Whats the story with this?

@mbuechse
Copy link
Contributor

It has to be verified that this change is consistent after the most recent commits by @garloff. It was a topic for the ALASCA Summit Hackathon, but we unfortunately didn't get around to it.

@mbuechse
Copy link
Contributor

I had a look. It seems fine.

@mbuechse
Copy link
Contributor

mbuechse commented Nov 20, 2025

@fkr I think this should be reviewed by someone who's not me, garloff or scoopex.

@mbuechse mbuechse requested review from berendt and chrisschwa and removed request for mbuechse November 20, 2025 15:10
@mbuechse
Copy link
Contributor

@fkr I think this should be reviewed by someone who's not me, garloff or scoopex.

@garloff

@fkr
Copy link
Member

fkr commented Nov 24, 2025

@fkr I think this should be reviewed by someone who's not me, garloff or scoopex.

I concur - github added you automatically because of the CODEOWNERS file... :)

Marc Schöchlin and others added 9 commits November 24, 2025 19:49
Signed-off-by: Marc Schöchlin <marc.schoechlin@uhurutec.com>
Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud>
Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud>
Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud>
Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud>
Signed-off-by: Kurt Garloff <kurt@garloff.de>
* Remove 1:16, 1:32 and -disk flavors from recommended list.

  Instead create language that explains the way how to systematically
  extend the list to stay in line with what might later be standardized.

* Escape underscore for markdown rendering. (#1000)

  github seems to be able to do without, but not all MD renderers are so
  tolerant.

Signed-off-by: Kurt Garloff <kurt@garloff.de>
Signed-off-by: Kurt Garloff <kurt@garloff.de>
Signed-off-by: Kurt Garloff <kurt@garloff.de>
@fkr fkr force-pushed the add_larger_flavors branch from 6e88062 to b7ddc75 Compare November 24, 2025 18:49
@fkr fkr requested a review from garloff November 24, 2025 18:50
@fkr
Copy link
Member

fkr commented Nov 24, 2025

@garloff @berendt @chrisschwa please comment and approve (or not)

@garloff
Copy link
Member

garloff commented Dec 1, 2025

From my perspective, this is good to go. But as main contributor, I'm not the best person to judge ...

@chrisschwa
Copy link
Contributor

LGMT

@mbuechse mbuechse merged commit 6b955ce into main Dec 1, 2025
8 checks passed
@mbuechse mbuechse deleted the add_larger_flavors branch December 1, 2025 11:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants