activation ordering

[horheynm]

Activation Ordering implementation.

Checked lm_eval value with actorder=True

"metrics":[{"name":"word_perplexity,none","value":10.17568878732032},

[robertgshaw2-redhat]

As it relates to the serialization of act_reordering in compressed-tensors, @dsikka can you make sure this works well with the code we have in vllm?

[ note: I know this is unrelated to this PR ]

[dbogunowicz]

Could we have some (manual) tests in place for this as well? It's a subtle modification of the behavior, it would be great to have tested one way or another.

[Satrat]

Could we add a unit test that tests the perplexity for oneshot done with this flag?

[jeanniefinks]

Per the main README announcement, SparseML is being deprecated by June 2, 2025. Closing the PR as work has been suspended; thank you for the inputs and support!