_include_te_fp8_autocast as CompileOption instead of an attribute to Trace

[kshitij12345]

          Makes me wonder whether this could / should be a compile data information ("option") rather than on the trace?

Originally posted by @t-vi in #1021 (comment)

[kshitij12345]

The reason it is an attribute currently is that we only want to wrap fp8_autocast for forward trace and currently there isn't a mechanism to find if the trace is forward trace. (One way could be checking if the name is augment_forward but that seemed brittle).

[t-vi]

Naive question: Could this be inferred form the te symbols in the trace?

[kshitij12345]

Naive question: Could this be inferred form the te symbols in the trace?

This could be the answer 😄 , yes - we should mostly be able to infer that based on the te symbols in trace. Though not from id as these symbols are created on the fly but their names.

lightning-thunder/thunder/executors/transformer_engineex.py

Line 427 in 61e2f84

def _create_fp8_linear_bound_symbol(