Run examine
automatically when hit unsupported operator failure
#270
Labels
enhancement
New feature or request
🚀 Feature
examine
is a very useful and clean method that analyzes the network and reports the unsupported operators. When Thunder hits an unsupported operator, it would be very useful to have Thunder automatically runexamine
internally with the model and the inputs it already has and report theexamine
output along with the error.Motivation
As Thunder grows in adoption, we are seeing it being used on models with operators which are not currently supported. Today, Thunder throws an error that's not very clear that the error is attributed to an unsupported operator.
Example, see comment from a contributor below -- #93 (comment)
Another motivation for this comes from more complex libraries like NeMo where the model builder and the dataloader are not often in the same piece of code and is not easily accessible as they use PyTorch Lightning Trainer etc. While there is an option to create dummy inputs to run
examine
, this creates a layer of friction between adoption. Often, the engineer running the model is not the same as the one who built the model and may not even have the understanding of the input data expected by the model.CC - @mruberry @tfogal
The text was updated successfully, but these errors were encountered: