Refactor integration with PyTorch's Autograd #4550

Job	Run time
pytester (ubuntu-22.04, 3.10, latest, core)	12m 20s
pytester (ubuntu-22.04, 3.10, latest, ops)	24m 2s
pytester (ubuntu-22.04, 3.10, nightly, core)	12m 12s
pytester (ubuntu-22.04, 3.10, nightly, ops)	24m 8s
pytester (macOS-14, 3.10, latest, core)	8m 28s
pytester (macOS-14, 3.10, latest, ops)	24m 16s
pytester (macOS-14, 3.10, nightly, core)	9m 49s
pytester (macOS-14, 3.10, nightly, ops)	18m 7s
pytester (windows-2022, 3.10, latest, core)	17m 58s
pytester (windows-2022, 3.10, nightly, core)	17m 28s
pytester (ubuntu-22.04, 3.11, latest)	20m 8s
pytester (ubuntu-22.04, 3.12, latest)	23m 9s
testing-guardian	1s
	3h 32m 6s

Provide feedback