Bump litgpt from 0.4.11 to 0.5.3 #4728

Job	Run time
pytester (ubuntu-22.04, 3.10, latest, core)	11m 4s
pytester (ubuntu-22.04, 3.10, latest, ops)	24m 14s
pytester (ubuntu-22.04, 3.10, nightly, core)	11m 36s
pytester (ubuntu-22.04, 3.10, nightly, ops)	23m 28s
pytester (macOS-14, 3.10, latest, core)	5m 56s
pytester (macOS-14, 3.10, latest, ops)	17m 55s
pytester (macOS-14, 3.10, nightly, core)	6m 57s
pytester (macOS-14, 3.10, nightly, ops)	19m 26s
pytester (windows-2022, 3.10, latest, core)	21m 22s
pytester (windows-2022, 3.10, nightly, core)	22m 53s
pytester (ubuntu-22.04, 3.11, latest)	19m 1s
pytester (ubuntu-22.04, 3.12, latest)	21m 19s
testing-guardian	1s
	3h 25m 12s

Provide feedback