You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: flashinfer/utils.py
+6Lines changed: 6 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -921,6 +921,12 @@ def backend_requirement(
921
921
backends. Should accept the same arguments as the decorated function and return
922
922
True if requirements are met, False otherwise.
923
923
In the case where the kernel function does not have any specific backends, this can be decorated with @supported_compute_capability to specify the function's supported compute capabilities.
924
+
heuristic_func : callable, optional
925
+
An optional function that performs heuristic backend selection when backend is "auto". Does not do anything if backend is not "auto".
926
+
Should accept the same arguments as the decorated function.
927
+
Should return an ordered list of runnable backends with the most preferred backend first.
928
+
When decorated function is not autotuned, the first backend in the heuristic list will be run.
929
+
When decorated function is autotuned, the backends in the heuristic list will be autotuned over to find the best backend.
0 commit comments