What is the best practice to kill the connection when spark driver lack resources to launch driver

[ruanwenjun]

Hi team,

We use Kyuubi JDBC driver to submit Spark SQL. I find when the Kyuubi create a connection, it will submit a Spark driver and wait the driver launched.

If the cluster lacks sufficient resources to launch the Spark driver, then the connection will not return, so the thread will be blocked. Then if I want to kill the connection, and submit the Spark SQL to another cluster which has sufficient resources, I need to wait the driver launched or the launched timeout.

Is there a good practice to achieve this? For example, interrupting the connection create thread.