Darkwing is a lightweight, high-performance server implementing the Arrow Flight SQL protocol. It enables efficient, scalable SQL query execution over Arrow data, making it ideal for modern analytics workflows.
- Arrow Flight SQL: Full native support for the Arrow Flight SQL protocol.
- Pluggable Backend Engines: Easily extendable architecture. Currently supports:
- Lightweight & Minimal: Few dependencies, fast startup, and simple deployment.
- Extensible: Built to support additional backend engines and new features with minimal effort.
Disclaimer: Darkwing is under active development and is not recommended for production use. Features and APIs may change without notice.
Clone the repository and navigate to the project directory:
git clone https://github.com/lakshgupta/darkwing.git
cd darkwingBuild the server:
task build-serverStart the server using Task:
task run-serverOr run the built binary directly:
./bin/darkwingConnect to Darkwing using any Arrow Flight SQL client. For example, with Python:
import pyarrow.flight.sql as fsql
client = fsql.FlightSQLClient("grpc+tcp://localhost:8815")
info = client.execute("SELECT * FROM my_table")
reader = client.do_get(info.endpoints[0].ticket)
print(reader.read_all())This project is licensed under the Apache License 2.0.
For more details, see the documentation or open an issue for support.