target-databricks is a Singer target for databricks.
Build with the Meltano Target SDK.
A full list of supported settings and capabilities for this target is available by running:
target-databricks --aboutThis Singer target will automatically import any environment variables within the working directory's
.env if the --config=ENV is provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the .env file.
You can easily run target-databricks by itself or in a pipeline using Meltano.
target-databricks --version
target-databricks --help
# Test using the "Carbon Intensity" sample:
tap-carbon-intensity | target-databricks --config /path/to/target-databricks-config.jsonFollow these instructions to contribute to this project.
pipx install poetry
poetry installCreate tests within the tests subfolder and
then run:
poetry run pytestYou can also test the target-databricks CLI interface directly using poetry run:
poetry run target-databricks --helpTesting with Meltano
Note: This target will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.
Next, install Meltano (if you haven't already) and any needed plugins:
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd target-databricks
meltano installNow you can test and orchestrate using Meltano:
# Test invocation:
meltano invoke target-databricks --version
# OR run a test `elt` pipeline with the Carbon Intensity sample tap:
meltano run tap-carbon-intensity target-databricksSee the dev guide for more instructions on how to use the Meltano Singer SDK to develop your own Singer taps and targets.