Skip to content

Latest commit

 

History

History
128 lines (101 loc) · 3.81 KB

configuration.md

File metadata and controls

128 lines (101 loc) · 3.81 KB
Raw

Configuration

Initializing & Updating a Configuration Directory

The connector requires a configuration directory to run.

Using the ndc-elasticsearch Executable

If you have the executable:

ndc-elasticsearch update --configuration=STRING

It initialize and updates the configuration directory by fetching mappings from Elasticsearch.

See also: development instructions

Index mappings

Index mappings are added by introspecting the Elasticsearch provided during update of the configuration directory. These mappings are similar to what we get in Elasticsearch's mappings API.

Native Queries

Native Queries allow you to run custom DSL queries on your Elasticsearch. This enables you to run queries that are not supported by Hasura DDN's GraphQL engine. This unlocks the full power of your search-engine, allowing you to run complex queries all directly from your Hasura GraphQL API.

In the internal section within the dsl, you have the option to write an Elasticsearch DSL query. Additionally, you can create a native query in a .json file located in your configuration directory, usually within a specific subdirectory. When specifying the query in the dsl, use the file option.

Your file may only contain only a single JSON DSL query.

Native Queries can take arguments using the {{argument_name}} syntax. Arguments must be specified along with their type.

{
    "query": {
        "range": {
            "age": {
                "gte": "{{gte}}"
            }
        }
    }
}

Then add the query to your configuration.json file. You'll need to determine the query return type.

The return type can either be of kind defination or index. kind defination requires a mappnigs section in the return type where you can define custom mappings for your returned documents (Logical Models).

Set kind to index to use mappings of the existing index in the indices section of the configuration.

Examples:

  1. Using internal parameter
{
    "aggregate_query": {
        "dsl": {
            "internal": {
                "aggs": {
                    "price_outlier": {
                        "percentiles": {
                            "field": "products.base_price",
                            "percents": [
                                95,
                                99,
                                99.9
                            ]
                        }
                    }
                }
            }
        },
        "index": "kibana_sample_data_ecommerce",
        "return_type": {
            "kind": "index"
        }
    }
}
  1. Using file parameter
{
    "range_query": {
        "dsl": {
            "file": "native_queries/range.json"
        },
        "index": "my_sample_index",
        "return_type": {
            "kind": "defination",
            "mappings": {
                "properties": {
                    "range": {
                        "age": {
                            "type": "integer"
                        }
                    }
                }
            }
        },
        "arguments": {
            "gte": {
                "type": "integer"
            },
            "lte": {
                "type": "integer"
            }
        }
    }
}

The CLI provides validate command to validate your configuration directory:

ndc-elasticsearch validate --configuration=STRING

Note on Configuration Structure Changes

During this active development phase, the configuration structure may change.

The CLI also provides an upgrade command to upgrade your configuration directory to be compatible with the latest connector version

ndc-elasticsearch upgrade --dir-from=STRING --dir-to=STRING