models databricks dolly v2 12b

databricks-dolly-v2-12b

Overview

The dolly-v2-12b model is a large, instruction-following language model created by Databricks, Inc. and is licensed for commercial use. It is based on EleutherAI’s Pythia-12b and was trained on a 15,000-record instruction corpus generated by Databricks employees, which was released under a CC-BY-SA license. It is not a state-of-the-art model, but it does exhibit high-quality instruction-following behavior that is not characteristic of the foundation model on which it is based.

The above summary was generated using ChatGPT. Review the original model card to understand the data used to train the model, evaluation metrics, license, intended uses, limitations and bias before using the model.

Inference samples

Inference type	Python sample (Notebook)	CLI with YAML
Real time	text-generation-online-endpoint-dolly.ipynb	text-generation-online-endpoint-dolly.sh
Batch	text-generation-batch-endpoint.ipynb	coming soon

Model Evaluation

Task	Use case	Dataset	Python sample (Notebook)	CLI with YAML
Text generation	Text generation	cnn_dailymail	evaluate-model-text-generation.ipynb	evaluate-model-text-generation.yml

Model Performance

SKU Name	Avg. Requests Per Second	Avg. Latency(s)
Standard_E16s_v3	0.03	50.34
Standard_F32s_v2	0.03	59.1
Standard_NC24s_v3	1.08	34.9

Sample inputs and outputs (for real-time inference)

{
    "input_data": {
        "input_string": ["Explain to me the difference between nuclear fission and fusion."]
    }
}

Sample output

[
  {
    "0": "Nuclear fission and fusion are the 2 main ways that the nucleus of an atom can change. Nuclear fission occurs when a nucleus splits into 2 or more pieces. Nuclear fusion occurs when 2 or more nuclei join together to make a much larger nucleus.\n\nBoth nuclear fission and nuclear fusion take a lot of energy. For fission, you need to melt the nucleus to allow for the pieces to separate. For fusion, you need to sustain temperatures over 10 million degrees Celsius in order to combine 2 nuclei together.\n\nNuclear fission is how nuclear power plants create electricity. Nuclear fission involves using high-energy radiation to split a nucleus in 2 pieces. The pieces become unstable and quickly decay to release energy.\n\nNuclear fusion involves combining 2 or more nuclei of different elements into one new one. For this to happen, the nuclei need to be brought close together but kept apart by the enormous energies needed for nuclear fusion. In this process, a small amount of energy is released that can be converted to electricity. Nuclear fusion is how stars create the light and heat we feel from the sun.\n\nHuman beings can control which process happens in a nuclear reactor. We use catalysts to cause nuclear fission or nuclear fusion to happen.\n\nFusion happens naturally in the"
  }
]

Version: 11

Tags

Featured Preview computes_allow_list : ['Standard_ND40rs_v2', 'Standard_ND96asr_v4'] license : mit task : text-generation

View in Studio: https://ml.azure.com/registries/azureml/models/databricks-dolly-v2-12b/version/11

License: mit

Properties

SHA: 7dde7ac26ddcb679e0429fed1b6f751c1ffab1fb

datasets: databricks/databricks-dolly-15k

evaluation-min-sku-spec: 16|0|64|128

evaluation-recommended-sku: Standard_NC24s_v3

inference-min-sku-spec: 0|24|448|1344

inference-recommended-sku: Standard_FX36mds, Standard_FX48mds, Standard_NC24s_v3, Standard_ND96asr_v4, Standard_ND96amsr_A100_v4, Standard_ND40rs_v2

languages: en