-
Notifications
You must be signed in to change notification settings - Fork 124
models databricks dolly v2 12b
Description: The dolly-v2-12b model is a large, instruction-following language model created by Databricks, Inc. and is licensed for commercial use. It is based on EleutherAI’s Pythia-12b and was trained on a 15,000-record instruction corpus generated by Databricks employees, which was released under a CC-BY-SA license. It is not a state-of-the-art model, but it does exhibit high-quality instruction-following behavior that is not characteristic of the foundation model on which it is based. > The above summary was generated using ChatGPT. Review the original model card to understand the data used to train the model, evaluation metrics, license, intended uses, limitations and bias before using the model. ### Inference samples Inference type|Python sample (Notebook)|CLI with YAML |--|--|--| Real time|text-generation-online-endpoint-dolly.ipynb|text-generation-online-endpoint-dolly.sh Batch |text-generation-batch-endpoint.ipynb| coming soon ### Model Evaluation Task| Use case| Dataset| Python sample (Notebook)| CLI with YAML |--|--|--|--|--| Text generation | Text generation | cnn_dailymail | evaluate-model-text-generation.ipynb | evaluate-model-text-generation.yml ### Model Performance SKU Name| Avg. Requests Per Second | Avg. Latency(s) |--|--|--| Standard_E16s_v3 | 0.03 | 50.34 Standard_F32s_v2 | 0.03 | 59.1 Standard_NC24s_v3 | 1.08 | 34.9 ### Sample inputs and outputs (for real-time inference) json { "input_data": { "input_string": ["Explain to me the difference between nuclear fission and fusion."] } } #### Sample output json [ { "0": "Nuclear fission and fusion are the 2 main ways that the nucleus of an atom can change. Nuclear fission occurs when a nucleus splits into 2 or more pieces. Nuclear fusion occurs when 2 or more nuclei join together to make a much larger nucleus.\n\nBoth nuclear fission and nuclear fusion take a lot of energy. For fission, you need to melt the nucleus to allow for the pieces to separate. For fusion, you need to sustain temperatures over 10 million degrees Celsius in order to combine 2 nuclei together.\n\nNuclear fission is how nuclear power plants create electricity. Nuclear fission involves using high-energy radiation to split a nucleus in 2 pieces. The pieces become unstable and quickly decay to release energy.\n\nNuclear fusion involves combining 2 or more nuclei of different elements into one new one. For this to happen, the nuclei need to be brought close together but kept apart by the enormous energies needed for nuclear fusion. In this process, a small amount of energy is released that can be converted to electricity. Nuclear fusion is how stars create the light and heat we feel from the sun.\n\nHuman beings can control which process happens in a nuclear reactor. We use catalysts to cause nuclear fission or nuclear fusion to happen.\n\nFusion happens naturally in the" } ]
Version: 8
Featured Preview computes_allow_list : ['Standard_ND40rs_v2', 'Standard_ND96asr_v4'] license : mit task : text-generation
View in Studio: https://ml.azure.com/registries/azureml/models/databricks-dolly-v2-12b/version/8
License: mit
SHA: 7dde7ac26ddcb679e0429fed1b6f751c1ffab1fb
datasets: databricks/databricks-dolly-15k
evaluation-min-sku-spec: 8|0|28|56
evaluation-recommended-sku: Standard_DS4_v2
inference-min-sku-spec: 16|0|64|128
inference-recommended-sku: Standard_NC24s_v3
languages: en