models Deci DeciLM 7B

Deci-DeciLM-7B

Overview

DeciLM-7B is a decoder-only text generation model with 7.04 billion parameters, released by Deci under the Apache 2.0 license. It is the top-performing 7B base language model on the Open LLM Leaderboard and uses variable Grouped-Query Attention (GQA) to achieve a superior balance between accuracy and computational efficiency. The model's architecture was generated using Deci's proprietary Neural Architecture Search technology, AutoNAC. DeciLM-7B is intended for commercial and research use in English and can be fine-tuned for various tasks and languages. However, like all large language models, its outputs are unpredictable and may generate responses that are inaccurate, biased, or otherwise objectionable. Developers planning to use DeciLM-7B should undertake thorough safety testing and tuning designed explicitly for their intended applications of the model before deployment.

Model Evaluation Sample

Task	Use case	Dataset	Python sample (Notebook)	CLI with YAML
Text generation	Text generation	cnn_dailymail	evaluate-model-text-generation.ipynb	evaluate-model-text-generation.yml

Inference samples

Inference type	Python sample (Notebook)	CLI with YAML
Real time	text-generation-online-endpoint.ipynb	text-generation-online-endpoint.sh
Batch	text-generation-batch-endpoint.ipynb	coming soon

Sample inputs and outputs (for real-time inference)

Sample input

{
  "input_data": {
    "input_string": [
      "In a shocking finding, scientists discovered a herd of unicorns living in"
    ],
    "parameters": {
      "top_p": 0.95,
      "temperature": 0.6,
      "max_new_tokens": 100,
      "do_sample": true
    }
  }
}

Sample output

[
  {
    "0": "In a shocking finding, scientists discovered a herd of unicorns living in the Pacific Ocean. The discovery was made by a team of scientists who were studying the effects of climate change on the ocean. They found that the unicorns were using the ocean as a refuge from the warmer temperatures on land.\n\nA team of scientists from the University of California, San Diego, and the University of California, Los Angeles, made the discovery while studying the effects of climate change on the ocean. They found that the unicorns were using the ocean as a"
  }
]

Version: 4

Tags

Featured Preview inference_compute_allow_list : ['Standard_NC12s_v3', 'Standard_NC24s_v3', 'Standard_ND40rs_v2', 'Standard_ND96asr_v4', 'Standard_ND96amsr_A100_v4'] evaluation_compute_allow_list : ['Standard_NC12s_v3', 'Standard_NC24s_v3', 'Standard_ND40rs_v2', 'Standard_ND96asr_v4', 'Standard_ND96amsr_A100_v4'] SharedComputeCapacityEnabled task : text-generation hiddenlayerscanned license : apache-2.0 author : Deci AI huggingface_model_id : Deci/DeciLM-7B

View in Studio: https://ml.azure.com/registries/azureml/models/Deci-DeciLM-7B/version/4

License: apache-2.0

Properties

SharedComputeCapacityEnabled: True

SHA: e790e338832d40275d34b174075bc87f44354497

inference-recommended-sku: Standard_NC12s_v3, Standard_NC24s_v3, Standard_ND40rs_v2, Standard_ND96asr_v4, Standard_ND96amsr_A100_v4

inference-min-sku-spec: 12|2|224|1474

evaluation-recommended-sku: Standard_NC12s_v3, Standard_NC24s_v3, Standard_ND40rs_v2, Standard_ND96asr_v4, Standard_ND96amsr_A100_v4

evaluation-min-sku-spec: 12|2|224|1474

languages: EN