docs/integrations/llms/huggingface_endpoint/

[giscus[bot]]

docs/integrations/llms/huggingface_endpoint/

The Hugging Face Hub is a platform with over 120k models, 20k datasets, and 50k demo apps (Spaces), all open source and publicly available, in an online platform where people can easily collaborate and build ML together.

https://python.langchain.com/docs/integrations/llms/huggingface_endpoint/

[monochandan]

For huggingfaceendpoint (same code from this doc):
/usr/local/lib/python3.11/dist-packages/huggingface_hub/inference/_providers/init.py in get_provider_helper(provider, task, model)
163 raise ValueError("Specifying a model is required when provider is 'auto'")
164 provider_mapping = _fetch_inference_provider_mapping(model)
--> 165 provider = next(iter(provider_mapping))
166
167 provider_tasks = PROVIDERS.get(provider) # type: ignore

StopIteration:

[Tarun2004e]

same error if got any solution please share

[darkpheonix2]

I'm not sure but I guess there are some models whose endpoint is not yet active, consider changing the model
For example use the metal-llama model.:
repo_id="meta-llama/Llama-3.2-3B-Instruct"

This works properly for me.

Also. try running the mistral again, as I faced the same error before but now it is working. I haven't done any changes in the configuration.
repo_id="mistralai/Mistral-7B-Instruct-v0.2"