Discussions

• 2 You must be logged in to vote

  💬

  Output types

  enhancement

  rlouf started Oct 24, 2024 in General

  

  

  2
• 2 You must be logged in to vote

  💬

  Refactor of the main user interface

  enhancement

  rlouf started Oct 21, 2024 in General

  

  

  

  

  16
• 2 You must be logged in to vote

  🙏

  Huggingface TGI / external API Support?

  ibndias asked Apr 8, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Issues with Guided Decoding Conformance to JSON Schema in vllm

  justHungryMan asked Oct 25, 2024 in Q&A · Unanswered

  

  

  4
• 1 You must be logged in to vote

  🙏

  'additionalProperties' is required to be supplied and to be false.

  Pavel401 asked Oct 21, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Slow generation, that depends on the max_tokens param when Lark grammar used

  plutasnyy asked Oct 14, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Why is the numpy version not allowed to bump to v2?

  vanakema asked Oct 5, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Slow "Compiling FSM index for all state transitions:"

  alexmadey-oc asked Sep 30, 2024 in Q&A · Unanswered

  

  

  3
• 0 You must be logged in to vote

  💬

  Draft: Efficient RegexFSM Concatenation / Union, Enabling LALR(1), Multi-Terminal Tokens

  lapp0 started Feb 16, 2024 in General

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Now I use outlines+vllm and it takes 10 seconds to generate a JSON. This speed is not feasible in my current business. Is there any accelerated solution, such as a paper, plan or PR?

  lwdnxu asked Sep 18, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Paper: Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models

  ChristianWeyer started Aug 26, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💡

  Feature Request: Expand Collapse Block, Tab Block, Image Options

  jonnymccullagh started Aug 22, 2024 in Feature requests · Closed

  

  

  2
• 1 You must be logged in to vote

  💡

  Allow for Pydantic model field structured output without JSON schema validation

  ncoop57 started Aug 14, 2024 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  🙏

  Supported models?

  jammiguelyfish asked Aug 1, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Generating grammars automatically following lark grammar

  AdrienCorenflos asked Aug 2, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to use multimodal models with Outlines?

  cegutica asked Jul 18, 2024 in Q&A · Answered

  

  

  

  

  9
• 0 You must be logged in to vote

  💬

  How to bypass group reference in regex expression

  wanxingliu94 started Jul 14, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to use the openai api service deployed by VLLM to use outlines

  deku0818 asked Jul 13, 2024 in Q&A · Unanswered

  

  

  

  

  4
• 2 You must be logged in to vote

  🙏

  Working with Groq?

  ubervincent asked May 6, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Huggingface token in Official docker image

  Ofplarsen asked Jul 5, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to use outlines with Replicate.com?

  stephane-klein asked Jul 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Huggingface Transformers/Tokenizers do not have required attributes for outlines.models.Transformers

  ahgraber asked Jun 12, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  💡

  Add support for CTranslate2 backend

  lewoudar started Jun 15, 2024 in Feature requests

  

  

  1
• 3 You must be logged in to vote

  🙏

  How to add the grammar of an entire programming language for better code generation?

  help wanted structured generation Linked to structured generation grammar

  MoritzLaurer asked May 12, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  💡

  Multimodal support for Llava

  kshetrajna12 started Jan 17, 2024 in Feature requests

  

  

  

  

  2