Skip to content

Suggestion: add a practical RAG failure troubleshooting reference for LinearRAG users #22

@onestardao

Description

@onestardao

Hi, I’d like to suggest a small practical companion resource that may be useful for users working with LinearRAG in real-world retrieval workflows.

I previously contributed a related WFGY ProblemMap reference in the GraphRAG ecosystem, including a submission to Awesome-GraphRAG, and I think a more implementation-oriented repo like LinearRAG may also benefit from a compact troubleshooting reference.

The resource is the WFGY RAG 16 Problem Map, a framework-agnostic checklist for diagnosing common downstream failure patterns in RAG and agent-style pipelines:

  • retrieval misses
  • stale or mismatched context
  • chunking and embedding mismatch
  • citation instability
  • answer inconsistency
  • multi-step reasoning drift
  • tool and routing confusion in retrieval-heavy flows

Reference:
https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md

This checklist has already been referenced or integrated by several public RAG / LLM ecosystem projects, including:

  • RAGFlow
  • LlamaIndex
  • ToolUniverse (Harvard MIMS Lab)
  • Rankify
  • Multimodal RAG Survey (QCRI LLM Lab)

I think it could work well here as a small supplemental troubleshooting page, or even just a concise “further reading” note, for users who want a structured way to debug what goes wrong after the base pipeline is already running.

If this seems appropriate, I’d be happy to open a small repo-style PR with minimal wording and scope, aligned to your documentation style.

Thanks for considering it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions