feat(qa construct): add optional long context window approach

[MichaelWalker-git]

Problem

Our construct currently defaults to a long context window approach for processing documents when a filename is specified. This method leverages an extensive portion of the document's content as the context for generating AI responses. While effective for comprehensive context provision, it may not always be the most efficient or relevant approach for all use cases.

Proposed Solution

To provide users with greater flexibility and control over the response generation process, we propose introducing a new parameter within our GraphQL schema: responseGenerationMethod. This parameter will allow users to explicitly select their preferred method of context application—either the existing long context window (longContext) or the Retrieval-Augmented Generation (RAG) method.

(QA construct): Update Q/A logic #137

#137

Screenshots:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the project license.

[krokoko]

Test cases discussed:

• ResponseGenerationMethod set to RAG should run the RAG approach (regardless of a filename specified)
• ResponseGenerationMethod set to Long context and no filename specified should send back an error message
• ResponseGenerationMethod set to Long context window and a filename specified should check how many tokens are in the specified document, if that amount is smaller that the max number of tokens supported by the model used, run Long Context window, otherwise run RAG approach

To know which approach was used, this information will be logged by the Lambda function

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (94dd364) 93.61% compared to head (3a9597e) 93.61%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #176   +/-   ##
=======================================
  Coverage   93.61%   93.61%           
=======================================
  Files          18       18           
  Lines        5624     5624           
  Branches      125      125           
=======================================
  Hits         5265     5265           
  Misses        359      359           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.