Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Return to Previous prompt not working with multi-turn custom question and answering. #1468

Open
anujjsr opened this issue Feb 14, 2023 · 1 comment
Assignees
Labels
Bot Services Required for internal Azure reporting. Do not delete. Do not change color. customer-replied-to Indicates that the team has replied to the issue reported by the customer. Do not delete. customer-reported Issue is created by anyone that is not a collaborator in the repository. ExemptFromDailyDRIReport Use this label to exclude the issue from the DRI report. feature-request A request for new functionality or an enhancement to an existing one.

Comments

@anujjsr
Copy link

anujjsr commented Feb 14, 2023

Describe the bug

Return to Previous prompt not working with multiturn QNA maker. Top to down sequence of follow-up prompt is working find but the reverse sequence i.e., bottom - up is not working.

Version

Component Version - 1.0.0.
SDK version - 4.12

Version: 2.1.2
Electron: 8.2.4
Chrome: 80.0.3987.165
NodeJS: 12.13.0
V8: 8.0.426.27-electron.0

To Reproduce

  1. Imported this doc to Custom Question and answering project.
  2. Under “Carbon Emissions” and “Financing Environment” add a follow-up to return to the previous conversation flow - it should be titled “Return to previous”

image

  1. Test it on CQA portal - Ensure that you are using the multi-turn conversation feature so that when you ask - for example - “ What Is Microsoft’s ESG rating?” you have the option of clicking “Climate Change”, “Human Capital”, “Corporate Governance”, and “Product Liability”. Select "Climate Change" --> "Carbon Emissions" --> "Return to previous" - Return to previous step is working fine in CQA test.
  2. Deployed it
  3. Create a composer bot and add the component "Microsoft.Bot.Components.Recognizers.CustomQuestionAnsweringRecognizer"
  4. Add the trigger "QNA intent recognized" to above created composer bot in step 5.
  5. Test the composer bot with the test steps mentioned in step number 4 but this time return to previous step follow-up prompt doesn't gives any response.

Expected behavior

Expected output is to have the follow up prompt for return to previous step

Screenshots

Follow up prompt working in Custom Question and answering Portal Test app
image

Follow up prompt also working for return to previous step in Custom Question and answering Portal Test app
Notice the last user request - "Return to previous" to which the reponse was generated for the linked climate change option.
image

Follow up prompt NOT working for return to previous step in Composer Bot using the component - Microsoft.Bot.Components.Recognizers.CustomQuestionAnsweringRecognizer

Return to previous step gives no response back as can be seen in below screenshot.

image

I can send the emulator transcript file on email if required.

Additional context

@anujjsr anujjsr added bug Indicates an unexpected problem or an unintended behavior. needs-triage The issue has just been created and it has not been reviewed by the team. labels Feb 14, 2023
@anishprasad01 anishprasad01 added customer-reported Issue is created by anyone that is not a collaborator in the repository. Bot Services Required for internal Azure reporting. Do not delete. Do not change color. customer-replied-to Indicates that the team has replied to the issue reported by the customer. Do not delete. feature-request A request for new functionality or an enhancement to an existing one. and removed needs-triage The issue has just been created and it has not been reviewed by the team. bug Indicates an unexpected problem or an unintended behavior. labels Feb 14, 2023
@anishprasad01
Copy link
Contributor

Hi @anujjsr,

Thank you for your report.

The CQA recognizer for Composer is fairly new, and based on the code, it would seem that the "return to previous" feature has not yet been implemented. This is therefore a feature request, and will be placed on the backlog for consideration.

@axelsrz axelsrz added the ExemptFromDailyDRIReport Use this label to exclude the issue from the DRI report. label Feb 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bot Services Required for internal Azure reporting. Do not delete. Do not change color. customer-replied-to Indicates that the team has replied to the issue reported by the customer. Do not delete. customer-reported Issue is created by anyone that is not a collaborator in the repository. ExemptFromDailyDRIReport Use this label to exclude the issue from the DRI report. feature-request A request for new functionality or an enhancement to an existing one.
Projects
None yet
Development

No branches or pull requests

3 participants