Analytics Implementation or QA Support for [Chatbot Platform Team - Skill Tracking Analytics]

[alexperson-tw]

Google Analytics Implementation Request

Please provide the following details for this request

• Team Name

  • Chatbot Platform Team

• Poduct Name

  • VA Chatbot

• When is the launch date?

  • ASAP

• Provide the link(s) for Product/Page urls

  • https://staging.va.gov/contact-us/virtual-agent/

• What Events need to be tracked? NOTE: Design System Components are automatically tracked and should be used whenever possible to avoid custom configuration

Skill entry events

• Desired change: We would like to add an additional "topic" attribute to our existing skill entry tracking events:

  • api-name: "Chatbot Skill Entry - va_ratings_bot"
  • api-status: "successful"
  • event: "api_call"
  • topic: "va_ratings_bot"
    

• How to trigger a skill entry event: Using our Ratings skill as an example, this event is generated whenever a user starts a chat, types "ratings", successfully completes the sign-in process with test user, triggering the first message from our Ratings bot (message captured in screenshot below):

Link clicks

• Desired change: We would like to add an additional "topic" attribute to our existing link click tracking events:
  • event: "chatbot-resource-link-click"
  • link: "https://staging.va.gov/disability/view-disability-rating/rating"
  • linkText: "View your VA disability ratings page (opens in new tab)"
  • topic: ""va_ratings_bot""

• How to trigger link click tracking event: Using the View your VA disability ratings page presented to the user as the second link as an example, the following event is generated whenever a user starts a chat, types "ratings", successfully completes the sign-in process with test user, and clicks the View your VA disability ratings page (opens in new tab) link from the second message in our Ratings skill (message captured in screenshot above):

  • [If this is a funnel, insert each step's URL - pages visible depending on the applicant's answers should be marked accordingly]

  • [Insert other interactions - please review the Design System Components and GA Data Dictionary to make sure these interactions aren't already tracked]

• If applicable, what test users are needed? NOTE: Do not put staging credentials in this ticket; store or reference them in a .md file in the va.gov-team-sensitive repository
  -Stored in chatbot folder in va.gov-team-sensitive repository

• Any additional comments

  • [Insert comments]

Please leave the following blank

Acceptance criteria

• All appropriate issue tagging is completed
• QA has been completed
• Events have been added to Product and Benefit Hub Content Groups

Additional information

Please refer to Platform Collaboration Cycle or the Analytics Request Touchpoint on Platform website for more information about the Collaboration Cycle.

[johnny-jesensky-adhoc]

Thanks for submitting this @alexperson-tw -- we'll review this, along with the other Chatbot requests we have in our backlog.

[lealmendozaalexander]

Changed the login credentials as the previous ones provided do not currently work. The folder path is teams/chatbot/ratings_staging_test_user.md

[jestutt]

@lealmendozaalexander You updated us on Monday, 7 Oct, that you all had figured out why the new events were showing up on staging and that it would take a few days to debug. Please let us know when it's ready on staging for us to review.

cc @alexperson-tw @Blivaditis @johnny-jesensky-adhoc

[jestutt]

@alexperson-tw @lealmendozaalexander Everything is looking great on staging. It's ready for production.

Skill entry events

Resource link click events

Button click events

Staging Explore report -- Chatbot Events by Skill

• Tab 0 = Chatbot Skills
• Tab 1 = Chatbot DataLayer Event Names (rows) by Chatbot Skill (columns)
• Tab 2 = Daily Chatbot event counts by Chatbot Skill
• Tab 3 = Chatbot click events Click text (rows) by Chatbot Skill (columns)
  -- Blank Click text is the microphone enable event
• Tab 4 = Daily API Call event counts by chatbot entry API Names
• Tab 5 = Chatbot entry events API Names (rows) by Chatbot Skill (columns)
  -- This was added to GTM during today's testing so you won't see it in GA until tomorrow (24 Oct)
• Tab 6 = VHA Health Assistant skill events
• Tab 7 = Claims skill events
• Tab 8 = Ratings skill events

Happy to review the report with you in an upcoming Office Hours.