Skip to content

Tests [QA] v1.10.0-rc30 #3458

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: development
Choose a base branch
from
Open

Tests [QA] v1.10.0-rc30 #3458

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
566020e
Updated LLM prompts test suite
EZheln Oct 8, 2025
deb5086
Merge branch 'development' into QA-tests-1.10.0-rc28
EZheln Oct 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
165 changes: 95 additions & 70 deletions tests/features/artifacts.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -300,76 +300,6 @@ Feature: Artifacts Page
Then click on "Tabel_View_Button" element on "Files_Info_Pane" wizard
Then verify "Cross_Close_Button" element visibility on "Files_Info_Pane" wizard

@MLA
@passive
@smoke
Scenario: MLA013 - Check Details panel still active on page refresh
# * set tear-down property "project" created with "automation-test" value
# * set tear-down property "file" created in "automation-test" project with "test-file" value
* create "automation-test" MLRun Project with code 201
* create "test-file" File with "test" tag in "automation-test" project with code 200
Given open url
And wait load page
And click on row root with value "automation-test" in "name" column in "Projects_Table" table on "Projects" wizard
And wait load page
And hover "Project_Navigation_Toggler" component on "commonPagesHeader" wizard
And click on cell with value "Artifacts" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then verify "Table_FilterBy_Button" element on "Files" wizard should display hover tooltip "Common_Tooltips"."FilterBy_Button"
Then click on "Table_FilterBy_Button" element on "Files" wizard
Then select "test" option in "Table_Tree_Filter_Dropdown" dropdown on "FilterBy_Popup" wizard
Then click on "Apply_Button" element on "FilterBy_Popup" wizard
And wait load page
When click on cell with value "test-file" in "name" column in "Files_Table" table on "Files" wizard
And wait load page
Then check "test" value in "tag" column in "Overview_Table" table on "Files_Info_Pane" wizard
Then click on "Edit_btn_table_view" element on "Files_Info_Pane" wizard
And wait load page
When type value "v1" to "Version_tag_Input" field on "Files_Info_Pane" wizard
Then click on "Apply_Button" element on "Files_Info_Pane" wizard
Then click on "Apply_Changes_Button" element on "Files_Info_Pane" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element visibility on "Files_Info_Pane" wizard
Then "Not_In_Filtered_List_Message" component on "Files_Info_Pane" should be equal "Files_Info_Pane"."Info_Banner_Message"
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then "Header" element on "Files_Info_Pane" should contains "test-file" value
Then refresh a page
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element visibility on "Files_Info_Pane" wizard
Then "Not_In_Filtered_List_Message" component on "Files_Info_Pane" should be equal "Files_Info_Pane"."Info_Banner_Message"
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then "Header" element on "Files_Info_Pane" should contains "test-file" value
Then verify "Table_Refresh_Button" element visibility on "Files" wizard
Then verify "Table_Refresh_Button" element on "Files" wizard should display hover tooltip "Common_Tooltips"."Refresh_Button"
Then click on "Table_Refresh_Button" element on "Files" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element visibility on "Files_Info_Pane" wizard
Then "Not_In_Filtered_List_Message" component on "Files_Info_Pane" should be equal "Files_Info_Pane"."Info_Banner_Message"
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then click on "Cross_Close_Button" element on "Files_Info_Pane" wizard
And wait load page
Then verify "Header" element not exists on "Files_Info_Pane" wizard
When click on cell with value "test-file" in "name" column in "Files_Table" table on "Files" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element not exists on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard

@MLA
@passive
@inProgress
Expand Down Expand Up @@ -893,6 +823,101 @@ Feature: Artifacts Page
And wait load page
Then verify "Table_Tree_Filter_Dropdown" dropdown on "FilterBy_Popup" wizard selected attribute option value "All tags"

@MLA
@passive
@smoke
Scenario: MLA013 - Check Details panel still active on page refresh
Given open url
And wait load page
And click on row root with value "default" in "name" column in "Projects_Table" table on "Projects" wizard
And wait load page
And hover "Project_Navigation_Toggler" component on "commonPagesHeader" wizard
And click on cell with value "Artifacts" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then select "Add a tag" option in action menu on "Files" wizard in "Files_Table" table at row with "training_iteration_results" value in "name" column
And wait load page
Then verify "Add_Tag_Popup" element visibility on "Add_Tag_Popup" wizard
Then type value "test" to "Tag_Input" field on "Add_Tag_Popup" wizard
Then click on "Add_Button" element on "Add_Tag_Popup" wizard
And wait load page
Then verify "Notification_Pop_Up" element visibility on "Notification_Popup" wizard
And wait load page
Then "Notification_Pop_Up" element on "Notification_Popup" should contains "Tag was added successfully" value
And wait load page
Then verify "Notification_Pop_Up_Cross_Close_Button" element visibility on "Notification_Popup" wizard
Then click on "Notification_Pop_Up_Cross_Close_Button" element on "Notification_Popup" wizard
Then verify "Table_FilterBy_Button" element on "Files" wizard should display hover tooltip "Common_Tooltips"."FilterBy_Button"
Then click on "Table_FilterBy_Button" element on "Files" wizard
Then select "test" option in "Table_Tree_Filter_Dropdown" dropdown on "FilterBy_Popup" wizard
Then click on "Apply_Button" element on "FilterBy_Popup" wizard
And wait load page
When click on cell with value "training_iteration_results" in "name" column in "Files_Table" table on "Files" wizard
And wait load page
Then check "test" value in "tag" column in "Overview_Table" table on "Files_Info_Pane" wizard
Then click on "Edit_btn_table_view" element on "Files_Info_Pane" wizard
And wait load page
When type value "v1" to "Version_tag_Input" field on "Files_Info_Pane" wizard
Then click on "Apply_Button" element on "Files_Info_Pane" wizard
Then click on "Apply_Changes_Button" element on "Files_Info_Pane" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element visibility on "Files_Info_Pane" wizard
Then "Not_In_Filtered_List_Message" component on "Files_Info_Pane" should be equal "Files_Info_Pane"."Info_Banner_Message"
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then "Header" element on "Files_Info_Pane" should contains "training_iteration_results" value
Then refresh a page
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element visibility on "Files_Info_Pane" wizard
Then "Not_In_Filtered_List_Message" component on "Files_Info_Pane" should be equal "Files_Info_Pane"."Info_Banner_Message"
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then "Header" element on "Files_Info_Pane" should contains "training_iteration_results" value
Then verify "Table_Refresh_Button" element visibility on "Files" wizard
Then verify "Table_Refresh_Button" element on "Files" wizard should display hover tooltip "Common_Tooltips"."Refresh_Button"
Then click on "Table_Refresh_Button" element on "Files" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element visibility on "Files_Info_Pane" wizard
Then "Not_In_Filtered_List_Message" component on "Files_Info_Pane" should be equal "Files_Info_Pane"."Info_Banner_Message"
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then click on "Cross_Close_Button" element on "Files_Info_Pane" wizard
And wait load page
Then verify "Header" element not exists on "Files_Info_Pane" wizard
And verify "No_Data_Message" element visibility on "commonPagesHeader" wizard
Then "No_Data_Message" component on "commonPagesHeader" should be equal "No_Data_Message"."Common_Message_Artifact_Tag"
Then click on "Table_FilterBy_Button" element on "LLM_Prompts" wizard
Then click on "Clear_Button" element on "FilterBy_Popup" wizard
And wait load page
When click on cell with value "training_iteration_results" in "name" column in "Files_Table" table on "Files" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element not exists on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then click on "Table_FilterBy_Button" element on "Files" wizard
Then select "v1" option in "Table_Tree_Filter_Dropdown" dropdown on "FilterBy_Popup" wizard
Then click on "Apply_Button" element on "FilterBy_Popup" wizard
And wait load page
When click on cell with value "training_iteration_results" in "name" column in "Files_Table" table on "Files" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Not_In_Filtered_List_Message" element not exists on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard

@MLA
@smoke
Scenario: MLA023 - Check components on artifact Full view content
Expand Down
27 changes: 27 additions & 0 deletions tests/features/common-tools/common-consts.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -110,6 +110,7 @@ export default {
},
Common_Lists: {
Action_Menu_List: ['Add a tag', 'Download', 'Copy URI', 'View YAML', 'Delete', 'Delete all versions'],
Action_Menu_List_LLM_Prompt: ['Add a tag', 'Download', 'Copy URI', 'View YAML'],
Action_Menu_List_Version_History: ['Add a tag', 'Download', 'Copy URI', 'View YAML', 'Delete'],
Action_Menu_List_Expanded: ['Add a tag', 'Download', 'Copy URI', 'View YAML', 'Delete all'],
Action_Menu_List_Dataset_Transition_Popup: ['Download', 'Copy URI', 'View YAML'],
Expand Down Expand Up @@ -154,6 +155,26 @@ export default {
],
Overview_Producer_Headers: ['Name:', 'Kind:', 'Tag:', 'Owner:', 'UID:']
},
LLM_Prompts_Info_Pane: {
Tab_List: ['Overview', 'Prompt Template', 'Generation Configuration'],
Tab_List_Prompt_Template: ['Prompt', 'Arguments'],
Info_Banner_Message: /The LLM prompt is not in the filtered list\. Closing the details panel will return you to the current list\./,
Overview_General_Headers: [
'Key:',
'Description:',
'Model name:',
'Hash:',
'Version tag:',
'Original source:',
'Iter:',
'URI:',
'Path:',
'UID:',
'Updated:',
'Labels:'
],
Overview_Producer_Headers: ['Name:', 'Kind:', 'Tag:', 'Owner:', 'UID:']
},
Alerts_Jobs_Info_Pane: {
Overview_General_Headers: [
'Project Name:',
Expand Down Expand Up @@ -399,6 +420,7 @@ export default {
Auto_Refresh: 'Uncheck Auto Refresh to view more results',
FilterBy_Button: 'Filter',
FilterBy_Button_1: 'Filter (1)',
Argument: 'The essence of all things',
Show_All_Versions: 'Show all versions',
Open_Metrics: 'Open metrics',
Refresh_Button: 'Refresh',
Expand Down Expand Up @@ -545,6 +567,7 @@ export default {
FeatureSets_Stats_Tip:
'Each feature set can have multiple versions, produced by multiple runs and given multiple tags.\n' +
' You can browse them in the Feature store page.',
Model_Version_Tag: 'Enter a model name to enable field.',
Artifacts_Stats_Tip:
'Each artifact can have multiple versions, produced by multiple runs and given multiple tags.\n' +
' You can browse them in the Artifacts page.',
Expand Down Expand Up @@ -766,6 +789,10 @@ export default {
Common_Message_Jobs_Monitoring:
/No data matches the filter: "Start time: \d{2}\/\d{2}\/\d{4} \d{2}:\d{2} - \d{2}\/\d{2}\/\d{4} \d{2}:\d{2}, Project: (.+?)"/,
Common_Message_Monitor_Jobs_Name: /No data matches the filter: "Name: (.+?)"/,
Common_Message_LLM_Prompt_Name: /No data matches the filter: "Name: (.+?), LLM prompt version tag: (.+?), Show best iteration only: (.+?)"/,
Common_Message_LLM_Prompt_Label: /No data matches the filter: "Name: (.+?), LLM prompt version tag: (.+?), Labels: (.+?), Show best iteration only: (.+?)"/,
Common_Message_LLM_Prompt_Tag: /No data matches the filter: "LLM prompt version tag: (.+?), Show best iteration only: (.+?)"/,
Common_Message_Artifact_Tag: /No data matches the filter: "Version tag: (.+?), Show best iteration only: (.+?)"/,
Common_Message_Jobs_Monitoring_Workflow_Project:
/No data matches the filter: "Created at: \d{2}\/\d{2}\/\d{4} \d{2}:\d{2} - \d{2}\/\d{2}\/\d{4} \d{2}:\d{2}, Project: (.+?)"/,
Common_Message_Jobs_Monitoring_Status:
Expand Down
1 change: 1 addition & 0 deletions tests/features/common/page-objects.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,7 @@ export default {
Jobs_Monitoring_Scheduled_Tab: jobsMonitoring['crossScheduledMonitorTab'],
Jobs_Monitor_Tab_Info_Pane: infoPane['jobsMonitorTabInfoPane'],
LLM_Prompts: llmPrompts['llmPrompts'],
LLM_Prompts_Info_Pane: infoPane['llmPromptsInfoPane'],
Metrics_Selector_Popup: interactivePopup['metricsSelectorPopup'],
ML_Function_Info_Pane: infoPane['mlFunctionInfoPane'],
ML_Functions: Functions['mlFunctions'],
Expand Down
Loading