Skip to content

Commit

Permalink
QA Sprint 149 done
Browse files Browse the repository at this point in the history
* Updated test for navigation bar
- project monitoring the main screen
- quick-actions the second screen
- Jira: ML-4667

* Created tests for Datasets, Artifacts, Models
- Check filter by "All" tag is performed when version tag was edited
- Jira: ML-4158

* Updated/created tests for Batch Inference
- update mock with batch inference_v2
- create test for check components (batch inference_v2, preview text, model path type store)
- Jira: ML-4485, ML-4781, ML-4697

---------

Co-authored-by: Olena Zhelnytska <olena.zhelnytska@medtronic.com>
  • Loading branch information
2 people authored and ilan7empest committed Nov 2, 2023
1 parent 78160f7 commit 1b9cc1a
Show file tree
Hide file tree
Showing 14 changed files with 5,400 additions and 4,318 deletions.
3 changes: 3 additions & 0 deletions tests/features/common-tools/common-consts.js
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,9 @@ module.exports = {
Parameters_Table_Header_Hyper: ['Hyper','Name', 'Type', 'Value'],
Image_Name_Text: 'The image must include all the software packages that are required to run the function. For example, for an XGBoost model, ensure that the image includes the correct XGboost package and version'
},
Batch_Inference: {
Model_Path_Type_Store: ['MLRun store']
},
Register_Artifact: {
Type_Options: ['General', 'Chart', 'Plot', 'Table'],
Form_Text:
Expand Down
16 changes: 9 additions & 7 deletions tests/features/common/page-objects/commonPagesHeader.po.js
Original file line number Diff line number Diff line change
Expand Up @@ -57,17 +57,14 @@ module.exports = {
Project_Settings_Icon: By.css(
'.ml-app .navbar .navbar__additional .navbar-links svg'
),
Project_Monitoring_Button: By.css(
'.navbar .navbar__body .navbar__content .navbar-links #monitor'
),
Pin_Quick_Link_Button: By.css(
'.navbar .navbar__body .tooltip-wrapper button.round-icon-cp__circle'
),
Navigation_Bar: By.css('.ml-app .navbar'),
Project_Home_Button: By.css('#home > span'),
Project_Home_Icon: By.css('#home > svg'),
Project_Monitoring_Button_Text: By.css('#monitor > span'),
Project_Monitoring_Button: By.css('#monitor > span'),
Project_Monitoring_Icon: By.css('#monitor > svg'),
Quick_actions_Button: By.css('#quick-actions > span'),
Quick_actions_Icon: By.css('#quick-actions > svg'),
Feature_Store_Button: By.css('#feature-store > span'),
Feature_Store_Icon: By.css('#feature-store > svg'),
Datasets_Button: By.css('#datasets > span'),
Expand All @@ -84,5 +81,10 @@ module.exports = {
Real_Time_Functions_Icon: By.css('.ml-app .navbar .navbar__content .navbar-links .nav-link:nth-of-type(9) svg'),
API_Gateways_Button: By.css('.ml-app .navbar .navbar__content .navbar-links .nav-link:nth-of-type(10) span'),
API_Gateways_Icon: By.css('.ml-app .navbar .navbar__content .navbar-links .nav-link:nth-of-type(10) svg'),
General_Info_Quick_Panel: By.css('.ml-app .navbar .navbar__body')
General_Info_Quick_Panel: By.css('.ml-app .navbar .navbar__body'),
Project_Quick_Actions_Instance: By.css('.project-details__details .link'),
Quick_actions_Active: By.css('#quick-actions'),
Project_Monitoring_First_Instance: By.css('.project-details__details .link'),
Project_Monitoring_Second_Instance: By.css('.project-overview-card:nth-of-type(3) .link:nth-of-type(4)'),
Project_Monitoring_Active: By.css('#monitor'),
}
15 changes: 15 additions & 0 deletions tests/features/common/page-objects/project.po.js
Original file line number Diff line number Diff line change
Expand Up @@ -443,6 +443,21 @@ module.exports = {
Refresh_Button: By.css('.page-actions .round-icon-cp')
},
batchInference: {
Function_Title: By.css(
'.modal .modal__content h6.modal__header-sub-title'
),
Form_Header_Batch_Run: By.css('.form .form-row .form-step-title'),
Edit_Button: By.css('.form-table__row:nth-of-type(3) .form-table__actions-cell .round-icon-cp:nth-of-type(1)'),
Data_Inputs_Path_Dropdown: dropdownComponent(
generateDropdownGroup(
'.form-table__row_active .form-field-combobox',
'.form-field-combobox__select',
'.form-field-combobox__dropdown-list-option'
)
),
Preview_text: By.css(
'.modal .modal__content .modal__header-preview-text'
),
Next_Button: By.css(
'.modal__footer .btn-secondary'
),
Expand Down
46 changes: 37 additions & 9 deletions tests/features/datasets.feature
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,7 @@ Feature: Datasets Page
Then verify redirection from "projects/INVALID/datasets/test_ds/latest/0/overview" to "projects"
Then verify redirection from "projects/default/INVALID/test_ds/latest/0/overview" to "projects"

Scenario: Check active/highlited items with details panel on Models tab
Scenario: Check active/highlited items with details panel on Datasets
Given open url
And wait load page
And click on row root with value "churn-project-admin" in "name" column in "Projects_Table" table on "Projects" wizard
Expand All @@ -334,21 +334,21 @@ Feature: Datasets Page
And click on cell with value "Datasets" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then click on cell with row index 1 in "name" column in "Datasets_Table" table on "Datasets" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Header" element visibility on "Models_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Datasets_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Datasets_Info_Pane" wizard
Then verify "Header" element visibility on "Datasets_Info_Pane" wizard
Then save to context "name" column on 1 row from "Datasets_Table" table on "Datasets" wizard
Then compare "Header" element value on "Models_Info_Pane" wizard with test "name" context value
Then compare "Header" element value on "Datasets_Info_Pane" wizard with test "name" context value
Then verify that row index 1 is active in "Datasets_Table" table on "Datasets" wizard
Then verify that row index 2 is NOT active in "Datasets_Table" table on "Datasets" wizard
Then click on cell with row index 2 in "name" column in "Datasets_Table" table on "Datasets" wizard
Then verify that row index 2 is active in "Datasets_Table" table on "Datasets" wizard
Then verify that row index 1 is NOT active in "Datasets_Table" table on "Datasets" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Header" element visibility on "Models_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Datasets_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Datasets_Info_Pane" wizard
Then verify "Header" element visibility on "Datasets_Info_Pane" wizard
Then save to context "name" column on 2 row from "Datasets_Table" table on "Datasets" wizard
Then compare "Header" element value on "Models_Info_Pane" wizard with test "name" context value
Then compare "Header" element value on "Datasets_Info_Pane" wizard with test "name" context value

Scenario: MLD009 - Check that version tag is filled when edit it in table view and full view on Overview tab table on Datasets page
Given open url
Expand Down Expand Up @@ -424,4 +424,32 @@ Scenario: MLD011 - Check that version tag has "Click to add" status when it's em
When click on cell with row index 1 in "name" column in "Datasets_Table" table on "Datasets" wizard
And wait load page
Then "Version_Tag_Input_Placeholder" element on "Datasets_Info_Pane" should contains "Click to add" value

Scenario: MLD012 - Check filter by "All" tag is performed when version tag was edited
Given open url
And wait load page
And click on row root with value "default" in "name" column in "Projects_Table" table on "Projects" wizard
And wait load page
And hover "Project_Navigation_Toggler" component on "commonPagesHeader" wizard
And click on cell with value "Datasets" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then click on "Table_FilterBy_Button" element on "Datasets" wizard
Then select "All" option in "Table_Tree_Filter_Dropdown" dropdown on "Artifacts_FilterBy_Popup" wizard
Then click on "Apply_Button" element on "Artifacts_FilterBy_Popup" wizard
And wait load page
Then click on cell with row index 2 in "name" column in "Datasets_Table" table on "Datasets" wizard
Then save to context "name" column on 2 row from "Datasets_Table" table on "Datasets" wizard
Then compare "Header" element value on "Datasets_Info_Pane" wizard with test "name" context value
Then check "latest" value in "tag" column in "Overview_Table" table on "Datasets_Info_Pane" wizard
Then click on "Edit_btn_table_view" element on "Datasets_Info_Pane" wizard
Then type value "latest123456" to "Version_tag_Input" field on "Datasets_Info_Pane" wizard
Then click on "Apply_Button" element on "Datasets_Info_Pane" wizard
Then click on "Apply_Changes_Button" element on "Datasets_Info_Pane" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" on "Datasets_Info_Pane" wizard should contains "Datasets_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Datasets_Info_Pane" wizard
Then verify "Overview_General_Headers" on "Datasets_Info_Pane" wizard should contains "Datasets_Info_Pane"."Overview_General_Headers"
Then check "latest123456" value in "tag" column in "Overview_Table" table on "Datasets_Info_Pane" wizard
Then save to context "name" column on 2 row from "Datasets_Table" table on "Datasets" wizard
Then compare "Header" element value on "Datasets_Info_Pane" wizard with test "name" context value

48 changes: 38 additions & 10 deletions tests/features/files.feature
Original file line number Diff line number Diff line change
Expand Up @@ -390,7 +390,7 @@ Feature: Files Page
Then verify redirection from "projects/automation-test-011/files/test_file/latest/IVNALID/overview" to "projects/automation-test-011/files"
Then verify redirection from "projects/INVALID/files" to "projects"

Scenario: Check active/highlited items with details panel on Models tab
Scenario: Check active/highlited items with details panel on Artifacts
Given open url
And wait load page
And click on row root with value "default" in "name" column in "Projects_Table" table on "Projects" wizard
Expand All @@ -399,21 +399,21 @@ Feature: Files Page
And click on cell with value "Artifacts" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then click on cell with row index 1 in "name" column in "Files_Table" table on "Files" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Header" element visibility on "Models_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then save to context "name" column on 1 row from "Files_Table" table on "Files" wizard
Then compare "Header" element value on "Models_Info_Pane" wizard with test "name" context value
Then compare "Header" element value on "Files_Info_Pane" wizard with test "name" context value
Then verify that row index 1 is active in "Files_Table" table on "Files" wizard
Then verify that row index 2 is NOT active in "Files_Table" table on "Files" wizard
Then click on cell with row index 2 in "name" column in "Files_Table" table on "Files" wizard
Then verify that row index 2 is active in "Files_Table" table on "Files" wizard
Then verify that row index 1 is NOT active in "Files_Table" table on "Files" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Header" element visibility on "Models_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Files_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Header" element visibility on "Files_Info_Pane" wizard
Then save to context "name" column on 2 row from "Files_Table" table on "Files" wizard
Then compare "Header" element value on "Models_Info_Pane" wizard with test "name" context value
Then compare "Header" element value on "Files_Info_Pane" wizard with test "name" context value

Scenario: MLA009 - Check that version tag is filled when edit it in table view and full view on Overview tab table on Artifacts page
Given open url
Expand Down Expand Up @@ -488,4 +488,32 @@ Scenario: MLA011 - Check that version tag has "Click to add" status when it's em
And wait load page
When click on cell with row index 1 in "name" column in "Files_Table" table on "Files" wizard
And wait load page
Then "Version_Tag_Input_Placeholder" element on "Files_Info_Pane" should contains "Click to add" value
Then "Version_Tag_Input_Placeholder" element on "Files_Info_Pane" should contains "Click to add" value

Scenario: MLA012 - Check filter by "All" tag is performed when version tag was edited
Given open url
And wait load page
And click on row root with value "default" in "name" column in "Projects_Table" table on "Projects" wizard
And wait load page
And hover "Project_Navigation_Toggler" component on "commonPagesHeader" wizard
And click on cell with value "Artifacts" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then click on "Table_FilterBy_Button" element on "Files" wizard
Then select "All" option in "Table_Tree_Filter_Dropdown" dropdown on "Artifacts_FilterBy_Popup" wizard
Then click on "Apply_Button" element on "Artifacts_FilterBy_Popup" wizard
And wait load page
Then click on cell with row index 2 in "name" column in "Files_Table" table on "Files" wizard
Then save to context "name" column on 2 row from "Files_Table" table on "Files" wizard
Then compare "Header" element value on "Files_Info_Pane" wizard with test "name" context value
Then check "latest" value in "tag" column in "Overview_Table" table on "Files_Info_Pane" wizard
Then click on "Edit_btn_table_view" element on "Files_Info_Pane" wizard
Then type value "latest123456" to "Version_tag_Input" field on "Files_Info_Pane" wizard
Then click on "Apply_Button" element on "Files_Info_Pane" wizard
Then click on "Apply_Changes_Button" element on "Files_Info_Pane" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Files_Info_Pane" wizard
Then verify "Overview_General_Headers" on "Files_Info_Pane" wizard should contains "Files_Info_Pane"."Overview_General_Headers"
Then check "latest123456" value in "tag" column in "Overview_Table" table on "Files_Info_Pane" wizard
Then save to context "name" column on 2 row from "Files_Table" table on "Files" wizard
Then compare "Header" element value on "Files_Info_Pane" wizard with test "name" context value
30 changes: 29 additions & 1 deletion tests/features/models.feature
Original file line number Diff line number Diff line change
Expand Up @@ -881,4 +881,32 @@ Scenario: MLM023 - Check that version tag has "Click to add" status when it's em
And wait load page
When click on cell with row index 2 in "name" column in "Models_Table" table on "Models" wizard
And wait load page
Then "Version_Tag_Input_Placeholder" element on "Models_Info_Pane" should contains "Click to add" value
Then "Version_Tag_Input_Placeholder" element on "Models_Info_Pane" should contains "Click to add" value

Scenario: MLM024 - Check filter by "All" tag is performed when version tag was edited
Given open url
And wait load page
And click on row root with value "default" in "name" column in "Projects_Table" table on "Projects" wizard
And wait load page
And hover "Project_Navigation_Toggler" component on "commonPagesHeader" wizard
And click on cell with value "Models" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And wait load page
Then click on "Table_FilterBy_Button" element on "Models" wizard
Then select "All" option in "Table_Tree_Filter_Dropdown" dropdown on "Artifacts_FilterBy_Popup" wizard
Then click on "Apply_Button" element on "Artifacts_FilterBy_Popup" wizard
And wait load page
Then click on cell with row index 3 in "name" column in "Models_Table" table on "Models" wizard
Then save to context "name" column on 3 row from "Models_Table" table on "Models" wizard
Then compare "Header" element value on "Models_Info_Pane" wizard with test "name" context value
Then check "latest" value in "tag" column in "Overview_Table" table on "Models_Info_Pane" wizard
Then click on "Edit_btn_table_view" element on "Models_Info_Pane" wizard
Then type value "latest123456" to "Version_tag_Input" field on "Models_Info_Pane" wizard
Then click on "Apply_Button" element on "Models_Info_Pane" wizard
Then click on "Apply_Changes_Button" element on "Models_Info_Pane" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard should contains "Models_Info_Pane"."Tab_List"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Overview_General_Headers" on "Models_Info_Pane" wizard should contains "Models_Info_Pane"."Overview_General_Headers"
Then check "latest123456" value in "tag" column in "Overview_Table" table on "Models_Info_Pane" wizard
Then save to context "name" column on 3 row from "Models_Table" table on "Models" wizard
Then compare "Header" element value on "Models_Info_Pane" wizard with test "name" context value
Loading

0 comments on commit 1b9cc1a

Please sign in to comment.