Skip to content

Conversation

@devanshjainms
Copy link
Contributor

This pull request introduces significant documentation improvements and adds a new guide for configuration checks to the SAP Testing Automation Framework. The main changes clarify the framework’s supported scenarios, improve onboarding instructions, and provide detailed usage information for configuration validation and offline cluster validation. These updates enhance clarity for users and contributors, and better organize documentation for both high availability and configuration checks scenarios.

Documentation and Usage Improvements

  • The README.md has been extensively revised to clarify supported scenarios, distinguish between High Availability Testing (GA) and Configuration Checks (Public Preview), and provide improved onboarding instructions for both standalone and SDAF-integrated setups. New sections detail key features, architecture, and test execution modes, and deprecated the prior configuration matrix in favor of scenario-driven documentation.
  • Additional resource links have been updated in README.md to reference the new Configuration Checks and High Availability Testing guides, making it easier for users to find scenario-specific documentation.

New and Enhanced Guides

  • A new docs/CONFIGURATION_CHECKS.md guide has been added, providing comprehensive instructions for running SAP configuration checks, including prerequisites, access requirements, execution steps, and report viewing. This guide formalizes and extends previous quality check scripts, offering a more extensible and maintainable solution.
  • The docs/HA_OFFLINE_VALIDATION.md guide has been rewritten for clarity, with improved explanations of offline validation, architecture, required directory structure, and step-by-step instructions for performing SAP HA cluster validation using CIB XML files. [1] [2]

Configuration and Linting Updates

  • The .ansible-lint configuration has been updated to exclude the src/roles/configuration_checks/tasks/files/ directory from linting, aligning the linting process with the new configuration checks module.

Copilot AI review requested due to automatic review settings October 28, 2025 23:29
@devanshjainms devanshjainms requested a review from a team as a code owner October 28, 2025 23:29
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces a new configuration checks framework (v2 of SAP Quality Checks) alongside significant updates to the existing functional test framework. The changes include renaming variables from snake_case to UPPER_SNAKE_CASE for consistency, adding comprehensive test coverage for new modules, and enhancing the HTML reporting template.

Key Changes

  • Introduction of a new configuration checks module with comprehensive validation capabilities
  • Variable naming standardization from sap_functional_test_type to SAP_FUNCTIONAL_TEST_TYPE
  • Addition of resource name separation for HANA clone vs primitive resources (SAPHanaSR-angi support)
  • Enhanced HTML templates for configuration checks reporting
  • New test files with over 2400 lines of comprehensive test coverage

Reviewed Changes

Copilot reviewed 65 out of 66 changed files in this pull request and generated 22 comments.

Show a summary per file
File Description
vars.yaml Updated variable names and added ConfigurationChecks as new TEST_TYPE option
src/vars/input-api.yaml Added configuration_test_type_map and renamed HANA resource command references
src/templates/azure-pipeline.yml Renamed parameters to use UPPER_SNAKE_CASE and updated template references
src/templates/report.html Added test message formatting and improved newline handling
src/templates/config_checks_report.html New comprehensive HTML template for configuration checks (1603 lines)
src/roles/misc/tasks/*.yml Updated to use new variable naming and added primitive resource ID support
src/roles/ha_db_hana/tasks/*.yml Enhanced HANA resource handling for both clone and primitive IDs
src/roles/ha_db_hana/tasks/files/constants.yaml Added azureevents resource, updated pcmk_delay_max values, restructured GLOBAL_INI
src/roles/ha_scs/tasks/files/constants.yaml Updated pcmk_delay_max to support both numeric and time unit formats
src/roles/configuration_checks/* New role with comprehensive configuration check framework
tests/* Added extensive test coverage for new modules (3 new test files with 2300+ lines)
requirements.in Added azure-mgmt-compute dependency

hdamecharla
hdamecharla previously approved these changes Oct 29, 2025
Copy link
Member

@hdamecharla hdamecharla left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved

…n collector and filesystem_collector modules; enhance tests by removing unnecessary assertions and print statements. (#147)
Copy link
Contributor

@dhruvmicrosoft dhruvmicrosoft left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG!

@devanshjainms devanshjainms merged commit 32daf5d into main Oct 30, 2025
12 checks passed
@devanshjainms devanshjainms deleted the development-oct-2025 branch October 30, 2025 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants