waivers are not getting applied for SCT, BBSR

[smangali-qc]

HI @chetan-rathore ,

we are unable to apply the waiver for SCT, BBSR . few test are failed due to lack of support , we would like apply the waiver for those test.

can we apply waiver for BSA test suite as well since it is recommended test (not mandatory )

Regards,
Shiva Kumar

[Ashishsharma1903]

Hi @shiva Kumar,

Thank you for reaching out regarding the waiver application for test suites.

Regarding SCT and BBSR:
According to the test category specifications, SCT and BBSR test suites are classified as non-waivable (Required for compliance). However, we understand that certain test failures may occur due to platform-specific configurations or lack of optional feature support.

But,we are planning to work on an enhancement to automatically report certain potentially waivable SCT failures as WARNINGs instead of FAILs. These align with the guidance provided in the ARM documentation:
https://developer.arm.com/documentation/107981/0303/Potentially-waivable-failures-for-SystemReady-band-compliance/SCT

This includes failures related to:

PCIe add-in card protocols (HII_CONFIG_ACCESS, EFI_ADAPTER_INFORMATION, COMPONENT_NAME2)
Network boot protocols (EFI_PXE_BASE_CODE, EFI_SIMPLE_NETWORK)
Platform-specific configuration tests

just one request:
Could you please share the complete test logs (SCT and BBSR) so we can review the specific failures you're encountering? This will help us determine if your failing tests match the ones we're planning to convert to permanent warnings, which may resolve your concerns.

Regarding BSA:
Yes, BSA test suites are waivable as they are classified as "Recommended" rather than mandatory for compliance.

Looking forward to your logs for further analysis.

Best regards
Ashish sharma

[smangali-qc]

HI Ashish,

From the logs, we observed that BBSR and BSSR-FWTS are listed as recommended. Could you please confirm which test suites are mandatory and which are recommended? Additionally, for the recommended suites, what is the expectation—should they be executed and then waived if needed, or is it acceptable to skip them entirely if the user chooses not to run them?

BSA :
We are encountering a crash during BSA execution in the latest prebuilt ACS release v25.10_3.1.0 (#528 (comment)). Due to this hang, we are unable to generate the report, and the final summary shows the tests as “Not Run.”
Since BSA is marked as recommended, could you clarify how we should proceed in this situation? Should we attempt to run and waive it, or is it acceptable to skip entirely? We are currently investigating internally why BSA is hanging frequently.

BBSR-FWTS:
After completing the BBSR-UEFI execution, we observed a boot failure because the DTB image is not signed. As a result, the required keys are missing from the ARM prebuilt image.
Our implementation requires authenticating both DTB and EFI using these keys. Since the keys are not included in the WIC image, how can the DTB be authenticated? Could you share details on how this is handled in other systems?

ticket: #458 (comment)

SCT and BBSR-UEFI logs :

EBBR_Summary.log
BBSR_Summary.log

Regards,
Shiva Kumar