Skip to content

[Fix] Update wildcard subscription to exclude atomic write attributes and CGEN_2_2 test#72742

Open
j-ororke wants to merge 3 commits into
project-chip:masterfrom
j-ororke:fix-72732-framework-wildcard-subscription-exlusions
Open

[Fix] Update wildcard subscription to exclude atomic write attributes and CGEN_2_2 test#72742
j-ororke wants to merge 3 commits into
project-chip:masterfrom
j-ororke:fix-72732-framework-wildcard-subscription-exlusions

Conversation

@j-ororke

@j-ororke j-ororke commented Jun 25, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds parsing for atomicWrite / atomic-write attributes in spec_parsing
  • Processes that metadata during setup so atomic-write attributes are excluded from wildcard subscription verification
  • TC_CGEN_2_2: opt out of the framework wildcard subscription (disable_wildcard_subscription = True), since its ArmFailSafe add/rollback cycles churn fabric/ACL state and cause spurious subscription cache mismatches (#72732).
  • Adding default PICS file to TSTAT tests in CI args so that those tests run all the test steps as expected without skipping most of them this was noticed due to TSTAT_4_2 failing as reported in #72732 by Ingo and when run locally we noticed issue [BUG] SetActivePreset does not trigger a subscription report for ActivePresetHandle attribute #43582: Thermostat ActivePresetHandle attribute does not emit attribute reports on changes. Which is now surfaced in this PR.

Related issues

Resolves: #72732

Testing

CGEN_2_2:

scripts/tests/run_python_test.py --factory-reset --app out/linux-x64-all-clusters/chip-all-clusters-app --app-args "--discriminator 1234 --passcode 20202021 --KVS kvs1" --script-args "--storage-path admin_storage.json --discriminator 1234 --passcode 20202021 --PICS src/app/tests/suites/certification/ci-pics-values --endpoint 0 --commissioning-method on-network --int-arg PIXIT.CGEN.FailsafeExpiryLengthSeconds:1" --script src/python_testing/TC_CGEN_2_2.py

… and CGEN_2_2 test

- Adds parsing for atomicWrite / atomic-write attributes in spec_parsing
- Processes that metadata during setup so atomic-write attributes are excluded from wildcard subscription verification
- Adds the full per-test-class opt-out with disable_wildcard_subscription = True for CGEN_2_2 test module
@j-ororke j-ororke self-assigned this Jun 25, 2026
@github-actions github-actions Bot added the tests label Jun 25, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request disables framework wildcard subscription in TC_CGEN_2_2.py and adds support for parsing the atomic_write attribute quality from XML specifications. The feedback suggests updating _is_atomic_write_attribute to check for both atomicWrite and atomic-write attributes to ensure full compatibility with different XML formats.

@github-actions

github-actions Bot commented Jun 25, 2026

Copy link
Copy Markdown

PR #72742: Size comparison from 413ff63 to 6869f9d

Full report (33 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, psoc6, qpg, realtek, stm32, telink)
platform target config section 413ff63 6869f9d change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1099176 1099176 0 0.0
RAM 133418 133418 0 0.0
bl702 lighting-app bl702+eth FLASH 1085726 1085726 0 0.0
RAM 109029 109029 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 882218 882218 0 0.0
RAM 108596 108596 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 777368 777368 0 0.0
RAM 103404 103404 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 790120 790120 0 0.0
RAM 108684 108684 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 739376 739376 0 0.0
RAM 97612 97612 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 719548 719548 0 0.0
RAM 97644 97644 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 569654 569654 0 0.0
RAM 205112 205112 0 0.0
lock CC3235SF_LAUNCHXL FLASH 597214 597214 0 0.0
RAM 205272 205272 0 0.0
efr32 lighting-app BRD4187C FLASH 1094924 1094924 0 0.0
RAM 135256 135256 0 0.0
lock-app BRD4187C FLASH 995184 995184 0 0.0
RAM 131292 131292 0 0.0
BRD4338a FLASH 799809 799809 0 0.0
RAM 243432 243432 0 0.0
esp32 all-clusters-app c3devkit DRAM 99556 99556 0 0.0
FLASH 1626146 1626146 0 0.0
IRAM 94776 94776 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 844772 844772 0 0.0
RAM 157771 157771 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1750756 1750756 0 0.0
RAM 215492 215492 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1626548 1626548 0 0.0
RAM 211604 211604 0 0.0
light cy8ckit_062s2_43012 FLASH 1470860 1470860 0 0.0
RAM 197436 197436 0 0.0
lock cy8ckit_062s2_43012 FLASH 1504308 1504308 0 0.0
RAM 225268 225268 0 0.0
qpg lighting-app qpg6200+debug FLASH 843156 843156 0 0.0
RAM 127908 127908 0 0.0
lock-app qpg6200+debug FLASH 782976 782976 0 0.0
RAM 118840 118840 0 0.0
realtek light-switch-app rtl8777g FLASH 689368 689368 0 0.0
RAM 101780 101780 0 0.0
lighting-app rtl8777g FLASH 730304 730304 0 0.0
RAM 102052 102052 0 0.0
stm32 light STM32WB5MM-DK FLASH 478976 478976 0 0.0
RAM 141492 141492 0 0.0
telink all-devices-app tl7218x FLASH 881716 881716 0 0.0
RAM 99716 99716 0 0.0
tlsr9118bdk40d FLASH 673322 673322 0 0.0
RAM 120848 120848 0 0.0
bridge-app tl7218x FLASH 734156 734156 0 0.0
RAM 97700 97700 0 0.0
light-app-ota-compress-lzma-factory-data tl3218x FLASH 800682 800682 0 0.0
RAM 42380 42380 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl7218x FLASH 845822 845822 0 0.0
RAM 101492 101492 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 734714 734714 0 0.0
RAM 57824 57824 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 795802 795802 0 0.0
RAM 75176 75176 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 734630 734630 0 0.0
RAM 34480 34480 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 615214 615214 0 0.0
RAM 118508 118508 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 842038 842042 4 0.0
RAM 97376 97376 0 0.0

@codecov

codecov Bot commented Jun 25, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 56.79%. Comparing base (413ff63) to head (dfb13da).

Additional details and impacted files
@@           Coverage Diff           @@
##           master   #72742   +/-   ##
=======================================
  Coverage   56.79%   56.79%           
=======================================
  Files        1642     1642           
  Lines      112757   112757           
  Branches    13139    13139           
=======================================
  Hits        64040    64040           
  Misses      48717    48717           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@j-ororke j-ororke marked this pull request as ready for review June 25, 2026 21:37
@github-actions

github-actions Bot commented Jun 26, 2026

Copy link
Copy Markdown

PR #72742: Size comparison from 413ff63 to dfb13da

Full report (33 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, psoc6, qpg, realtek, stm32, telink)
platform target config section 413ff63 dfb13da change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1099176 1099176 0 0.0
RAM 133418 133418 0 0.0
bl702 lighting-app bl702+eth FLASH 1085726 1085726 0 0.0
RAM 109029 109029 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 882218 882218 0 0.0
RAM 108596 108596 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 777368 777368 0 0.0
RAM 103404 103404 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 790120 790120 0 0.0
RAM 108684 108684 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 739376 739376 0 0.0
RAM 97612 97612 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 719548 719548 0 0.0
RAM 97644 97644 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 569654 569654 0 0.0
RAM 205112 205112 0 0.0
lock CC3235SF_LAUNCHXL FLASH 597214 597214 0 0.0
RAM 205272 205272 0 0.0
efr32 lighting-app BRD4187C FLASH 1094924 1094924 0 0.0
RAM 135256 135256 0 0.0
lock-app BRD4187C FLASH 995184 995184 0 0.0
RAM 131292 131292 0 0.0
BRD4338a FLASH 799809 799809 0 0.0
RAM 243432 243432 0 0.0
esp32 all-clusters-app c3devkit DRAM 99556 99556 0 0.0
FLASH 1626146 1626146 0 0.0
IRAM 94776 94776 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 844772 844772 0 0.0
RAM 157771 157771 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1750756 1750756 0 0.0
RAM 215492 215492 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1626548 1626548 0 0.0
RAM 211604 211604 0 0.0
light cy8ckit_062s2_43012 FLASH 1470860 1470860 0 0.0
RAM 197436 197436 0 0.0
lock cy8ckit_062s2_43012 FLASH 1504308 1504308 0 0.0
RAM 225268 225268 0 0.0
qpg lighting-app qpg6200+debug FLASH 843156 843156 0 0.0
RAM 127908 127908 0 0.0
lock-app qpg6200+debug FLASH 782976 782976 0 0.0
RAM 118840 118840 0 0.0
realtek light-switch-app rtl8777g FLASH 689368 689368 0 0.0
RAM 101780 101780 0 0.0
lighting-app rtl8777g FLASH 730304 730304 0 0.0
RAM 102052 102052 0 0.0
stm32 light STM32WB5MM-DK FLASH 478976 478976 0 0.0
RAM 141492 141492 0 0.0
telink all-devices-app tl7218x FLASH 881716 881716 0 0.0
RAM 99716 99716 0 0.0
tlsr9118bdk40d FLASH 673322 673322 0 0.0
RAM 120848 120848 0 0.0
bridge-app tl7218x FLASH 734156 734156 0 0.0
RAM 97700 97700 0 0.0
light-app-ota-compress-lzma-factory-data tl3218x FLASH 800682 800682 0 0.0
RAM 42380 42380 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl7218x FLASH 845822 845822 0 0.0
RAM 101492 101492 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 734714 734714 0 0.0
RAM 57824 57824 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 795802 795802 0 0.0
RAM 75176 75176 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 734630 734630 0 0.0
RAM 34480 34480 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 615214 615214 0 0.0
RAM 118508 118508 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 842038 842042 4 0.0
RAM 97376 97376 0 0.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CERT-TEST-FAILURE] Base-Wildcard-Subscription-Check from #43274 is based on wrong assumptions and btreaks tests

1 participant