Category: test

OBSERVABILITY PTS Smoke Test

Prerequisites

• Configure credentials with least privilege (ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET / optional ALICLOUD_REGION_ID ) if you plan to execute real PTS APIs.

• Target skill: skills/observability/pts/alicloud-observability-pts/ .

• Optional online SDK test dependency:

python -m pip install -U alibabacloud_pts20201020 alibabacloud_tea_openapi

Test Steps

• Run offline script compilation check (no network needed):

python3 tests/common/compile_skill_scripts.py
--skill-path skills/observability/pts/alicloud-observability-pts
--output output/alicloud-observability-pts-test/compile-check.json

• Run metadata API discovery script:

python3 skills/observability/pts/alicloud-observability-pts/scripts/list_openapi_meta_apis.py
--product-code PTS
--version 2020-10-20
--output-dir output/alicloud-observability-pts-test

• Verify generated files and API count:

test -f output/alicloud-observability-pts-test/PTS_2020-10-20_api_docs.json test -f output/alicloud-observability-pts-test/PTS_2020-10-20_api_list.md rg -n "API count: [1-9][0-9]*" output/alicloud-observability-pts-test/PTS_2020-10-20_api_list.md

• Save request summary, response summary, and raw output under output/alicloud-observability-pts-test/ .

• If the call fails, record exact error code/message without guessing.

Optional Online Read-only Check

Run one bounded read-only scene query:

python3 skills/observability/pts/alicloud-observability-pts/scripts/list_pts_scenes.py
--region "${ALICLOUD_REGION_ID:-cn-hangzhou}"
--page-number 1
--page-size 10
--json
--output output/alicloud-observability-pts-test/list-scenes.json

Then verify output contains response metadata:

rg -n '"RequestId"|"Success"|"Code"' output/alicloud-observability-pts-test/list-scenes.json

Pass Criteria

• Script compilation check passes (compile-check.json.status=pass ).

• Metadata API discovery succeeds and produces both JSON and markdown output files.

• API list markdown shows a positive API count.

• Evidence files exist in output/alicloud-observability-pts-test/ .

• Optional online read-only check returns a valid PTS response structure.

Result Template

• Date: YYYY-MM-DD

• Skill: skills/observability/pts/alicloud-observability-pts

• Conclusion: pass / fail

• Notes: