project-chip/certification-tool

View on GitHub

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.

Stars: 82
Forks: 47
Open beginner issues: 0
Indexed issues: 51
Avg merge: 1d 15h
Merged PRs (30d): 17

Dominant language: Shell
License: Apache-2.0
Last GitHub push: Sep 10, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

51 open issues indexed

[CLI] Add commands to archive/unarchive a test run execution Open

CLI

project-chip/certification-tool#1120 · 1 assignee · Opened Sep 18, 2026
Perf: end-of-test-case log replay + single end-of-run DB commit cause long tail latency on constrained hosts (e.g. Raspberry Pi) Open

Backend CLI Enhancement

project-chip/certification-tool#1119 · 1 assignee · Opened Sep 17, 2026
wifi_container image (and other TH images) still build on Ubuntu 22.04 instead of 24.04 Open

project-chip/certification-tool#1122 · 1 assignee · Opened Sep 16, 2026
WiFiContainer.start() silently reuses stale fixture config when the container is already running Open

project-chip/certification-tool#1121 · 1 assignee · Opened Sep 16, 2026
[Feature] MOTD enhancement for TH information Open

Feature Needs Triage

project-chip/certification-tool#1109 · 1 assignee · Opened Sep 10, 2026
[Bug][WebRTC] Sequential TC-WEBRTC tests lose video preview because /ws/video rebinds UDP port 5000 Open

Bug Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 68/100

project-chip/certification-tool#1080 · Opened Aug 19, 2026
[Bug] TC-GRPKEY-2.2 : Test harness backward compatibility issue TH V1.6 Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 38/100

project-chip/certification-tool#1077 · 2 comments · Opened Aug 12, 2026
[Feature] CADMIN 1.3 Add test case "Timeout" Error as possibility in documentation Open

Feature Needs Triage

Difficulty 2/5 1-3 hours Newbie friendliness 62/100

project-chip/certification-tool#1074 · 1 comment · Opened Aug 11, 2026
Support NFC-Ethernet pairing mode for python_testing (SDK) tests Open

project-chip/certification-tool#1067 · 1 assignee · Opened Jul 27, 2026
[Bug] v2.15+spring2026 installation on Raspberry Pi 5 failed at installing new packages to a pristine ubuntu 24.04 LTS server Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#1064 · 2 comments · Opened Jul 22, 2026
[Bug] Concrete Test errors not visible in Matter 1.6.1 tests Open

Bug Found in 1.6.1_MVE Needs Triage

project-chip/certification-tool#1055 · 24 comments · 1 assignee · Opened Jul 21, 2026
【TC-OCC-2.2】OccupancySensorTypeEnum Missing Enums for New Matter 1.5 Sensor Feature Modalities Open

Bug Needs Triage

Difficulty 5/5 Over a week Newbie friendliness 25/100

project-chip/certification-tool#1042 · Opened Jul 9, 2026
[Bug] chip-tool interactive server hangs during ble-wifi commissioning — WebSocket closes with 1011 keepalive ping timeout, aborting FirstChipToolSuite (TC-ACL-2.1) Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#1037 · 1 comment · Opened Jul 7, 2026
[Bug] TC-IDM-10.4 check TSTAT.S.Cfe.Rsp & TSTAT.S.Cfd.Tx Open

Bug Needs Triage

project-chip/certification-tool#1035 · 6 comments · 1 assignee · Opened Jul 6, 2026
[Bug] th-cli calls /api/v1/version on every invocation (slow when backend is unreachable) Open

Bug CLI

Difficulty 2/5 1-3 hours Newbie friendliness 82/100

project-chip/certification-tool#1005 · Opened May 26, 2026
[Feature] UG - Update documentation regarding Python suites as they are renamed Open

Documentation Feature

project-chip/certification-tool#993 · 1 assignee · Opened May 20, 2026
[Bug] Auto Install Error Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#986 · 3 comments · Opened May 8, 2026
[Bug] [TC-CADMIN-1.7] The User Consent screen does not pops up before Manual Code screen. Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 45/100

project-chip/certification-tool#982 · Opened May 6, 2026
[Feature] [SVE 1.6] NodeID is not printed 1st test case in CLI Open

Feature Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 52/100

project-chip/certification-tool#965 · 3 comments · Opened Apr 22, 2026
[Bug] Need to copy commissioner_dut folder in Test Harness Open

Bug Needs Triage

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

project-chip/certification-tool#954 · Opened Apr 20, 2026
[Bug] Missing Video/Audio Prompt in TH-CLI Causes TC-WEBRTC-1.6 Step 7 Failure (NotFound Error) Open

1.6_SVE-QA found 1.7-qa-required Bug cameras Needs to be fixed for 1.6.1 release Needs Triage V1.6 v1.7

project-chip/certification-tool#946 · 18 comments · 2 assignees · Opened Apr 14, 2026
[Bug] [v2.14.1+winter2026] TC-PAVST-related test items failed because TLS commands were sent to endpoint 1 and encountered errors. Open

Bug Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 48/100

project-chip/certification-tool#938 · 1 comment · Opened Apr 1, 2026
[Bug] [v2.14.1+winter2026] TC_PAVSTI_1_1, TC_PAVSTI_1_2 failed for not support H265 video Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#937 · 2 comments · Opened Mar 31, 2026
[Bug] [v2.14.1+winter2026] TC-PAVSTI-1.1, TC-PAVSTI-1.2 test failed if dut send audio and video both Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#936 · 1 comment · Opened Mar 31, 2026
[Bug] TC-IDM-10.5 Adding extra clusters to a standard device type will cause the test to fail Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 38/100

project-chip/certification-tool#933 · Opened Mar 25, 2026
[Bug] [v2.15-beta2.1+spring2026] TC-WEBRTCP-2.2 TC-WEBRTCP-2.3 TC-WEBRTCP-2.5 faild Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#924 · 3 comments · Opened Mar 23, 2026
[Bug] High CPU Usage Using CLI Open

Backend Bug

project-chip/certification-tool#911 · 1 assignee · Opened Mar 10, 2026
[Bug] TC-SU-2.2: Step 2 Can Time Out Because DUT May Still Be in Downloading When AnnounceOTAProvider Is Sent Open

Bug Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 48/100

project-chip/certification-tool#906 · Opened Mar 5, 2026
[Bug] [TC_SU_2.2] Test Case Status Shows Pending After Successful Execution Open

Awaiting Originator Feedback Bug Needs Triage

project-chip/certification-tool#891 · 6 comments · 2 assignees · Opened Feb 27, 2026
[Bug] [Matter v1.4.2 TH] TC-BINFO-2.2 Failed – Manual log file expected, but no manual step is present Open

Bug Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 35/100

project-chip/certification-tool#890 · Opened Feb 26, 2026
[Bug] [Matter v1.4.2 TH]Second Fabric commissioning ingored in TC-ACL-2.10 Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

project-chip/certification-tool#889 · Opened Feb 26, 2026
[Bug] [Matter V1.4.2] TC-DGGEN-2.1 Failed Due to >= not supported between instances of 'int' and 'NoneType' Open

Bug Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 35/100

project-chip/certification-tool#887 · Opened Feb 25, 2026
[BUG] CLI API Client Workaround Removal Open

CLI Enhancement On Hold

project-chip/certification-tool#885 · 1 comment · 1 assignee · Opened Feb 25, 2026
[Bug] TC-DGGEN-2_1 Gives error in execution V1.5 Harness Open

Bug Needs Triage

Difficulty 4/5 3-5 days Newbie friendliness 30/100

project-chip/certification-tool#883 · Opened Feb 20, 2026
[Bug] TC-SC-4_1 does execute properly Open

Bug Needs Triage

Difficulty 3/5 1-2 days Newbie friendliness 35/100

project-chip/certification-tool#882 · 1 comment · Opened Feb 20, 2026
[Feature] Support for running different versions simultaneously Open

Feature Needs Triage

Difficulty 5/5 Over a week Newbie friendliness 25/100

project-chip/certification-tool#862 · Opened Jan 30, 2026
[Bug] [TC-CNET-4.12] Timeout at Step 8 – TH unable to communicate with DUT on THREAD_2ND_OPERATIONALDATASET (Python inside Docker) Open

1.7-qa-required Awaiting Dev Feedback Bug Needs Triage v1.7

project-chip/certification-tool#770 · 10 comments · 1 assignee · Opened Oct 16, 2025
[Bug] [TC-CNET-4.12] Test consistently failing at Connecting the 2nd thread network(Step 7) with timeout error in TH GUI Open

1.7-qa-required Bug Needs Triage v1.7

Difficulty 4/5 3-5 days Newbie friendliness 45/100

project-chip/certification-tool#769 · 6 comments · Opened Oct 16, 2025
[Feature] Review and improve all TH scripts Open

Feature Needs Triage

Difficulty 5/5 Over a week Newbie friendliness 25/100

project-chip/certification-tool#721 · 1 comment · Opened Aug 21, 2025
[Feature] Can we add a section to the TH user guide about sideloading? Open

Documentation Feature

project-chip/certification-tool#605 · 1 comment · 1 assignee · Opened May 16, 2025
[Feature] Create a script to check the sanity of the Python Scripts Open

Feature Needs Triage

Difficulty 5/5 Over a week Newbie friendliness 30/100

project-chip/certification-tool#597 · Opened May 13, 2025
[Bug] TC-DA-1.7 fails if run in GUI but passes running direct from Docker Open

Awaiting Dev Feedback Bug SDK v1.4

Difficulty 3/5 1-2 days Newbie friendliness 62/100

project-chip/certification-tool#507 · 4 comments · Opened Dec 5, 2024
[Feature] Re-consider the docker directory re-mapping Open

Awaiting Originator Feedback Backend Feature Found_SVE_1.4

project-chip/certification-tool#462 · 3 comments · 1 assignee · Opened Oct 3, 2024
[Feature] TH should separate test run logs Open

Awaiting Originator Feedback Feature Found_SVE_1.4 Needs Triage

project-chip/certification-tool#459 · 1 comment · 1 assignee · Opened Oct 3, 2024
[Feature] TestHarness image for China mainland region Open

Feature Needs Triage v1.4

project-chip/certification-tool#384 · 2 comments · 1 assignee · Opened Aug 19, 2024
[Feature] Test harness log naming requires extra updates to fit to certification format (and is error prone as a result) Open

Awaiting Originator Feedback Feature Found_1.4_TE2 v1.4

project-chip/certification-tool#382 · 1 comment · 1 assignee · Opened Aug 16, 2024
[Feature] TH should name all logs properly according to TEDS alias to avoid manual renaming Open

Awaiting Originator Feedback Feature Found_1.4_TE2 v1.4

project-chip/certification-tool#370 · 5 comments · 2 assignees · Opened Aug 14, 2024
[Feature] Allow chip-tool to be commissioned at the same time Open

Feature Found_1.4_TE2 Needs Triage v1.4

project-chip/certification-tool#363 · 1 assignee · Opened Aug 14, 2024
[Feature] TH image is not prasing the PIXIT values from the PICS XML files Open

Awaiting Originator Feedback Backend Feature v1.4.2

project-chip/certification-tool#344 · 4 comments · 2 assignees · Opened Aug 12, 2024
[Enhancement] Implement real hash check for test suite and test case metadata Open

Enhancement v1.4.2

Difficulty 4/5 3-5 days Newbie friendliness 52/100

project-chip/certification-tool#339 · 1 comment · Opened Aug 8, 2024

project-chip/certification-tool

Get new issues in your inbox