eclipse-tractusx / eclipse-tractusx/knowledge-agents

E2E Tests (Release 24.12)

Open
#168 4 comments 0 reactions 2 assignees Claimed by @obalandi View on GitHub
documentation
Dominant language
Java
Stars
1
Forks
5
PR merge metrics
No merged PRs in 30d

Description

Please open and fill in this issue in your product repository to document the status of E2E tests.

**Show success/failure ** by attaching screenshots and/or result documents/failure messages.

## Close this issue once the status of the E2E tests has been documented
Testers(s) and Role(s):

* Oguzhan Balandi (T-Systems, CONSUMER, SUPPLIER)
* Christoph Jung (T-Systems, OEM, PROVIDER, PRODUCER)

Deployment/Umbrella Chart Coordinates:

* https://github.com/big-data-spaces/knowledge-agents-deployment/tree/release/cx-2408/infrastructure

Tested Sub-Charts/Versions:

* tractusx-connector-azure-vault: 0.8.0-RC4
* agent-plane-azure-vault: 1.14.24-SNAPSHOT
* conforming-agent: 1.14.24-SNAPSHOT
* matchmaking-agent: 1.14.24-SNAPSHOT
* remoting-agent: 1.14.24-SNAPSHOT
* provisioning-agent: 1.14.24-SNAPSHOT
* aas-bridge: 1.14.24-SNAPSHOT

Retest with:

* agent-plane-azure-vault: 0.8.0-RC4
* matchmaking-agent: 1.14.24-SNAPSHOT

Release Management Reference Issue:

[eclipse-tractusx/sig-release#902](https://github.com/eclipse-tractusx/sig-release/issues/902)

## Preconditions / Integration Tests
* For Release 24.12 Integration Test various scenarios need to be performed by the testing parties depending on their role (CONSUMER, OEM, PROVIDER, PRODUCER, SUPPLIER).
* Example performances of the integration steps can be found in the [postman collection](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/folder/2757771-82cf45dc-57e5-4243-acaf-5180c867d0ce?action=share&source=copy-link&creator=2757771&ctx=documentation)

### CONSUMER of a sample OEM and PROVIDER:
* [x] Deploy Agent-Enabled Connector
* [x] Perform Remote Catalogue Request (OEM and PROVIDER)
* [x] Check Federated Catalogue (need to list OEM and PROVIDER assets)

### OEM for a sample SUPPLIER, access Provisioning Agents and register a graph
* [x] Deploy Agent-Enabled Connector
* [x] Perform Remote Catalogue Request (against SUPPLIER)
* [x] Check Federated Catalogue (needs to see SUPPLIER and PROVIDER assets)
* [x] Deploy Provisioning Agent
* [x] Access Provisioning Agent (Reliability)
* [x] Access Provisioning Agent (Supply Chain)
* [x] Register Graph Asset(s)
* [x] Register Graph Policy
* [x] Register Graph Contract

### SUPPLIER for a sample PRODUCER and OEM, access Remoting Agent and register a graph
* [x] Deploy Agent-Enabled Connector
* [x] Perform Remote Catalogue Request (against PRODUCER and OEM)
* [x] Check Federated Catalogue (of PRODUCER and OEM)
* [x] Deploy Remoting Agent with RUL binding
* [x] Access Remoting Agent (Remaining Useful Life)
* [x] Register Graph Asset
* [x] Upload Graph Asset (Supply Chain)
* [x] Register Graph Policy
* [x] Register Graph Contract

### PRODUCER for a sample SUPPLIER and register a graph
* [x] Deploy Agent-Enabled Connector
* [x] Perform Remote Catalogue Request
* [x] Check Federated Catalogue (needs to see SUPPLIER and PROVIDER)
* [x] Upload Graph Asset (Supply Chain)
* [x] Register Graph Policy
* [x] Register Graph Contract

### PROVIDER for sample OEM, SUPPLIER and PRODUCER and register a Skill
* [x] Deploy Agent-Enabled Connector
* [x] Perform Remote Catalogue Request (against OEM, SUPPLIER and PRODUCER)
* [x] Register Skill Asset
* [x] Register Skill Policy
* [x] Register Skill Contract

## Test Plan
* The Test Steps are documented as API interactions in this [postman collection](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/folder/2757771-f21e7e62-519f-4d7a-9eac-72748e732548?action=share&source=copy-link&creator=2757771&ctx=documentation).
* The concrete Test environment is referred in this [postman environment](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/environment/2757771-2037e25c-d239-4e3a-a053-7c22ecdd05b1?action=share&creator=2757771&active-environment=2757771-2037e25c-d239-4e3a-a053-7c22ecdd05b1). The necessary secrets will be communicated by the test management in private.

### PROVIDER Test
* [x] [E2E_02_00_01_OEM_GRAPH_POLICY](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-b27effc2-7a02-433d-8a37-2537c9ccdc16?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Creates a Policy for Providing Graphs and Skills to the E2E participants
* [x] [E2E_02_00_02_OEM_GRAPH_CONTRACT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-ac81c0ad-5981-40c1-86a0-3a3b0dd67132?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Creates a Contract Definition for Providing Graphs and Skills to the E2E participants
* [x] [E2E_02_00_03_OEM_RELIABILITY_GRAPH](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-8f89af1b-fb9a-4846-9221-e2c186548ad3?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Creates a Graph Asset with Telematics Data
* [x] [E2E_02_01_00_SUPPLIER_GRAPH_POLICY](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-9f8d6c74-14fa-4414-8075-798d3d10996c?action=share&source=copy-link&creator=2757771&ctx=documentation) SUPPLIER Creates a Policy for Providing Graphs to the E2E participants
* [x] [E2E_02_01_01_SUPPLIER_GRAPH_CONTRACT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-c5ddce74-c2e5-4ad6-bd5b-53531f1abd25?action=share&source=copy-link&creator=2757771&ctx=documentation) SUPPLIER Creates a Contract Definition for Providing Graphs to the E2E participants
* [x] [E2E_02_01_02_SUPPLIER_BEHAVIOUR_GRAPH](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-71c5fd6f-6a2c-4e23-a26e-c02cc1c11baf?action=share&source=copy-link&creator=2757771&ctx=documentation) SUPPLIER Creates a Graph Asset with RUL Prognosis
* [x] [E2E_02_01_03_SUPPLIER_BEHAVIOUR_GRAPH_VARIANT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-28752c03-c3b2-4966-b3e8-f06f9c025d41?action=share&source=copy-link&creator=2757771&ctx=documentation) SUPPLIER Creates a Graph Asset with HI Prognosis
* [x] [E2E_02_02_01_OPEN_POLICY](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-72a65a2c-064b-4053-9147-d0b72b083a2f?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Creates a Permissive Policy
* [x] [E2E_02_02_02_OPEN_CONTRACT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-a820ccf9-7cb8-464b-8156-364a9d697c6a?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Creates a Permissive Contract Definition
* [x] [E2E_02_02_03_REGISTER_RUL_SKILL_REMOTE](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-04fbe9ba-8355-4bd5-8cb2-388fa0ec4087?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Creates a RUL Skill in PROVIDER Mode
* [x] [E2E_02_02_04_REGISTER_RUL_SKILL_LOCAL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-c2447e64-0628-471c-a50f-5be1c4e88433?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Creates a RUL Skill in CONSUMER Mode
* [x] [E2E_02_02_06_REGISTER_BEH_SKILL_PROVIDER](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-a66ea0b8-3db1-4761-842c-eb4f1842ab60?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Creates a Behaviour Skill in PROVIDER Mode
* [x] [E2E_02_03_01_OEM_FEDERATED_CATALOGUE](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-46fac696-4d90-4784-9539-29f84c3f5f85?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Checks SUPPLIER Information in Federated Catalogue
* [x] [E2E_02_03_02_OEM_CALL_REMOTE](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-b7207962-22b6-4902-bd0a-f2e8fccefe4e?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Checks Successful Calling SUPPLIER Prognosis Logic
* [x] [E2E_02_03_03_OEM_CALL_REMOTE_FAIL_INVALID_GRAPH](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-da8f61fa-171b-407e-992b-2e91d3d1192f?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Checks Successful Unsuccessful Calling SUPPLIER Prognosis Logic (Wrong Address)
* [x] [E2E_02_03_04_OEM_CALL_REMOTE_FAIL_INVALID_SYNTAX](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-ce06b1e1-5754-4385-bd01-de6c7e09d882?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Checks Successful Unsuccessful Calling SUPPLIER Prognosis Logic (Invalid Query)
* [x] [E2E_02_03_05_OEM_CALL_REMOTE_FAIL_NS](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-fe9c99b3-e6bf-436d-84a0-808789f22beb?action=share&source=copy-link&creator=2757771&ctx=documentation) OEM Checks Successful Unsuccessful Calling SUPPLIER Prognosis Logic (Non-Matched Semantics)
* [x] [E2E_02_04_01_PROVIDER_FEDERATED_CATALOGUE](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-90bd9d73-def1-4e0b-9d78-8ee1f5773c1b?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Checks OEM Information in Federated Catalogue
* [x] [E2E_02_04_02_PROVIDER_CALL_REMOTE](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-1a0933ce-0247-42a9-afec-d8c187fda048?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Checks Successful Calling OEM Telematics Data
* [x] [E2E_02_04_03_PROVIDER_CALL_REMOTE_FAIL_INVALID_GRAPH](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-439bb568-4dd0-4f22-9abf-275f9e419bf9?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Checks Successful Unsuccessful Calling OEM Telematics Data (Wrong Address)
* [x] [E2E_02_04_04_PROVIDER_CALL_REMOTE_FAIL_INVALID_SYNTAX](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-a789efd4-45c3-43c4-9a65-13b07ffc9d7e?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Checks Successful Unsuccessful Calling OEM Telematics Data (Invalid Query)
* [x] [E2E_02_04_05_PROVIDER_CALL_REMOTE_FAIL_NS](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-362dcf0b-d1ce-4589-b0a9-62f5ab543e62?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER Checks Successful Unsuccessful Calling OEM Telematics Data (Non-Matched Semantics)
* [x] [E2E_02_06_01_LIST_SKILLS](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-4978464b-68c6-4075-8f56-e3201387dffb?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER lists all required skills for the E2E Test
* [x] [E2E_02_06_02_AAS_DESCRIPTION](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-282636fd-22a4-4641-98a8-807db58a298b?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER successfully lists AAS capabilties
* [x] [E2E_02_06_03_AAS_ALL_SHELLS](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-e5ffecc4-e3bf-4561-b512-4c535afa5e38?action=share&source=copy-link&creator=2757771&ctx=documentation PROVIDER successfully lists all twins inside Traceability Graph
* [x] [E2E_02_06_04_AAS_ALL_SUBMODELS](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-84f3e7cc-16a7-446b-a8da-7d1d388224b3?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER successfully lists all submodels inside Traceability Graph
* [x] [E2E_02_06_05_ONE_SHELL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-2ba70ef7-f32b-4031-ab78-2ff17acac833?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER successfully looks up single twin from the Traceability Graph
* [x] [E2E_02_06_06_NOTEXISTS_SHELL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-2696dd0e-7f6a-421b-8cca-42722aee061f?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER fails looking up non-existing twin
* [x] [E2E_02_06_07_ONE_SUBMODEL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-49900f04-8050-431c-94df-7fbc26511c8f?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER successfully looks up single submodel from the Traceability Graph
* [x] [E2E_02_06_07_NOTEXISTS_SUBMODEL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-e631050b-975e-4846-9840-bbb28d88c17e?action=share&source=copy-link&creator=2757771&ctx=documentation) PROVIDER fails looking up non-existing submodel

### CONSUMER Test
* [x] [E2E_02_02_05_REGISTER_RUL_SKILL_CONSUMER](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-27e7e471-6070-436d-97c3-0314ff238aa5?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Creates a Non-Federated RUL Skill
* [x] [E2E_02_05_01_RUL_SKILL_ADHOC](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-a3058014-34e8-4ed6-aa54-86036d68a945?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls an Ad-hoc Skill Over OEM and SUPPLIER
* [x] [E2E_02_05_02_RUL_SKILL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-b4b17fc1-d620-48f7-8a02-1642c886c976?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls Own Predefined RUL Skill
* [x] [E2E_02_05_03_RUL_SKILL_WRONG_VEHICLES](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-cd017e9c-5f74-4359-b8da-50334415ecab?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls Own Predefined RUL Skill with an invalid parameterization
* [x] [E2E_02_05_04_RUL_SKILL_REMOTE_IMPLICIT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-2662de60-c83d-44b6-8ad2-4608ddc95f2b?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls PROVIDER Skill (Implicit Mode)
* [x] [E2E_02_05_05_RUL_SKILL_REMOTE_EXPLICIT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-2211012c-e63e-4478-aa82-ec0bec02a979?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls PROVIDER Skill (Explicit Mode)
* [x] [E2E_02_05_06_RUL_SKILL_REMOTE_WRONG_MODE](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-6078d537-58ed-4958-a165-f32f840c4e2e?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls PROVIDER Skill (Wrong Mode)
* [x] [E2E_02_05_07_RUL_SKILL_LOCAL_IMPLICIT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-aba5099b-e167-4b8d-9830-56146d694a61?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls PROVIDER Skill (Implicit Mode)
* [x] [E2E_02_05_08_RUL_SKILL_LOCAL_EXPLICIT](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-f9e15c2a-7c68-47cd-b468-7aef6ec27f7e?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls PROVIDER Skill (Explicit Mode)
* [x] [E2E_02_05_09_RUL_SKILL_LOCAL_WRONG_MODE](E2E_02_05_09_RUL_SKILL_LOCAL_WRONG_MODE) CONSUMER Calls PROVIDER Skill (Wrong Mode)
* [x] [E2E_02_05_10_BT_SKILL_RUL](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-375d2f8e-521a-4e81-9ee5-c690b67d137d?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls Polymorphic OEM Skill (Variant 1)
* [x] [E2E_02_05_11_BT_SKILL_HI](https://www.postman.com/catena-x/workspace/catena-x-knowledge-agents/request/2757771-b34cce18-1552-420a-a819-8afd863e2179?action=share&source=copy-link&creator=2757771&ctx=documentation) CONSUMER Calls Polymorphic OEM Skill (Variant 2)

### Hints
### Information Sharing

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.