Self healing AI capability doesn't repeat waitForVisible/waitForElement step healing for more than 1 BDD scenario (test)
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 35/100
- Issue 类型
- 缺陷
- 描述清晰度
- 基本清楚
- 活跃度
- 停滞
- 技术栈
- javascript, nodejs, playwright
- 领域
- ai, testing-qa
调研方向
Start with the heal.addRecipe('ai', ...) configuration and the ai.healFailedStep entry point shown in the issue. Reproduce the two-scenario BDD case with waitForVisible or waitForElement on the listed CodeceptJS, Node.js, and Playwright versions, then trace why healing runs only for the first scenario. Done means the second scenario also invokes self-healing and its logs show the healing attempt.
由索引模型根据 Issue 内容生成。
描述
What are you trying to achieve?
We would like to use self healing AI capability https://codecept.io/ai/#self-healing-tests on CI with non default steps (waitForVisible/waitForElement) for more then 1 BDD scenario (test)
@test
Feature: Check that self healing works for more then 1 scenario
Scenario: Self-healing test 1
Given The tests is logged into Application
Scenario: Self-healing test 2
Given The tests is logged into Application
What do you get instead?
Self-healing is being invoked for the first scenario (test) on waitForVisible step and doesn't for the second on the same step.
- logs from 1st scenario:
[1] Error (Non-Terminated) | Error: element ({id: usernameee}) still not present on page after 15 sec
locator.waitFor: Timeout 15000ms exceeded.
Call log:
- waiting for locator('#usernameee').first()
| async (err) => { isHealing = true if (caughtError ...
codeceptjs:heal Self-healing started I.waitForElement({"id":"usernameee"}, 15) +0ms
› Trying to heal I.waitForElement({"id":"usernameee"}, 15) step
- logs from 2nd scenario:
[3] Error (Non-Terminated) | Error: element ({id: usernameee}) still not present on page after 15 sec
locator.waitFor: Timeout 15000ms exceeded.
Call log:
- waiting for locator('#usernameee').first()
| (err) => { step.status = 'failed'; step.endTime = ...
[3] Error | Error: element ({id: usernameee}) still not present on page after 15 sec
locator.waitFor: Timeout 15000ms exceeded.
Call log:
- waiting for locator('#usernameee').first()
undefined...
[3] <teardown> Stopping recording promises
heal.addRecipe('ai', {
priority: 1,
prepare: {
html: ({ I }) => I.grabHTMLFrom('body'),
},
steps: [
'waitForVisible',
'waitForInvisible',
'waitForElement',
],
fn: async args => {
return ai.healFailedStep(args);
},
});
Details
- CodeceptJS version:3.6.6
- NodeJS Version:18.17.0
- Operating System:MacOS
- Playwright: 1.46
- 主要语言
- JavaScript
- 星标
- 4.2k
- 派生
- 756
- 平均合并
- 2 天 9 小时
- 30 天内合并 PR
- 16
贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
codeceptjs/CodeceptJS 的其他 Issue
-
stale
难度 2/5 1-3 小时 新手友好度 72/100
codeceptjs/CodeceptJS#5420 · 1 条评论 ·
-
stale
难度 2/5 1-3 小时 新手友好度 76/100
codeceptjs/CodeceptJS#5358 · 1 条评论 ·
-
stale
难度 2/5 1-3 小时 新手友好度 78/100
codeceptjs/CodeceptJS#4958 · 10 条评论 · 2 个 reaction ·
-
stale
难度 1/5 1 小时以内 新手友好度 72/100
codeceptjs/CodeceptJS#4778 · 3 条评论 ·
-
stale
难度 4/5 3-5 天 新手友好度 38/100
codeceptjs/CodeceptJS#5618 · 1 条评论 ·
查看 codeceptjs/CodeceptJS 的全部 Issue
相似的 Issue
-
bug
难度 2/5 1-3 小时 新手友好度 76/100
avniproject/avni-client#2135 ·
-
enhancement
难度 2/5 1-3 小时 新手友好度 70/100
babalae/bettergi-scripts-list#3674 ·
-
A-Release-Notes C-Editing D-Modest S-Ready-For-Implementation
难度 2/5 1-3 小时 新手友好度 72/100
bevyengine/bevy-website#2595 ·
-
ecosystem wording
难度 1/5 1 小时以内 新手友好度 90/100
matrix-org/matrix.org#3649 ·
-
难度 2/5 1-3 小时 新手友好度 88/100
vadimdemedes/ink#1029 ·