Autodesk / Autodesk/shore

E2E testing - Figure out expected_output

Open
#56 0 comments 0 reactions 0 assignees View on GitHub
DevX E2E enhancement
Dominant language
Go
Stars
21
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Original Author: @dkirillov

We should figure out how the E2E testing behaves and the interface for it - specifically around `expected_output` and the various stage output cases.

Some things that come up are:
- How strict we are with tests.
- If the stage produces nothing, do tests _need_ to check for nothing.
- If a stage produces something, but we don't care, do we still need to check for it.
- If a stage produces something, but that something is dynamic between each run, how do we check for that (or do we).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the E2E testing implementation and the expected_output interface. Define and document the expected behavior for empty output, ignored output, dynamic output, and strictness before making changes; done means the interface rules are agreed and represented by the relevant E2E tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.