adoptium / adoptium/aqa-tests

CryptoTests are reporting GssApiMechanismTests and SaslServerFactoryTests as passed, where it should be skipped

Open
#5,246 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
HTML
Stars
155
Forks
346
Avg merge
2d 9h
Merged PRs (30d)
36

Description

Those two tests - SaslServerFactoryTests and GssApiMechanismTests are relying on remote kerberos server, which is disabled in Aqa-tests by SKIP_AGENT_TESTS/cryptotests.skipAgentTests

However setting up this property/variable is making the tests silently pass, instead of ignoring them. I will be fixing this in upstream today. It thsould not affect the aqavit runs, onluy those two tests will move from passed to ignored.

However I would like to enable those two tests. The kerberos server it needs, have accidentaly same setup as kerberos server for tck. Is there any available ?

In both cases, I would like to improve a bit the aqavit crypto test targets, so they allow the passing of both AGENT_HOSTNAME and SKIP_AGENT_TESTS inside, so anybody who have kerbeors server can point Cryptotest targets to it.

In addition, this server can be setup locally by morevoer simple script - if all depndences are satisfied. Thus I was thinking, about creating an `external` aqa-tests test, which would run only those two tests, and will prepare the local kerberos server inside the container. WDYT @smlambert @llxia @zzambers @annaibm @pshipton?

Contributor guide

Open the contributing guide

Research direction

Start by examining the CryptoTests targets and the SKIP_AGENT_TESTS/cryptotests.skipAgentTests handling for SaslServerFactoryTests and GssApiMechanismTests. Review how AGENT_HOSTNAME is passed to AQA tests and how the existing TCK Kerberos server is set up. Done should include a decided scope for optional Kerberos support and ensure these tests are ignored rather than reported as passed when unavailable.

Written by the indexing model from the issue text.

Assessment

Domain
testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.