microsoft / microsoft/rego-cpp

OPA 1.20.2 smoke test failed

Open
#244 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

dependencies opa-version
Dominant language
C++
Stars
47
Forks
19
PR merge metrics
No merged PRs in 30d

Description

The weekly OPA smoke test bumped REGOCPP_OPA_VERSION from 1.18.1 to 1.20.2 and observed a failure.

Step Outcome
Configure success
Build success
OPA conformance tests failure

Full logs: https://github.com/microsoft/rego-cpp/actions/runs/34089258717

Release notes: https://github.com/open-policy-agent/opa/releases/tag/v1.20.2

Action required

  • Reproduce locally: bump REGOCPP_OPA_VERSION to 1.20.2 and run ctest -R rego_test_opa
  • Run the opa-compat-check skill to review the release notes
  • Fix / implement any regressions or new features
  • Land the bump

Tail of test output

"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrmerge"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/array".............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsecertificates".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/units"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/indexing".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexmatchtemplate"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/inputvalues".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/graphql".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacsha512".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/globquotemeta".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialiter".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsnegate"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/dataderef".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectfilternonstringkey".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/replacen"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsor"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/keywordrefs"...............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialdocconstants"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyhs256"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/containskeyword".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netlookupipaddr".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/typenamebuiltin".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/walkbuiltin"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/completedoc"................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/helloworld".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimprefix"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexfind"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/assignments".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trim"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/comprehensions"........................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsecertificaterequest".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexsplit"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/functionerrors".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesignheadererrors".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrexpand"....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/strings".......................................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonpatch"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/globsmatch"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsersaprivatekey".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/withkeyword"............................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonremoveidempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectfilter"..................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtbuiltins"............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectremoveidempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/subset".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyrsa".......................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimleft"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/topdowndynamicdispatch".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesign"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/semvercompare".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrcontains"............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/providers-aws"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/compositebasedereference"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexmatch".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/compositereferences"...............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrcontainsmatches".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptomd5".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/sprintf".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/aggregates"...............................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/hexbuiltins"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacequal".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/virtualdocs"............................................................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/sets"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexreplace".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectkeys".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonbuiltins"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/stringinterpolation"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectfilteridempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/typebuiltin"....................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsshiftright"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsekeypair"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/functions".........................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectremove"...................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/time"..........................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/urlbuiltins".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/rendertemplate".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptoparsersaprivatekeys".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/numbersrange".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/arithmetic"...................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonfilter"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/logic_operators"....................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesignraw"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regometadatarule".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/embeddedvirtualdoc".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectunionn".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexfindallstringsubmatch"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/numbersrangestep".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/nestedreferences".................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonschema"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/example"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/every"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonfilteridempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimright"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/semverisvalid"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimspace"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/casts".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/invalidkeyerror"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/disjunction"..............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/indirectreferences".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/rand".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimsuffix"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialsetdoc"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptosha1".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/negation"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/planner-ir"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesignpayloaderrors"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyeddsa".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyhs512"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/reachable".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/elsekeyword"..............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/comparisonexpr".............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/defaultkeyword".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/globmatch".............................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/type".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/varreferences".................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/intersection".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacsha256".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsxor"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/union".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regometadatachain".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptosha256".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacsha1".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialobjectdoc"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtdecodeverify"...............................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regoparsemodule"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectget".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/base64builtins".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parseandverifycertificates".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsand"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/evaltermexpr"....................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectunion"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/eqexpr".......................................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/undos".........Done


  SKIP: valid ipv4 cidr (built-in not supported)                                          0.002 sec
  SKIP: empty cidr (built-in not supported)                                               0.002 sec
  SKIP: random string (built-in not supported)                                            0.002 sec
  SKIP: valid ipv4 address (built-in not supported)                                       0.002 sec
  SKIP: valid ipv6 cidr (built-in not supported)                                          0.002 sec
  PASS: indexing on any and arrays                               0.002 sec
  PASS: with: ndb_cache-issue                                    0.002 sec
  PASS: set data                                                 0.004 sec
  PASS: regex.replace: test pattern match and replace            0.002 sec
  PASS: regex.replace: work with groups                          0.002 sec
  PASS: regex.replace: bad regex pattern: Syntax error           0.002 sec
  PASS: regex.replace: anchored RE, start                        0.002 sec
  PASS: regex.replace: anchored RE, start+end, no match          0.002 sec
  PASS: regex.replace: anchored RE, start+end, match             0.002 sec
  PASS: regex.replace: anchored RE, end                          0.002 sec
  PASS: regex.replace: anchored RE, end, no match                0.002 sec
  PASS: regex.replace: per-character match                       0.002 sec
  PASS: regex.replace: match with count                          0.002 sec
  PASS: regex.replace: match with count, 2                       0.002 sec
  PASS: unused arg                                               0.002 sec
  PASS: floor rounds down                                        0.002 sec
  PASS: floor rounds down (2)                                    0.002 sec
  PASS: floor rounds down (3)                                    0.002 sec
  PASS: floor integer                                            0.002 sec
  PASS: floor negative                                           0.002 sec
  PASS: ceil rounds up                                           0.002 sec
  PASS: ceil rounds up (2)                                       0.002 sec
  PASS: ceil rounds up (3)                                       0.002 sec
  PASS: ceil integer                                             0.002 sec
  PASS: ceil negative                                            0.002 sec
  PASS: # 5073 regression test                                   0.002 sec
  PASS: partialsetdoc: object sort while iter                    0.002 sec

27 / 27 passed
(5 skipped)

aggregates

  PASS: count set                                                0.002 sec
  PASS: min virtual                                              0.002 sec
  PASS: count string                                             0.002 sec
  PASS: count string                                             0.002 sec
  PASS: count keys virtual                                       0.002 sec
  PASS: count                                                    0.002 sec
  PASS: sum virtual                                              0.002 sec
  PASS: max virtual                                              0.002 sec
  PASS: count virtual                                            0.002 sec
  PASS: count keys                                               0.002 sec
  PASS: min                                                      0.002 sec
  PASS: min out-of-order                                         0.002 sec
  PASS: bignum exact (>64-bit integers through sum and product)  0.003 sec
  PASS: sum integer fast-path overflow (elements fit int64, sum does not)0.003 sec
  PASS: member simple, set                                       0.002 sec
  FAIL: member check set with with both key and value            0.002 sec
  wanted a result, but was undefined
(from "/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/aggregates/test-membership.yaml")


0% tests passed, 1 tests failed out of 1

Total Test time (real) =   4.81 sec

The following tests FAILED:
	 19 - rego_test_opa (Failed)
Errors while running CTest

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by bumping REGOCPP_OPA_VERSION from 1.18.1 to 1.20.2 and running ctest -R rego_test_opa, using the linked workflow logs to identify the failing conformance cases. Run the opa-compat-check skill and review the OPA v1.20.2 release notes. Done means the regression or compatibility work is addressed, conformance passes, and the version bump is landed.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.