microsoft / microsoft/rego-cpp

OPA 1.19.1 smoke test failed

Open
#242 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

dependencies opa-version
Dominant language
C++
Stars
47
Forks
19
PR merge metrics
No merged PRs in 30d

Description

The weekly OPA smoke test bumped REGOCPP_OPA_VERSION from 1.18.1 to 1.19.1 and observed a failure.

Step Outcome
Configure success
Build success
OPA conformance tests failure

Full logs: https://github.com/microsoft/rego-cpp/actions/runs/32696132419

Release notes: https://github.com/open-policy-agent/opa/releases/tag/v1.19.1

Action required

  • Reproduce locally: bump REGOCPP_OPA_VERSION to 1.19.1 and run ctest -R rego_test_opa
  • Run the opa-compat-check skill to review the release notes
  • Fix / implement any regressions or new features
  • Land the bump

Tail of test output

"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/undos".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/logic_operators"....................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/rand".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/eqexpr".......................................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/walkbuiltin"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexfind"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptoparsersaprivatekeys".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsor"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/array".............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectremoveidempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrisvalid".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrmerge"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/invalidkeyerror"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/example"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectget".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/uuid"....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesign"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtdecodeverify"...............................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/typebuiltin"....................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacequal".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesignpayloaderrors"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/sprintf".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/semvercompare".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/globmatch".............................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/stringinterpolation"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/defaultkeyword".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectunion"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectfilternonstringkey".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimspace"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectfilteridempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/strings".......................................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regoparsemodule"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/virtualdocs"............................................................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/compositereferences"...............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/replacen"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsshiftright"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/uribuiltins"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/base64builtins".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyhs512"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/elsekeyword"..............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regometadatarule".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacsha1".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parseandverifycertificates".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/intersection".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialdocconstants"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonfilteridempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/hexbuiltins"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrcontains"............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/urlbuiltins".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/comprehensions"........................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsersaprivatekey".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrintersects"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/union".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trim"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonpatch"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsshiftleft".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/topdowndynamicdispatch".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/globquotemeta".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialiter".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/arithmetic"...................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsand"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialobjectdoc"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/indexing".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonbuiltins"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsnegate"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/dataderef".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectremove"...................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/casts".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/base64urlbuiltins"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/globsmatch"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesignraw"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/fix1863"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/sets"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/completedoc"................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/providers-aws"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexmatch".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyhs256"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyhs384"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/numbersrange".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimprefix"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/time"..........................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/varreferences".................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacsha256".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsecertificates".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/baseandvirtualdocs"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonremove".........................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/numbersrangestep".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectfilter"..................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptomd5".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexmatchtemplate"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/embeddedvirtualdoc".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regometadatachain".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsecertificaterequest".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonfilter"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/assignments".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/typenamebuiltin".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/planner-ir"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/aggregates"...............................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectkeys".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/indirectreferences".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/negation"......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/graphql".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrexpand"....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/semverisvalid"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/nestedreferences".................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/bitsxor"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/keywordrefs"...............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptox509parsekeypair"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonremoveidempotent".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimsuffix"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexfindallstringsubmatch"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/withkeyword"............................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectremovenonstringkey".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/compositebasedereference"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimright"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtencodesignheadererrors".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/every"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/regexisvalid"...
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netcidrcontainsmatches".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/netlookupipaddr".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtbuiltins"............
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/containskeyword".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jsonschema"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/trimleft"..
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/units"........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/objectunionn".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/helloworld".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/cryptohmacmd5".
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/partialsetdoc"...........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/jwtverifyrsa".......................................
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/inputvalues".......
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/reachable".........
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/functionerrors".....
"/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/disjunction"..............Done


  PASS: unused arg                                               0.002 sec
  PASS: regex.replace: test pattern match and replace            0.002 sec
  PASS: regex.replace: work with groups                          0.002 sec
  PASS: regex.replace: bad regex pattern: Syntax error           0.002 sec
  PASS: regex.replace: anchored RE, start                        0.002 sec
  PASS: regex.replace: anchored RE, start+end, no match          0.002 sec
  PASS: regex.replace: anchored RE, start+end, match             0.002 sec
  PASS: regex.replace: anchored RE, end                          0.002 sec
  PASS: regex.replace: anchored RE, end, no match                0.002 sec
  PASS: regex.replace: per-character match                       0.002 sec
  PASS: regex.replace: match with count                          0.002 sec
  PASS: regex.replace: match with count, 2                       0.002 sec
  SKIP: valid ipv4 cidr (built-in not supported)                                          0.002 sec
  SKIP: empty cidr (built-in not supported)                                               0.002 sec
  SKIP: random string (built-in not supported)                                            0.002 sec
  SKIP: valid ipv4 address (built-in not supported)                                       0.002 sec
  SKIP: valid ipv6 cidr (built-in not supported)                                          0.002 sec
  PASS: set data                                                 0.004 sec
  PASS: floor rounds down                                        0.002 sec
  PASS: floor rounds down (2)                                    0.002 sec
  PASS: floor rounds down (3)                                    0.002 sec
  PASS: floor integer                                            0.002 sec
  PASS: floor negative                                           0.002 sec
  PASS: ceil rounds up                                           0.002 sec
  PASS: ceil rounds up (2)                                       0.002 sec
  PASS: ceil rounds up (3)                                       0.002 sec
  PASS: ceil integer                                             0.002 sec
  PASS: ceil negative                                            0.002 sec
  PASS: indexing on any and arrays                               0.003 sec
  PASS: with: ndb_cache-issue                                    0.002 sec
  PASS: # 5073 regression test                                   0.002 sec
  PASS: partialsetdoc: object sort while iter                    0.002 sec

27 / 27 passed
(5 skipped)

aggregates

  PASS: max                                                      0.002 sec
  PASS: sort                                                     0.002 sec
  PASS: count with invalid utf-8 chars (0xFFFD)                  0.002 sec
  PASS: min virtual set                                          0.002 sec
  PASS: count set                                                0.003 sec
  PASS: sum virtual set                                          0.002 sec
  PASS: reduce ref dest (2)                                      0.002 sec
  PASS: count                                                    0.002 sec
  PASS: sum virtual                                              0.002 sec
  PASS: count keys                                               0.002 sec
  PASS: min                                                      0.002 sec
  PASS: product                                                  0.002 sec
  PASS: bug 2469 - precision                                     0.002 sec
  PASS: member simple, set                                       0.002 sec
  FAIL: member check set with with both key and value            0.002 sec
  wanted a result, but was undefined
(from "/home/runner/work/rego-cpp/rego-cpp/build/tests/../opa/v1/test/cases/testdata/v1/aggregates/test-membership.yaml")


0% tests passed, 1 tests failed out of 1

Total Test time (real) =   5.70 sec

The following tests FAILED:
	 19 - rego_test_opa (Failed)
Errors while running CTest

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by bumping REGOCPP_OPA_VERSION to 1.19.1 and running ctest -R rego_test_opa, then inspect the linked workflow logs to identify the failing conformance cases. Run the opa-compat-check skill against the OPA 1.19.1 release notes; done means any required compatibility fixes are implemented, the conformance test passes, and the version bump is landed.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.