Pattern properties do not load external $refs

Describe the bug
Pattern properties do not load external $refs, it seems to work if the $refs are local, but I didn't properly test it

Expected behavior
$refs should properly load external files

Minimal reproducible OpenAPI snippet(if possible)
test.yaml

openapi: 3.1.0
info:
  title: "Example"
  version: "1.0"
  description: "Example"
paths:
  "/test/":
    get:
      summary: Example
      responses:
        200:
          description: List of shops and their details
          content:
            "application/json":
              schema:
                type: object
                properties:
                  "working":
                    $ref: "testobj.yaml"
                patternProperties:
                  "not-working":
                    $ref: "testobj.yaml"

testobj.yaml

type: object
properties:
  key:
    type: number

Screenshots

Reproduce the issue with test.yaml and the referenced testobj.yaml, comparing the properties and patternProperties cases. Trace how external $refs are loaded for the OpenAPI 3.1 schema and verify that the patternProperties reference renders or resolves like the local and properties references.