json-schema-org/JSON-Schema-Test-Suite

View on GitHub

A language agnostic test suite for the JSON Schema specifications

Stars: 750
Forks: 308
Open beginner issues: 0
Indexed issues: 39
Avg merge: 3d 17h
Merged PRs (30d): 24

Dominant language: Python
License: MIT
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 18, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

37 open issues indexed

idn-email: the domain half is never checked — no draft has a single invalid-domain case, unlike email Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

json-schema-org/JSON-Schema-Test-Suite#1197 · Opened Sep 16, 2026
[unify] annotate-specification-links TypeError crash, disconnected CI trigger, and Windows UTF-8 loading Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

json-schema-org/JSON-Schema-Test-Suite#1190 · Opened Sep 12, 2026
idn-*: which IDNA profile should the tests target, per dialect directory? Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#1132 · 1 comment · Opened Aug 18, 2026
duplicate ecmascript-regex.json files (with different content) Open

Difficulty 2/5 1-3 hours Newbie friendliness 72/100

json-schema-org/JSON-Schema-Test-Suite#1129 · 10 comments · Opened Aug 16, 2026
jsonschema_suite flatten crashes with AttributeError: 'str' object has no attribute 'rglob' Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

json-schema-org/JSON-Schema-Test-Suite#1022 · Opened Jul 24, 2026
tests regarding RFC 3987 incomplete Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

json-schema-org/JSON-Schema-Test-Suite#1013 · 4 comments · Opened Jul 23, 2026
jsonschema_suite check fails with UnicodeDecodeError on Windows (non-UTF-8 default locale) Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

json-schema-org/JSON-Schema-Test-Suite#1009 · 1 comment · Opened Jul 22, 2026
email / idn-email: scope questions - 4.5.3.1 length limits and control / noncharacter codepoints Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#948 · 4 comments · Opened Jun 16, 2026
Out-of-order schemas Open

Difficulty 3/5 1-2 days Newbie friendliness 58/100

json-schema-org/JSON-Schema-Test-Suite#941 · 2 comments · Opened Jun 13, 2026
Regular expression pattern specification and testing clarifications Open

Difficulty 5/5 Over a week Newbie friendliness 40/100

json-schema-org/JSON-Schema-Test-Suite#898 · 7 comments · Opened May 7, 2026
Root level $ref and $id in Draft 7 Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

json-schema-org/JSON-Schema-Test-Suite#894 · 4 comments · Opened Apr 18, 2026
Possibly inconsistent `$schema` for optional `format` tests ? Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

json-schema-org/JSON-Schema-Test-Suite#885 · 20 comments · Opened Mar 25, 2026
[Coverage] output-tests/ is missing structure/ subdirectory documented in README Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

json-schema-org/JSON-Schema-Test-Suite#863 · Opened Mar 7, 2026
Add test to ensure dotted-decimal IPv4 addresses are rejected by format: hostname Open

Difficulty 1/5 Under an hour Newbie friendliness 52/100

json-schema-org/JSON-Schema-Test-Suite#838 · 9 comments · 1 reaction · Opened Feb 12, 2026
Testing interaction of default with required Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

json-schema-org/JSON-Schema-Test-Suite#834 · 1 comment · 1 reaction · Opened Feb 10, 2026
Add Unicode-focused tests for string length and pattern handling Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

json-schema-org/JSON-Schema-Test-Suite#829 · 5 comments · Opened Feb 7, 2026
Managing tests through the feature life cycle Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

json-schema-org/JSON-Schema-Test-Suite#805 · 13 comments · Opened Dec 13, 2025
Cover URI schemes in $id besides URL and URN Open

Difficulty 1/5 Under an hour Newbie friendliness 48/100

json-schema-org/JSON-Schema-Test-Suite#797 · 10 comments · Opened Nov 25, 2025
Add a `specification` property to test cases + tests Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 38/100

json-schema-org/JSON-Schema-Test-Suite#699 · 16 comments · 3 reactions · Opened Oct 31, 2023
Add an `id` property to all test cases Open

enhancement good first issue

json-schema-org/JSON-Schema-Test-Suite#698 · 35 comments · 1 reaction · 1 assignee · Opened Oct 31, 2023
Revamped output testing Open

enhancement missing test

Difficulty 5/5 Over a week Newbie friendliness 25/100

json-schema-org/JSON-Schema-Test-Suite#657 · 8 comments · Opened Mar 13, 2023
Tests for bundling Open

enhancement missing test

json-schema-org/JSON-Schema-Test-Suite#653 · 28 comments · 2 reactions · 1 assignee · Opened Mar 7, 2023
A suite of vexatious JSON Schemas Open

enhancement missing test

Difficulty 5/5 Over a week Newbie friendliness 25/100

json-schema-org/JSON-Schema-Test-Suite#589 · 6 comments · 1 reaction · Opened Aug 20, 2022
Add a post- spec release checklist Open

documentation enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

json-schema-org/JSON-Schema-Test-Suite#571 · 2 comments · Opened Jul 5, 2022
Document the metaschema URI used for draft-next tests for authors of new tests and implementers wanting to run them Open

documentation enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#554 · 2 comments · Opened Jun 15, 2022
Document how to use Dependabot to keep a test suite submodule up to date Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

json-schema-org/JSON-Schema-Test-Suite#549 · 3 comments · Opened Apr 11, 2022
multipleOf contains incorrectly optional (bignum dependent) tests Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

json-schema-org/JSON-Schema-Test-Suite#536 · 6 comments · Opened Dec 28, 2021
Tests for format should make better use of vocabularies and optional/ is too overloaded with meaning Open

needs decision

Difficulty 5/5 Over a week Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#495 · 13 comments · 1 reaction · Opened Jul 2, 2021
test needed to show that transclusion of $ref into allOf changes the evaluation outcome Open

missing test

Difficulty 3/5 1-2 days Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#444 · 3 comments · Opened Oct 26, 2020
Document the test inclusion guidance/criteria Open

documentation enhancement

Difficulty 2/5 1-2 days Newbie friendliness 38/100

json-schema-org/JSON-Schema-Test-Suite#439 · 1 comment · Opened Oct 4, 2020
Test suite CI should ensure tests' schema IDs are unique Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

json-schema-org/JSON-Schema-Test-Suite#423 · 2 comments · Opened Aug 12, 2020
beef up bignum tests Open

missing test

Difficulty 3/5 1-2 days Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#378 · 9 comments · Opened May 28, 2020
Add test for multipleOf to ensure that implementation does not have an issue regarding scale Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

json-schema-org/JSON-Schema-Test-Suite#321 · 2 comments · Opened Dec 31, 2019
Test for valid use of empty fragment in "$id" Open

missing test

json-schema-org/JSON-Schema-Test-Suite#300 · 4 comments · 1 assignee · Opened Nov 11, 2019
Automatically format the JSON as part of CI Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

json-schema-org/JSON-Schema-Test-Suite#268 · 5 comments · Opened Jun 30, 2019
The suite should explicitly document its backwards compatibility policy Open

documentation enhancement

json-schema-org/JSON-Schema-Test-Suite#223 · 3 comments · 1 reaction · 1 assignee · Opened May 12, 2018
draft-07: more relative JSON pointer tests Open

missing test

Difficulty 3/5 1-2 days Newbie friendliness 35/100

json-schema-org/JSON-Schema-Test-Suite#202 · 8 comments · Opened Nov 19, 2017

json-schema-org/JSON-Schema-Test-Suite

Get new issues in your inbox