nlohmann / nlohmann/json

[GLD Serializer Benchmark] C++ nlohmann_msgpack 3.12.0 — spec compliance misses

Open
#5,527 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
50.6k
Forks
7.5k
Avg merge
4d 17h
Merged PRs (30d)
58

Description

Hi — this is a friendly report from the GLD Serializer Benchmark, an independent multi-language suite that times serializers and checks them against the published format specs (RFC 8259, YAML 1.2, …).

We measured nlohmann_msgpack 3.12.0 on C++. The suite recorded spec-profile misses for this pin. The catalog is report-only: a miss is not a CI failure, and some cases are older or stricter profiles (for example RFC 4627 vs RFC 8259) rather than a crash.

Compliance results (please start here)

This link opens the live heatmap on C++ with nlohmann_msgpack already selected (All standards). Click a scored cell for each FAIL and the cited spec paragraph:

https://leo-gan.github.io/GLD.SerializerBenchmark/dashboard/#compliance/cpp/nlohmann_msgpack

How the catalog is built, and how to read a FAIL line:

I am not pasting the case list here so you can use the Dashboard (filters, heatmap, and spec links) rather than a static dump.

Optional: one standard family only — #compliance/cpp/nlohmann_msgpack/json (or yaml, cbor, …).

Benchmark timings (same pin)

The same suite also publishes encode / decode time and payload size for this library on C++:

https://leo-gan.github.io/GLD.SerializerBenchmark/dashboard/?lang=cpp&data=document@n=1&mode=bytes#dashboard

Details table (this library pre-selected):

https://leo-gan.github.io/GLD.SerializerBenchmark/dashboard/?lang=cpp&ser=nlohmann_msgpack&data=document@n=1&mode=bytes#detailed-analytics

That page is the live L1 snapshot, not a claim that one library is “best.”

Ask

Please look at the Compliance view for nlohmann_msgpack. If a miss is a real decoder/encoder bug you want to fix, great. If it is an intentional default (accepting NaN, YAML 1.1 bools, …), a short note here is enough — we will keep the catalog as-is unless the library’s documented contract changes.

Thanks for the library.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the C++ nlohmann_msgpack Compliance dashboard and open each FAIL cell to read its cited specification paragraph. Use the compliance and reading-results pages to verify whether each miss is a real encoder or decoder issue or an intentional default. Done means the relevant cases are classified and any intentional behavior is documented in the issue, or a concrete fix scope is identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.