ManimCommunity / ManimCommunity/manim

Experimental test issue tracker

Open
#4,592 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
40.9k
Forks
3.1k
Avg merge
3d 12h
Merged PRs (30d)
25

Description

The intention with this issue is to create an overview of the types of errors on the Experimental branch.

At the current state of the experimental branch (40c166153d0c6d 2026-02-16), the types of errors on the pytest suite is as follows.

```
196 GraphicalDeviationError
23 AssertionError
16 TypeError
9 AttributeError
8 NotImplementedError
7 assert False
3 Failed
1 NameError
1 _moderngl.Error
1 FileNotFoundError
1 Exception
5
```
The list was generated with the command:
```
cat experimental_errors.txt | grep FAILED | sed "s/FAILED \(.*\)::.* - \([^:]*\).*/\2/g" | sort | uniq -c | sort -nr
```

The dominating group of errors are the `GraphicalDeviationErrors`.
The errors in that group can be divided into the following groups.

- Larger surfaces differ due to differences in their fill (118 errors)
- Differences along edges of objects (67 errors)
- Differences in 3D viewpoint (8 errors)
- Variations in the rendered shape (5 errors)
- Unclassified (8 errors)

I have included a number of examples below.

Larger surfaces differ due to differences in their fill
Example with the test `tests/test_graphical_units/test_img_and_svg.py::test_Inheritance`

Image

Image

Differences along edges of objects
Example with the test `tests/test_graphical_units/test_geometry.py::test_AnnularSector`

Image

Image

Differences in 3D viewpoint

Example with the test `tests/test_graphical_units/test_polyhedra.py::test_ConvexHull3D`

Image

Image

Variations in the rendered shape

Example with the test `tests/test_graphical_units/test_functions.py::test_ImplicitFunction`

Image

Image

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the experimental pytest suite and the named examples in tests/test_graphical_units/test_img_and_svg.py, test_geometry.py, test_polyhedra.py, and test_functions.py. Reproduce the provided command against experimental_errors.txt, then organize the failures into agreed categories; done means the error overview and classifications are current and complete.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-graphics, testing-qa
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.