graphprotocol / graphprotocol/graph-node

[Bug] graphman truncate doesn't remove 300 GB of the old blocks from db

Open
#5,529 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug Stale
Dominant language
Rust
Stars
3.2k
Forks
1.1k
Avg merge
4d 1h
Merged PRs (30d)
1

Description

Bug report

When using graphman chain truncate I still see over 2.5 million blocks in chain4.blocks table and 5.5 million in chain5.blocks inside postgres. They are taking around 300 GB of space. Why are they not removed? Can I remove them in any other way? I don't see a reason why they are kept there.

Relevant log output
graphDB=# SELECT
    table_schema || '.' || table_name AS "table_full_name",
    pg_size_pretty(pg_total_relation_size('"' || table_schema || '"."' || table_name || '"')) AS "size"
FROM
    information_schema.tables
WHERE
    table_schema NOT IN ('pg_catalog', 'information_schema')
ORDER BY
    pg_total_relation_size('"' || table_schema || '"."' || table_name || '"') DESC;
                 table_full_name                 |    size
-------------------------------------------------+------------
 chain4.blocks                                   | 167 GB
 chain5.blocks                                   | 146 GB


graphDB=# select count(*) from chain4.blocks;
  count
---------
 2627100

graphDB=# select count(*) from chain5.blocks;
  count
---------
 5482991

graphDB=# SELECT reltoastrelid::regclass AS toast_table_name,
       pg_size_pretty(pg_relation_size(reltoastrelid)) AS toast_table_size
FROM pg_class
WHERE relname = 'blocks';
     toast_table_name      | toast_table_size
---------------------------+------------------
 pg_toast.pg_toast_5695384 | 165 GB
 pg_toast.pg_toast_5695408 | 142 GB
 pg_toast.pg_toast_18030   | 105 MB
 pg_toast.pg_toast_18054   | 0 bytes
 pg_toast.pg_toast_2412454 | 5592 kB
IPFS hash

No response

Subgraph name or link to explorer

No response

Some information to help us out
  • Tick this box if this bug is caused by a regression found in the latest release.
  • Tick this box if this bug is specific to the hosted service.
  • I have searched the issue tracker to make sure this issue is not a duplicate.
OS information

Linux

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The report centers on graphman chain truncate and the PostgreSQL chain4.blocks and chain5.blocks tables. Start by reproducing the truncation and checking the reported row counts, table sizes, and TOAST sizes before and after it runs. Done means the command's behavior is explained and the old blocks are removed or a documented cleanup path is identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
postgresql, rust
Domain
cli, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.