IQSS / IQSS/dataverse

Tabular data without headers with first row cell content longer than 255 characters cause exception for document ingestion

Open
#7,386 8 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Feature: File Upload & Handling Type: Bug User Role: Depositor
Dominant language
Java
Stars
1.1k
Forks
564
Avg merge
2d 2h
Merged PRs (30d)
29

Description

@tparkola @4tikhonov
Dataverse v. 4.19 build 331-affbf4f.
I wanted to upload some xlsx file, but i got an error:

"Tabular data ingest failed. Ingest produced tabular data, but failed to save it in the database; Transaction aborted No further information is available."

After checking out the log file, I found out that one of my tabs got a cell, which was treated as header, and max length for header is 255 (column type varchar(255)) . Mine was longer.
I got through this by changing datavariable name column type to TEXT.
ALTER TABLE datavariable ALTER COLUMN name TYPE TEXT;
Then it worked just fine.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the failure by ingesting an XLSX tab without headers whose first-row cell exceeds 255 characters, then inspect the tabular ingestion log and the datavariable table schema. Confirm that the fix allows the header value to be stored and that ingestion completes without the transaction-aborted error.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.