CentreForDigitalHumanities / CentreForDigitalHumanities/Word2VecElastic

Handle missing values in content field

Open Beginner friendly
#10 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

If the content field is missing in some documents, the script will fail during collection. This should be handled gracefully (i.e. treat the value as an empty string).

If the value is missing from *all* documents, training word2vec models will fail, obviously, but this is not communicated clearly in the log. Maybe an extra check would be useful.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at the script's Elasticsearch collection path and follow how the content field is read before training begins. Handle missing content as an empty string, and add a clear log message when no document contains content; verify both cases through the existing script workflow.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, python
Domain
data-engineering, machine-learning, search
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
64/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.