scrapinghub / scrapinghub/dateparser

Dateparser fails to detect dates in format : DD.MM.YYYY (German, or any permutation) and YYYYMMDD (any variation)

Open
#1,142 0 comments 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

search_dates
Dominant language
Python
Stars
2.9k
Forks
520
Avg merge
22h 56m
Merged PRs (30d)
6

Description

Hi,

In this notebook, I found that dateparser always fails to detect German Format date : DD.MM.YYYY which can simply handle by replacing '.' with '/' before parsing.

Not sure that this is the best way to do, but important improvement on date accuracy as shown on the dataset 400 dates in different formats

from dateparser import search

search.search_dates("23.03.01")
search.search_dates("23/03/01")

search.search_dates("2023.03.01")
search.search_dates("2023/03/01")

search.search_dates("20230301")

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the examples through dateparser.search.search_dates, comparing dotted, slashed, and compact date forms such as DD.MM.YY and YYYYMMDD. Read the parsing path reached by search_dates and check how German-style separators and compact dates are handled. Done means the listed valid formats are detected consistently without regressing the working slash-separated examples.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
internationalization
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.