AnswerDotAI / AnswerDotAI/ModernBERT

How to Tag Entities/Keywords in ModernBert?

Open
#188 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
145
PR merge metrics
No merged PRs in 30d

Description

For identifying entities for ModernBert, what is the syntax? Is it something like the below?
What is best practice for embedding hierarchical documents with entities?

Travel-esque documement with entities:
```
search_document:
[TOPIC: Travel]
[SECTION: Europe]
[SUBSECTION: France]
[PARAGRAPH] The [KEYWORD: Eiffel Tower] is a must-visit landmark in Paris.
[SUBSECTION: Italy]
[PARAGRAPH] The Colosseum in Rome is a symbol of ancient history.
[SECTION: North America]
[SUBSECTION: USA]
[PARAGRAPH] The Statue of Liberty is a famous symbol of freedom.
```

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are identified in the issue. Start by reviewing the repository's ModernBERT usage guidance and determine whether entity tagging or hierarchical document embedding syntax is supported. Done means providing a clear, documented answer to both questions, including any applicable examples or limitations.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.