JuliaText / JuliaText/Snowball.jl
Multi-threaded stemming?
- Dominant language
- Julia
- Stars
- 3
- Forks
- 2
- PR merge metrics
- No merged PRs in 30d
Description
First of all, thank you for the library!
I was wondering is it possible to use it with multi-threading?
I've tried initializing several stemmers (`Stemmer()`), one for each thread, but it led to a segfault. I
'm not sure why - I thought it should have initialized separate stemmers.
Is there another workaround that can use to parallelize the stemming workload?
Contributor guide
No contributing guide indexed for this repository
Research direction
No source file or test is named. Start by reproducing the reported segfault with one Stemmer() per thread and inspect the stemmer initialization and threaded execution paths. Done means parallel stemming works without a segfault, or the supported limitation and a safe workaround are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100