internetarchive / internetarchive/openlibrary
Changes not showing up in autocomplete & search contexts
- Dominant language
- Python
- Stars
- 6.7k
- Forks
- 2k
- Avg merge
- 2d 19h
- Merged PRs (30d)
- 138
Description
Search indexing of changes used to be quite slow, but reasonably reliable. Now it seems to be somewhat faster, if it happens, but increasingly unreliable. Search is the glue that holds the system together because it's used not only to power user searches, but also to dynamically construct many different types of pages. It *must* become a priority and be made reliable.
### Evidence / Screenshot (if possible)
Here are some examples. I created this author record 12 days ago: https://openlibrary.org/authors/OL9105182A
and it still is inaccessible both by name and ID in the work edit form autocomplete

Additionally the work that edited to create that record: https://openlibrary.org/works/OL20688435W
Doesn't show up on the new author page and still shows up on the old author page: https://openlibrary.org/authors/OL3966915A
This author record: https://openlibrary.org/authors/OL768915A
still shows works that were edited to correct the author two days ago:
* https://openlibrary.org/works/OL4102694W
* https://openlibrary.org/works/OL4102690W
This author doesn't show the edited work above: https://openlibrary.org/authors/OL6390493A
The results for this author search: https://openlibrary.org/search/authors?q=jenny+morris&mode=everything
shows 45 books for the top author,

but the author page shows 40: https://openlibrary.org/authors/OL556098A
and claims there are three pages of results, even though the third page is empty: https://openlibrary.org/authors/OL556098A/Jenny_Morris?page=3

This author is missing newly edited metallurgy works from a couple of days ago: https://openlibrary.org/authors/OL6457565A
which are still listed under this author: https://openlibrary.org/authors/OL1716362A
etc, etc
This happens on an ongoing basis and is a waste of users' volunteered efforts.
### Relevant url?
See above.
### Steps to Reproduce
1. Go to ... description above
2. Do ...
* Actual:
* Expected: Search index is refreshed immediately and accurately
### Details
- **Logged in (Y/N)?** Y
- **Browser type/version?** N/A
- **Operating system?** N/A
- **Environment (prod/dev/local)?** prod
### Proposal & Constraints
### Related files
### Stakeholders
Contributor guide
Assessment
This issue has not been assessed yet.