Adding libraries doesn't work unless restart IDE

Environment:

• VS Code Version: 1.96.4
• Extension Version: Extension Pack for Java v0.29.0 + Lanuagae Support for Java v1.41.0
• JDK Type & Version: jdk-17
• OS Type & Version: Linux/Windows

Step to Reproduce:

1. Clone and open https://github.com/jdneo/invisble-project
2. Open a java file
3. Open project settings > Libraries > Add new library for test-lib folder > Apply
4. Or Open Java Project view > Referenced Libraries > Add new library for test-lib folder

Expected Behavior:
After add new libraries, it can automatically show up without manually refreshing or restarting IDE.

Actual Behavior:
Add libraries at step 3 or step 4, it won't be refreshed here, even manually refresh it > Restart IDE, the new added libraries will be shown up.
Note: with vscode java 1.40.0 + pack 1.29.0, it doesn't repro.

Related Issues:

Riprodurre il problema seguendo i passaggi elencati, utilizzando Project Settings > Libraries e la visualizzazione Java Project > Referenced Libraries come punti di ingresso. Confrontare l’aggiunta di una libreria nelle versioni indicate e verificare che la libreria venga visualizzata senza un aggiornamento manuale o il riavvio dell’IDE; l’issue non indica file sorgente o test da cui iniziare.