versions 3.16.x are slower than 3.15.x

### How are you using the lua-language-server?

NeoVim

### Which OS are you using?

Windows

### What is the issue affecting?

Type Checking, Completion, Diagnostics/Syntax Checking, Hover, Libraries

### Expected Behaviour

Be able to parse/load the lua workspace/environment as fast as versions 3.15.x, or faster ideally.

### Actual Behaviour

Many seconds slower to load into lua files such as init.lua.

### Reproduction steps

Install versions 3.16.0 or later, and open a lua file.

### Additional Notes

my lua_ls config looks like this;
```lua
lua_ls = {
Lua = {
hint = {
semicolon = 'All'
},
runtime = {
version = 'LuaJIT',
path = {
'?.lua',
'?/init.lua'
},
pathStrict = true
},
workspace = {
checkThirdParty = false,
library = vim.api.nvim_get_runtime_file('', true)
},
telemetry = {
enable = false
}
}
}
```
loading into init.lua for neovim has to scan ~1600 in the counter, and it takes at least 15 seconds on version 3.16.4, and only up to 4 seconds on 3.15.0.

### Log File

_No response_

Reproduce the slowdown by opening init.lua in Neovim on Windows with the provided lua-language-server configuration, comparing 3.15.0 with 3.16.4 or later. Start by measuring the workspace/library scan, including the reported ~1600 counter, and identify what differs between versions. Done means loading completes near the earlier four-second result rather than taking at least 15 seconds.

Written by the indexing model from the issue text.