[Bug] Regex without anchor `^` in the tokenizer rule matches only the beginning of the string

Reproducible in vscode.dev or in VS Code Desktop?

• Not reproducible in vscode.dev or VS Code Desktop

Reproducible in the monaco editor playground?

• Not reproducible in the monaco editor playground

Monaco Editor Playground Link

https://microsoft.github.io/monaco-editor/playground.html?source=v0.46.0#XQAAAAJVBAAAAAAAAABBqQkHQ5NjdMjwa-jY7SIQ9S7DNlzs5W-mwj0fe1ZCDRFc9ws9XQE0SJE1jc2VKxhaLFIw9vEWSxW3yscw6ftFC3x0sNKcPu0Jit6fah4A22z_ji5IM-YpoZGfrOjjhdPzzHa_1-x58P3EziD4N3-CN3OczbNnZyHd1YfXpW8qxqbTyhpPy_Qx6woe3fa2ju-ec3eBgdh6fR6wqvcyqmhW_9FExf3EuRhbdzx_OP58l_gNQ_7GZNSp9AOGCvFZEMHRrc_Ioy3mf3Zl4KHwr-4k2SezwKxMA_4gjnkJI3LuPGw7rU59QMFykyswoBrn81K_NDIajLIO1V14pengI0mGdxXLPR3E4UUNaXD_NP_VaPLtlyXJ76Q3sgRyELbzI4k6mzCaCBSTg8ld-Nnrj96wtlXTmrAieynWLegDt45-AOLMeb485CPu62VU4WMVFt22FCdf1bskc32h3hVltztt8BdroFCh8JiZQ0hOfxeDweleMZv9q-iq1p4NlQiKQhDl6TICQq-jpH_9WD_Ev3M6O5hZKMGLHPVARzt-ADG5-sRwiDwSsfIxDBt2nNV1fUMmdWWt7arE2CE79IGxYBYlfvyYnRUbyx04My-vpH7w5Oa-aW_SdelbuTUT_MH8rfECAMXKRRtLg_rok9Hh5O7XBfjiwJkrUE1OGUzOFXeHNvE-VYNwxT7nqNuyfFMh62WdRm9jXm7dxwz_EiAnly2iuTTW9jeu5hamF1Z3QUeucbAyo0wIattnM62a4m0ALZZMMTpEhLEo7fNvj__6AE0A

Monaco Editor Playground Code

// Register a new language
monaco.languages.register({ id: "mySpecialLanguage" });

monaco.languages.setLanguageConfiguration('mySpecialLanguage', {
	brackets: [
      ['{', '}'],
      ['(', ')'],
    ],
});

// Register a tokens provider for the language
monaco.languages.setMonarchTokensProvider("mySpecialLanguage", {
	tokenizer: {
		root: [
			[/\{(.*?)\}\(.*?\)/, 'custom-url'],
			[/[^<&]+/, ''] // text,
		],
	},
});

// Define a new theme that contains only rules that match this language
monaco.editor.defineTheme("myCoolTheme", {
	base: "vs",
	inherit: true,
	rules: [
		{ token: "custom-url", foreground: "EB9642" },
	],
	colors: {
		"editor.foreground": "#000000",
	},
});

monaco.editor.create(document.getElementById("container"), {
	theme: "myCoolTheme",
	value: getCode(),
	language: "mySpecialLanguage",
});

function getCode() {
	return [
		"{Monaco - The Editor of the Web}(https://microsoft.github.io/monaco-editor/)",
		"    {Monaco - The Editor of the Web}(https://microsoft.github.io/monaco-editor/)"
	].join("\n");
}

Reproduction Steps

In tokenizer, add a regular expression for parsing markdown-like links before the regular expression for plain text

Actual (Problematic) Behavior

Text matching the regular expression is highlighted with the 'cutom-url' token anywhere in the text

Expected Behavior

The text is highlighted only at the beginning of the line and is not highlighted if any characters precede the match pattern

Additional Context

[/[^<&]+/, ''] this regular expression is taken from the html syntax description embedded in monaco https://github.com/microsoft/monaco-editor/blob/main/src/basic-languages/html/html.ts#L102, since I'm doing an add-in over html. The example in playground is minimal, but the important thing is that the regular expression for markdown-like links comes first, and then at the end the regular expression for plain text

https://regex101.com/r/5AOaMI/1

Start with the Monaco Editor Playground link and the tokenizer configuration in the issue, then compare the behavior with the HTML syntax description at src/basic-languages/html/html.ts. Verify whether a tokenizer rule without a ^ anchor is intended to match later in a line, and confirm that the reproduction highlights the markdown-like link only at the line start.