while converting a URI/URL, requests needs timeout when server doesn't close the stream

        elif uri.startswith("http:") or uri.startswith("https:"):
            response = self._requests_session.get(uri, stream=True)
            response.raise_for_status()
            return self.convert_response(
                response,
                stream_info=stream_info,
                file_extension=file_extension,
                url=mock_url,
                **kwargs,
            )
        else:
            raise ValueError(
                f"Unsupported URI scheme: {uri.split(':')[0]}. Supported schemes are: file:, data:, http:, https:"
            )

I have encountered issues when server doesn't close the steam and it hangs forever trying to buffer the stream

How do reproduce:

from markitdown import MarkItDown

client = OpenAI()
md = MarkItDown()
result = md.convert("https://alletting.dot.state.al.us/")
markdown = result.text_content

I propose adding a timeout value. I have tested this locally, and if you give me direction, i.e how do we pass the timeout value to this function, I can make the change myself.

I propose modifying stream_info blob to add timeout.

Start at MarkItDown.convert and the HTTP branch shown, then inspect how stream_info reaches the _requests_session.get call. Reproduce the hang with the provided URL and verify that a non-closing server no longer blocks indefinitely; the timeout behavior and its handoff through stream_info still need to be established.