WebRTC seed doesn't happen until client connects from same network

I'm using cmd/torrent by building it like this:

```bash
go build -o /tmp/torrent_cmd ./cmd/torrent
```

And then seeding a file like this:

```bash
/tmp/torrent_cmd serve /tmp/sintel.mp4
```

It starts up with a few messages :

```bash
(base) ┌─[me@pc]─[~/Projects/test]
└──╼ $/tmp/torrent_cmd serve /tmp/modded-sintel.mp4
"modded-sintel.mp4": magnet:?xt=urn:btih:237a8fecf92ce838b6706a0012e44f84a31b7232&dn=sintel.mp4&tr=wss%3A%2F%2F
[2023-07-27 05:26:41 +0530 WRN] tracker client for "wss://": unhandled announce response "{\"action\":\"announce\",\"complete\":1,\"incomplete\":0,\"info_hash\":\"#z\u008fìù,è8¶pj\\u0000\\u0012äO\u0084£\\u001br2\",\"interval\":120}" [github.com/anacrolix/torrent/webtorrent tracker-client.go:336]
[2023-07-27 05:27:13 +0530 WRN] tracker client for "wss://": webrtc PeerConnection state changed to closed [github.com/anacrolix/torrent/webtorrent transport.go:73]
```

And continues to have messages like this:

```
[2023-07-27 05:27:13 +0530 WRN] tracker client for "wss://": webrtc PeerConnection state changed to closed [github.com/anacrolix/torrent/webtorrent transport.go:73]
2023/07/27 05:27:28 context deadline exceeded
[2023-07-27 05:27:35 +0530 WRN] tracker client for "wss://": webrtc PeerConnection state changed to closed [github.com/anacrolix/torrent/webtorrent transport.go:73]
2023/07/27 05:27:38 max retry time elapsed: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:4317: connect: connection refused"
[2023-07-27 05:27:47 +0530 WRN] tracker client for "wss://": webrtc PeerConnection state changed to closed [github.com/anacrolix/torrent/webtorrent transport.go:73]
2023/07/27 05:27:48 max retry time elapsed: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:4317: connect: connection refused"
[2023-07-27 05:29:10 +0530 WRN] tracker client for "wss://": webrtc PeerConnection state changed to closed [github.com/anacrolix/torrent/webtorrent transport.go:73]
2023/07/27 05:29:13 max retry time elapsed: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:4317: connect: connection refused"
```

And I'm unable to stream the video file from a remote PC using instant.io or any other webtorrent client. But the catch is.. the moment I start playing the same video (with the same magnet) on my PC (the same PC as the one that is seeding the torrent) everything is fine and all the peers get the video stream..

I have tried both the reference bittorrent-tracker as well as the openwebtorrent tracker, both of them show the same issue

EDIT: I also just tested webtorrent's desktop client and there too there's the same issue (with the same tracker), public trackers also have the same issue so I don't think it's that, is this something that is isolated to my PC/network or is it a known thing with the protocol, some pointers in the right direction would be super helpful!