Lag spikes every 5 minutes.

Streaming overall is very smooth, no drops whatsoever, overall 10ms of latency(average 2,5ms of network receive time) on 1080p, 40Mbps and 120fps. It only happens every 5 minutes or so, for 3 seconds, that the frames start to drop dramatically.
The audio and video stutters heavily, bitrate visibly drops. The spike lasts for about 3 seconds, just to get back to normal performance.
Moonlight streaming stats, when the spike happens, show that 50% of my frames dropped because of my network connection.
Tried setting the network duplex to 100 Mbps Full Duplex, but the issue still persists.
The issue is not present when switching to my 4G phone data.
The issue does not exist on other phones connected to my home Wi-Fi.
I'm using an Exynos S7, 600mb/s 5Ghz Wi-Fi, playing with a Bluetooth controller(The issue persists with Bluetooth off as well)

when testing my connection on ping.canbeuseful.com on my phone's browser, I get a of having single 200ms, sometimes 400ms ping spikes every so often, but I'm not quite sure what to make out of it.

I also had another stutter issue before, that still exists, it's just that I managed to find a workaround for it. There are microstutters that happen every 5 seconds, make the audio stutter as well. To get rid of them, I have to turn on, and turn off airplane mode before launching a Moonlight streaming session. This, however, does not fix the mentioned above huge stutters.

it seems like its a local issue on my phone, but not quite sure what causes it :\

Start by reproducing the periodic frame drops on the Exynos S7 over 5GHz home Wi-Fi and compare the behavior with 4G data and other phones on the same network. Check the reported ping spikes and the separate five-second microstutters; done means identifying a reproducible cause and verifying that streaming no longer has the reported periodic stutters.