Memory stays high after dropping torrent

Heya!

Once a torrent is finished downloading (There is a check every 5m, that drops a torrent is torrent.Complete is true.), I drop it with torrent.Drop(), and rename it from the map I use to keep track of them. However, my application's memory usage stays up, not going down unless I restart.
After a few downloads, it's at ~400mb, while if I hadn't downloaded anything it stabilizes around 25mb.

I've tried looking at a heapdump with pprof, but I understand far too little of it to figure out what might be going wrong with it.

Am I supposed to remove a torrent on the client somewhere, or close something else first? Any help would be super welcome ❤️

Thanks for the amazing project!
~ Amelia