[Feature Request] crawl through the onion network to prevent abuse reports about bitmagnet HOT 4 CLOSED

Hi, I'm not sure Tor integration is feasible, and is likely to be prohibitively slow. See https://blog.torproject.org/bittorrent-over-tor-isnt-good-idea/ or Google "BitTorrent over Tor" to find a ton of articles like this. In any case DHT uses UDP which isn't possible over Tor so this would just be for the peer protocol bit that downloads the meta info.

I DO want to make it easier to route through something like GlueTun (https://github.com/qdm12/gluetun), this might just be a case of providing an example docker-compose people can use.

from bitmagnet.

I'm not sure I understand what kind of integration you have in mind, but for any part of the crawler to run over Tor would likely incur a significant overhead and might well be viewed as abuse of the Tor network. It's more about number of requests than size - the crawler might be making thousands of requests per minute. That said, I'm no Tor expert and if someone can come up with a workable PoC I'd be happy to be proven wrong.

Sure, feel free to get in touch at [email protected]

from bitmagnet.

There's a gluetun example here now @Motophan https://github.com/bitmagnet-io/bitmagnet/blob/main/docker-compose.yml

from bitmagnet.

Ah, sorry for the miscommunication, when I said "route everything over tor" I meant this container's public connections, not the entire download stack from bitmagnet -> arr -> client. I want to crawl dht files over tor only, however I would use a seedbox for the downloads. Crawling the network isnt that much bandwidth and the onion network is better setup for this. I think maybe 10-20KB per file, so even a million files would only be a few GBs. However I see its udp, so that wouldnt work. Drat.

A vpn / seedbox will usually ignore a few dmcas before banning you, but after running this only a hour I was listed for over 100 files on iknowwhatyoudownload.com and I think a overzelous copy protection agencies would send a letter on a metainfo req instead of waiting for you to download from them. However, they might actually wait to get data back from you before firing off a love letter. I dont know.

However, do you get abuse reports from running this? I may be overly concerned.

just some sample gluten config would be wonderful, I am currently trying something on my end.

Can I contact you over email? There is something private I want to say.

from bitmagnet.