Comments (1)
Search API that returns a list of domains
I implemented a nice test version that returns a plain text list of the domains. It can be used as a malware feed and Tor2web blocklist.
This is how it works
- Query format is key=value and the location of the API is /search/API
- Accordingly, the search is /search/API?q=key=value
- Key can be title, server_header, text, h1 or h2
- The value is what you are searching for
- Examples: title=alert, server_header=openresty, text=ahmia, h1=Hidden Service, h2=Hidden Service
- Query key=value must be shorter than 120 chars
For instance, as we know that the title element of CTB-Locker site is "Recovering the private key for the CTB-Locker encryption", see https://ahmia.fi/search/?q=CTB-Locker, we can search this title pattern using the API: https://ahmia.fi/search/API?q=title=Recovering%20the%20private%20key%20for%20the%20CTB-Locker%20encryption
Very useful for those who are hunting malware servers on Tor. This list can be handled to Tor2web as a blocklist.
Let's take another example: F-Secure published, see https://www.f-secure.com/weblog/archives/00002777.html, that there is a new malware called OphionLocker. We can easily find more of it's servers just by searching https://ahmia.fi/search/API?q=h1=please+enter+your+hwid
In general, if we are interested to look for a list of sites that are seized by FBI and Homeland Security we can just look one of these sites and see that there is a title element "Alert!" and after this look similar sites https://ahmia.fi/search/API?q=title=alert
from ahmia.
Related Issues (20)
- Sort search results according to popularity measurements HOT 1
- Mobile optimization and user experience
- Testing in Django
- More documentation
- Memory leak in Django WSGI process
- Rewrite tools as Scrapy spiders
- Statistics about hidden websites over time
- Tweaking Apache Solr to get better search results
- Why some pages are so slow? Make them faster! HOT 1
- Gather ALL hidden services HOT 7
- Online checker script is consuming a large amount of memory
- got the installation error for requirements HOT 4
- dependency for postgresql HOT 1
- Fix Tor2web uptime reporting by changing the way uptime checking is done
- Adding gpg-signed onion address / gpg key to onion sites HOT 1
- When a hidden service has been online HOT 1
- tor2web HOT 1
- Install database HOT 3
- Introduce "Similarity Matching" logic into ahmia to aggregated website that are very similar
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ahmia.