jivoi / awesome-osint Goto Github PK
View Code? Open in Web Editor NEW:scream: A curated list of amazingly awesome OSINT
License: Other
:scream: A curated list of amazingly awesome OSINT
License: Other
Maybe you want to mention that this list is taken directly from i-inteligence's OSINT handbook.
It's cool to convert the PDF into a format that is easier to collaborate on and contribute to, but I think they deserve credit for compiling this awesome list.
Each section needs to be checked for low quality links that:
a) are not awesome
b) low-quality
c) very little information
d) removed/dead link
Do this in sections:
Also see #79 for more to do.
Useful github OSINT website for usernames.
nationalcellulardirectory.com
Can you consider adding analyzeid to the list?
https://analyzeid.com/
Search for other websites owned by the same person using reverse lookup Google Adsense & Google Analytics.
Category: Domain and IP Research
Non-related:
These websites seem to be down. I don't want to do a PR if these sites are temporarily down.
https://unicorns.io/
Unicorns
http://sameid.net/
SameID
http://www.tweetpaths.com/
Tweetpaths
The search function was removed from Pastebin but most of these sites still have search functions.
Alternatively TrashPanda is a good scraper for most bin sites: https://twitter.com/leak_scavenger by @rnd_infosec_guy
https://batman.gyptis.org/zerobin
https://Cl1p.net
https://Codepad.org
https://Controlc.com
https://Doxbin.org
https://Dpaste.com
https://Dpaste.org
https://Dumpz.org
https://Friendpast.com
https://ghostbin.co/
https://Gist.github.com
https://Hastebin.com
https://Heypasteit.com
https://Hpaste.org
https://Ideone.com
https://Ivpaste.com
https://Jsbin.com
https://Justpaste.it
https://Mysticpaste.com
https://Nopaste.info
https://0bin.net
https://Obin.net
https://Paste.debian.net
https://Paste.ee
https://Paste.fedoraproject.org
https://Paste.frubar.net
https://Paste.kde.org
https://Paste.lisp.org
https://Paste.pound-python.org
https://Paste.openuse.org
http://doxbinjs77uawbbl.onion/ (Tor bin site)
Hello,
This awesome list includes a lot of paid tools and services.
Please highlight the free and/or open source ones.
Thanks
IntelTechniques.com removed all their tools due to a recent issue. More info at https://inteltechniques.com/menu.html
Hi, I would like to add our service into "E-mail Search / E-mail Check" category. We have been working for 2.5 years, since this period we've collected about 7.5B entries from more than 3000 databases and this number is still growing. We provide API on any subscription (SLA 99.95%), integration with Telegram bot, notifications of new entries and allow search by e-mail, username, password, corporate domain name, hash. Officially registered as a company, using reliable hosting and payment providers.
Our website: https://leakcheck.net
The Amass tool is similar to TheHarvester in that it is a DNS OSINT tool. It would be great to have it on your list. The link to the project page is below:
https://github.com/caffix/amass
Thanks in advance!
The Edgar Online entry seems to be a corporate solution of minimal usefulness for a broad list such as this.
However, the United States Securities and Exchange Commission posts the Edgar data publicly at the following link:
EDGAR U.S. Securities and Exchange Commission Filings - Periodic reports and extensive corporate disclosures from all businesses publicly traded in the United States.
The link above is very useful for research into any company that is listed on a public U.S. stock exchange, as such businesses are required to post certain data and periodic reports to this database. This includes foreign entities that are listed on the NYSE, ETF funds or other investment products, and publicly-traded U.S. businesses. Data includes information on owners of these entities, information they disclose to investors, and financial statements.
Recommend replacing the Edgar Online link with the one above, the primary source is sufficient and useable.
I saw your page:
https://github.com/jivoi/awesome-osint
Could you please add our tool there as well, in exchange for free notifier account?
Our tool:
https://notifierforreddit.com
Is there a way to import these into a bookmarks html file easily or a fork that does this?
Ran a quick link checker tool and the following returned a timeout or other critical error (other than a 403 forbidden which appeared on many legitimate and working links).
Some are just typos or broken links, others are defunct sites. Others may just be a timeout by the script I ran. Should be run through to fix up or remove all as appropriate.
Such a great list! Thank you so much for creating it.
We would really appreciate it if you could add our citation generator to your directory:
Bibcitation - https://www.bibcitation.com
Suggested Category:
Writing and Office Tools
Thanks so much again!
Going through and reviewing for links that are not very useful and I think that this list could benefit from refining the summary a bit to add focus. "Open source intelligence"/OSINT is a very amorphous term, but there is probably at least some improvement to be made to the current description:
A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term "open" refers to overt, publicly available sources (as opposed to covert or clandestine sources)
I think about OSINT in general terms of using information available from publicly accessible websites, tools, or databases in order to gather and congregate information with real-world applications.
Even with a broad definition I think there's room to focus the list a bit. There are pages of translation apps and it's not clear what utility that provides over just one tool that is curated as being the best for curation. The clutter makes it difficult to navigate!
Hello,
I did a quick scan of broken links on the page and found these links --> OSINT.xlsx no longer exists. The excel sheet also includes their error code when accessing them. It is possible that some pages may have been temporarily down.
I would also like to kindly suggest a new one -- https://www.ezixy.com/shopiq/
The tool allows shopping multiple ecommece sites with single search query and also allows to bulk open selected sites.
Nice list. We have started a new malware threat feed (REScure) which is accessible at :
homepage : https://rescure.fruxlabs.com/
Feedpath : https://rescure.fruxlabs.com/rescure_blacklist.txt
The feed is curated form an inhouse threat intelligence solution and is updated at every 6 hours. A blogpost detailing about this is mentioned here :
https://www.theprohack.com/2018/09/rescure-cyber-threat-intelligence-feed.html
Currently limited to only malicious IPs, we will enhance this by adding IoCs such as malware hashes, domains et al in future.
Thanks !
Hi everyone, the latest iIntelligence OSINT Handbook 2018 has just been released. How can we extract the data into your excellent GitHub format? Happy to help if needed.
https://www.i-intelligence.eu/wp-content/uploads/2018/06/OSINT_Handbook_June-2018_Final.pdf
According to the guidelines awesome entries in this guide must be open but most of the entries in the PDF Managment section are not open source
Anyone have any good database for asia people search?
Osintgram seems like a good fit for this list. Spotted in some online news coverage this week.
Docker image tool that supports some pretty rad OSINT procedures on any public Instagram handle, including:
- addrs Get all registered addressed by target photos
- captions Get user's photos captions
- comments Get total comments of target's posts
- followers Get target followers
- followings Get users followed by target
- fwersemail Get email of target followers
- fwingsemail Get email of users followed by target
- fwersnumber Get phone number of target followers
- fwingsnumber Get phone number of users followed by target
- hashtags Get hashtags used by target
- info Get target info
- likes Get total likes of target's posts
- mediatype Get user's posts type (photo or video)
- photodes Get description of target's photos
- photos Download user's photos in output folder
- propic Download user's profile picture
- stories Download user's stories
- tagged Get list of users tagged by target
- wcommented Get a list of user who commented target's photos
- wtagged Get a list of user who tagged target
I'll put a PR together with a description when I have time.
This repository has violated the copyright of the Snoop Project https://github.com/snooppr/snoop.
An attacker illegally used the 'BDfull' Snoop database. At the moment, the pirate was blocked on Gitlab (for this case https://gitlab.com/soxoj), I will also recover from him for copyright infringement, so that Github would react.
You can check the post BlackArch/blackarch#2848 (comment)
After restoring the maigret repository (Soxoj began cleaning up its traces, deleting all its commits). But Github has an api that shows the real history of the maigret repository https://api.github.com/repos/soxoj/maigret (created_at ":" 2020-06-27T14: 16: 42Z). Creation date is not 8 Jan 2020 as he faked in the commits (soxoj/maigret@ac0be37).
Here is his forked real repository https://github.com/torerobo/maigret (he illegally used the Snoop Project database). He is not allowed to distribute his pirated work under the MIT license (because he illegally used the Snoop Project database).
Some evidence of his piracy (I collected a lot of them, for example, I dumped and hashed all the chats in Telegram, where he wrote, about Snoop and his illegal actions, all this evidence will go to court against the pirate):
https://www.youtube.com/watch?v=R8dWfbyKSsE&feature=youtu.be
https://www.youtube.com/watch?v=Z_titGNXm6g — very clear demonstration of evidence of open piracy: from 6 minutes 18 seconds, just watch this piece.
Here at 18 seconds, you can see that this is a fork of Sherlock (before he started obfuscating the repository).
https://www.youtube.com/watch?v=9FCfpG75YAc
I ask you not to encourage piracy and to block the pirate repository maigret:
#199
UPD: Часть доказательств в PDF формате/RU
Note to fix, self-explanatory title. Simple mistake in the link.
There are lots of free tools here: https://securityforeveryone.com/information-gathering-tools
Hey @jivoi ,
I made the request here but there a few changes that need to be made to the overall list.
Care to add me as an admin maintainer so I can tidy up list a bit and get us approved?
Thanks
After more than 19 years, and over two million questions answered, AllExperts.com is now closed. We apologize for any inconvenience.
You can find our latest Expert-answered content at Thoughtco.com.
AOL Reader shut down in 2018
Add to company research section:
it is a tool that presents unique features in file sharing and collaboration and will be a very good addition to that branch, My team and all of our clients use this tool to share content and we have had a very positive experience of it for years.
Bublup.com
Add redirect inspector to list of domain research tools. It's similar to redirectdetective, but allows t make geo dependant requests (it's very useful for debug RKN blocks etc).
Tool to search through public S3 buckets. Amazing
filmot.com - Search all youtube subtitles
haveibeenzuckered.com - Check if a phone number appeared in a Facebook data leak
Hello. I found a mistake about the AFP acronym in the "News" section of the list. AFP doesn't mean "Associated France Press", but "Agence France-Presse". Apparently, the name isn't translated into english (https://en.wikipedia.org/wiki/Agence_France-Presse). I think there was a confusion with the AP (Associated Press) which is another agency.
Here is the link, found in the README of this repo at line 351.
AFAIK, its name changed last year from ExtractFace to DumpItBlue but I might be wrong so I don't want to open a PR myself that might be based on a misunderstanding.
https://www.vesselfinder.com/?utm_campaign=meetedgar&utm_medium=social&utm_source=meetedgar.com
To track ships and vessels.
To get added to the official awesome list, descriptions must be added to the following:
(Please note that this is not a copy paste, only the ones without descriptions (about 95% of them))
Please help. Even just doing 5 to 10 will help, it won't take up much of your time.
Just FYI there are 1834 :O !!! descriptions to do!
General Search
Main National Search Engines
Meta Search
Specialty Search Engines
Similar Sites Search
Document and Slides Search
Pastebins
Major Social Networks
Real-Time Search, Social Media Search, and General Social Media Tools
Social Media Tools/Twitter
Social Media Tools/Facebook
Social Media Tools/Google+
Social Media Tools/Instagram
Social Media Tools/Pinterest
Social Media Tools/VKontakte
Social Media Tools/Tumblr
Blog Search
Forums and Discussion Boards Search
Username Check
People Investigations
E-mail Search / E-mail Check
Expert Search
Company Research
Job Search Resources
Q&A Sites
Domain and IP Research
Keywords Discovery and Research
Web History and Website Capture
Language Tools
Image Search
Image Analysis
Stock Images
Video Search and Other Video Tools
Radio and Podcasts Tools
Academic Resources and Grey Literature
Books and Reading
Geospatial Research and Mapping Tools
News
News Digest and Discovery Tools
Fact Checking
Data and Statistics
Web Monitoring
Bookmarking
Startpages
Browsers
Offline Browsing
VPN Services
Note-taking
Annotation Tools
Writing and Office Tools
Slide Show and Presentation Tools
Digital Publishing
Newsletter Tools
Digital Storytelling
Infographics and Data Visualization
Image and Photo Editing
Productivity Tools
E-mail Management
Document and Reference Management
PDF Management
Cloud Storage and File Sharing
Web Automation
Dashboard Tools
Wikis
Collaboration and Project Management
Communication Tools
Calendars and Scheduling
Mind Mapping, Concept Mapping and Idea Generation Tools
Social Network Analysis
Privacy and Encryption Tools
OSINT Videos
Please see #80 for some more stuff to do.
Awesome list!
Please add Digitalstakeout to the list.
https://www.digitalstakeout.com/platform
Social Media Tools
Real-Time Search, Social Media Search, and General Social Media Tools
Domain and IP Research
Threat Intelligence
Suggested Categories:
Dark Web Monitoring
Dark Web Search Engines
unable to import face_recognition and facebook.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.