We have updated our free OSINT tools: https://intelx.io/tools
✅ New YouTube DataViewer: Shows metadata and thumbnails
✅ New Vehicle Identification Number (VIN) tab
✅ Added 4 sites to Domain search, including crt.sh, Robtex, and Hurricane Electric
✅ Added 3 sites to IP search
The YouTube DataViewer is forked from Amnesty International’s version. You can access it here: https://intelx.io/tools?tab=youtube
As announced in our last newsletter from October, we are now indexing the public web. We started to crawl domains from certain TLDs (top-level domains). There are new search categories for the public web, including “Web: Germany”, which covers DE, AT, CH, and LU and “Web: Russia”, which covers RU, KZ, and UA.
More TLDs are to follow – we are optimizing our algorithms and storage handling before scaling up. Even though we’re crawling only a handful of TLDs, and currently have set a crawling depth of just 10 sub-pages per domain, it takes up 2 TB of space already.
This new data category contains already more than 824 million selectors. Click here for an example of a search result, that shows historical copies of spiegel.de: https://intelx.io/?s=spiegel.de&m=30
We open-sourced our Go “fileconversion” library: https://github.com/IntelligenceX/fileconversion
It supports the conversion of many files to plaintext and provides other file format related functions. It was tested on 184+ million files and is used by our search engine. We are happy to give back to the open source community.
Kleissner Investments s.r.o., Na Strzi 1702/65, 14000 Prague, Czech Republic
If you don’t want to receive this email anymore, click here to unsubscribe.
February 2021: Launch of the European Internet Archive The European Internet Archive just launched! 🎉🥳 ➡ https://archive.eu/ 225 TLDs added to the list of web crawling We have added 225 top-level domains (TLDs) to the list of web crawling. Find the full list and how we are categorizing them in this blog post. Our dataset
We have added the new category “Bot Logs”. It contains data collected by and leaked from viruses such as Azorult. Such data is often sold on marketplaces such as the Genesis Market. We decided to index such data into this new category to help filtering out relevant results. You can find this new category in
We are excited to announce that we just added 225 top-level domains (TLDs) to the list of web crawling! Below is the full list. The domain count per TLD represents the domains registered according to DomainTools. We group multiple TLDs into “buckets” to make it manageable – you can select these buckets in the Advanced