Newsletter 2019-11-12

Published on November 12, 2019 by

November 2019: Tools and Public Web

🕵🏻 OSINT Tools: New Tabs & Updates

We have updated our free OSINT tools: https://intelx.io/tools

✅ New YouTube DataViewer: Shows metadata and thumbnails
✅ New Vehicle Identification Number (VIN) tab
✅ Added 4 sites to Domain search, including crt.sh, Robtex, and Hurricane Electric
✅ Added 3 sites to IP search

The YouTube DataViewer is forked from Amnesty International’s version. You can access it here: https://intelx.io/tools?tab=youtube

🌍 Public Web

As announced in our last newsletter from October, we are now indexing the public web. We started to crawl domains from certain TLDs (top-level domains). There are new search categories for the public web, including “Web: Germany”, which covers DE, AT, CH, and LU and “Web: Russia”, which covers RU, KZ, and UA.

More TLDs are to follow – we are optimizing our algorithms and storage handling before scaling up. Even though we’re crawling only a handful of TLDs, and currently have set a crawling depth of just 10 sub-pages per domain, it takes up 2 TB of space already.

This new data category contains already more than 824 million selectors. Click here for an example of a search result, that shows historical copies of spiegel.de: https://intelx.io/?s=spiegel.de&m=30

Open Sourcing our “fileconversion” Library

We open-sourced our Go “fileconversion” library: https://github.com/IntelligenceX/fileconversion

It supports the conversion of many files to plaintext and provides other file format related functions. It was tested on 184+ million files and is used by our search engine. We are happy to give back to the open source community.

✉️ Connect with us


Kleissner Investments s.r.o., Na Strzi 1702/65, 14000 Prague, Czech Republic

If you don’t want to receive this email anymore, click here to unsubscribe.

Related articles

Newsletter 2020-03-23

Published on March 23, 2020 by

March 2020 Updates How we prepared for the current global situation We have ordered and deployed 180 TB worth of enterprise storage to be prepared for upcoming price increases and shortages of hard disks. We are reading reports that warn of upcoming delivery delays due to disruptions in the supply chain. We tweeted a picture


Decoding the US Death Master File

Published on March 19, 2020 by

“The Death Master File (DMF) is a computer database file made available by the United States Social Security Administration since 1980″ according to Wikipedia. It is available here https://ladmf.ntis.gov/ but costs $2,930.00 anually. The file has since been posted on the internet for free, including here: http://ssdmf.info/download.html November 30, 2011 http://cancelthesefunerals.com/ May 31, 2013 https://archive.org/details/DeathMasterFile May 31, 2013 This file can


An OSINT investigation into one of our attackers

Published on March 5, 2020 by

On December 11, 2019 we have received 31,866 HTTP requests from the IP 81.171.107.57. Below are few sample log entries: 81.171.107.57 – – [11/Dec/2019:13:52:37 +0000] “POST /login HTTP/1.1” 200 7448 81.171.107.57 – – [11/Dec/2019:13:52:37 +0000] “POST /login HTTP/1.1” 200 7443 81.171.107.57 – – [11/Dec/2019:13:52:37 +0000] “POST /login HTTP/1.1” 200 7447 81.171.107.57 – – [11/Dec/2019:13:52:37 +0000]


Search the blog: