Newsletter 2019-11-12

Published on November 12, 2019 by

November 2019: Tools and Public Web

🕵🏻 OSINT Tools: New Tabs & Updates

We have updated our free OSINT tools: https://intelx.io/tools

✅ New YouTube DataViewer: Shows metadata and thumbnails
✅ New Vehicle Identification Number (VIN) tab
✅ Added 4 sites to Domain search, including crt.sh, Robtex, and Hurricane Electric
✅ Added 3 sites to IP search

The YouTube DataViewer is forked from Amnesty International’s version. You can access it here: https://intelx.io/tools?tab=youtube

🌍 Public Web

As announced in our last newsletter from October, we are now indexing the public web. We started to crawl domains from certain TLDs (top-level domains). There are new search categories for the public web, including “Web: Germany”, which covers DE, AT, CH, and LU and “Web: Russia”, which covers RU, KZ, and UA.

More TLDs are to follow – we are optimizing our algorithms and storage handling before scaling up. Even though we’re crawling only a handful of TLDs, and currently have set a crawling depth of just 10 sub-pages per domain, it takes up 2 TB of space already.

This new data category contains already more than 824 million selectors. Click here for an example of a search result, that shows historical copies of spiegel.de: https://intelx.io/?s=spiegel.de&m=30

Open Sourcing our “fileconversion” Library

We open-sourced our Go “fileconversion” library: https://github.com/IntelligenceX/fileconversion

It supports the conversion of many files to plaintext and provides other file format related functions. It was tested on 184+ million files and is used by our search engine. We are happy to give back to the open source community.

✉️ Connect with us


Kleissner Investments s.r.o., Na Strzi 1702/65, 14000 Prague, Czech Republic

If you don’t want to receive this email anymore, click here to unsubscribe.

Related articles

List of buckets

Published on May 5, 2022 by

At Intelligence X we categorize data sources into buckets. Buckets can be used as filters and to broadly identify the source of individual search results. For example, the bucket “Darknet Tor” indicates the result origins from some a Tor hidden service (.onion domain) and was collected by our Tor crawler. Buckets have human readable names


Adding support for new top-level domains

Published on April 6, 2022 by

We just added support for an additional 152 top-level domains (TLDs), increasing the support to 511 TLDs in total. Support means that you can search for those domains across intelx.io and APIs, and internally that our backend supports processing them. While you can start searching for them immediately, it will take some time until our


A word of #OPSEC @theguardian

Published on March 7, 2022 by

Earlier today at 11:24 The Guardian Journalist Shaun Walker posted the security procedure and the security token used to pass makeshift checkpoints in Ukraine related to the Russian Ukrainian war: This is a reminder to journalists – and the public – to take OPSEC (operations security) seriously and not endanger people on the ground. Posting


Search the blog: