Newsletter 2021-01-23

Published on January 23, 2021 by

January 2021: Capitol Hill Riots Archive, New Features

Our dataset contains now 30 billion records and grows by +3 billion every month. Last year has been incredible for us. We are growing by any metric – all organically. Searches are up 113% Q-on-Q and our user base is growing sustainably at 18% month-on-month.

Capitol Hill Riots

We have sprung into action on January 6, 2021 when Twitter and Facebook started to delete videos of the Capitol Hill riots. It is important evidence for law enforcement & the public. Use the “Tree View” tab to see all pictures and videos! Link:

You can find the public FTP details (containing 200 GB of media) in this tweet. Our efforts on this has been mentioned in the news:

Excel like Viewer

We launched an embedded Excel-like viewer! It will automatically appear for all CSV and XLSX files. This new feature was tricky because of different delimiters, formats, and many edge cases to consider. The text-only tab is still available to show the data as plaintext.

A good example is an archive of former President Trump’s tweets:

Native Video and Audio Players

Another new feature we released is native video and audio players. You can try out video streaming by the link on the top regarding the Capitol Hill Riots.

Here is an audio example: North Korea music

📝 Trivia

  • We ran into an exotic Windows issue: one of our key-value databases maxed out the NTFS file fragment count. While the database is stored as 1 file on disk, NTFS stores it internally as millions of little fragments, eventually hitting an internal limit and preventing the file from growing.
  • We are upgrading our peer uplink to 10 Gbit!

📰 Darknet marketplaces and hacks

  • ViceLeaker which allegedly has ties to the Iranian government got internal documents exposed on a Telegram channel. It is indexed here. Use the Tree View to switch to the Telegram messages.
  • Marketplace “DarkMarket” has been seized by Europol and friends. Our first archived copy (link 🔒) dates to July 2019. There is not a lot of information crawled, but at least a few pointers including the onion domains used over time. Read Europol’s press release.
  • There is a follow-up on the WeLeakInfo takedown. Police apparently arrested 21 customers according to this news report.

Kleissner Investments s.r.o., Na Strzi 1702/65, 14000 Prague, Czech Republic

If you don’t wish to receive this newsletter anymore, please click here to unsubscribe.

Related articles

List of buckets

Published on May 5, 2022 by

At Intelligence X we categorize data sources into buckets. Buckets can be used as filters and to broadly identify the source of individual search results. For example, the bucket “Darknet Tor” indicates the result origins from some a Tor hidden service (.onion domain) and was collected by our Tor crawler. Buckets have human readable names

Adding support for new top-level domains

Published on April 6, 2022 by

We just added support for an additional 152 top-level domains (TLDs), increasing the support to 511 TLDs in total. Support means that you can search for those domains across and APIs, and internally that our backend supports processing them. While you can start searching for them immediately, it will take some time until our

A word of #OPSEC @theguardian

Published on March 7, 2022 by

Earlier today at 11:24 The Guardian Journalist Shaun Walker posted the security procedure and the security token used to pass makeshift checkpoints in Ukraine related to the Russian Ukrainian war: This is a reminder to journalists – and the public – to take OPSEC (operations security) seriously and not endanger people on the ground. Posting

Search the blog: