List of buckets

Published on May 5, 2022 by

At Intelligence X we categorize data sources into buckets. Buckets can be used as filters and to broadly identify the source of individual search results. For example, the bucket “Darknet Tor” indicates the result origins from some a Tor hidden service (.onion domain) and was collected by our Tor crawler.

Buckets have human readable names and machine readable names, in the above example, it is “darknet.tor”. Another one would be “web.public.com” for data coming from the public web .com domains.

Note that access to some buckets is restricted to paid licenses, while some may be available as partial preview, and others may be available fully redacted, depending on your license.

Filter via API

You can use buckets as filters to only search specific buckets. Specifying “web.public.com” in the buckets filter (for the API endpoint /intelligent/search) will only search in that bucket.

List

Below is a non-exhaustive list of the most important buckets available. Buckets may be added and remove at any time.

BucketInfo
darknet.i2pI2P Darknet, .i2p sites
darknet.torTor Darknet, .onion sites
documents.public.scihubDocuments Public: Sci-Hub
dumpsterDumpster: Everything that does not fit anywhere else
dumpster.web.1Dumpster: Interesting other websites with high-value information
dumpster.web.ssnDumpster: SSN related websites
leaks.logsBot logs: Data collected by and leaked from viruses
leaks.private.generalRestricted Leaks
leaks.public.generalPublic Leaks
leaks.public.wikileaksWikiLeaks: Published leaked emails and documents, Snowden Documents, Cryptome
pastesPastes
patent.usPatents: US
usenetUsenet
web.gov.ruRussia Governmental Public Sites
web.public.afPublic Web
web.public.amsPublic Web
web.public.aqPublic Web
web.public.businessPublic Web
web.public.ceePublic Web
web.public.cnPublic Web
web.public.comPublic Web: .COM
web.public.dePublic Web: Germany. AT, DE, LU, CH
web.public.euPublic Web: EU
web.public.govPublic Web: Government US
web.public.infoPublic Web: .INFO
web.public.kpNorth Korea: Public Government Sites
web.public.meaPublic Web
web.public.miscPublic Web
web.public.netPublic Web: .NET
web.public.nordPublic Web
web.public.ocPublic Web
web.public.orgPublic Web: .ORG
web.public.peerPublic Web: Decentralized blockchain based TLDs, BIT, BAZAR
web.public.ruPublic Web: Russia. UA, KZ, RU
web.public.socialPublic Web
web.public.techPublic Web
web.public.wePublic Web
whoisWhois data

Related articles

Adding support for new top-level domains

Published on April 6, 2022 by

We just added support for an additional 152 top-level domains (TLDs), increasing the support to 511 TLDs in total. Support means that you can search for those domains across intelx.io and APIs, and internally that our backend supports processing them. While you can start searching for them immediately, it will take some time until our


A word of #OPSEC @theguardian

Published on March 7, 2022 by

Earlier today at 11:24 The Guardian Journalist Shaun Walker posted the security procedure and the security token used to pass makeshift checkpoints in Ukraine related to the Russian Ukrainian war: This is a reminder to journalists – and the public – to take OPSEC (operations security) seriously and not endanger people on the ground. Posting


Newsletter 2022-03-01

Published on March 1, 2022 by

We stand with Ukraine πŸ‡ΊπŸ‡¦ Intelligence X commends the brave Ukrainian soldiers. πŸ‡ΊπŸ‡¦ Free access for the Ukrainian Government We have whitelisted the domain gov.ua – all accounts signed up on intelx.io with that email ending have full access to 100 billion records. This includes access to our Identity Portal which allows users to quickly


Search the blog: