Open Government 🏛

Published on November 20, 2020 by

Open government is the governing doctrine which holds that citizens have the right to access the documents and proceedings of the government to allow for effective public oversight.

Wikipedia

After the recent firing of Christopher Krebs, the 1st director of the Cybersecurity and Infrastructure Security Agency (CISA), we decided to leap into action and preserve public data from US governmental websites.

New Category

We created the new category, “Government US”, that includes all Public Web data from these TLDs:

  • .GOV
  • .MIL

As a result, you can now access historical versions of the CISA website via https://intelx.io/?did=3dab2dd6-724f-4c66-916f-62c586ab7037. New copies are made every few days so it will catch any changes – and preserve any content that might be deleted or altered by the current or future administration. This data is available for free (you don’t even need an account).

Why historical websites look plain: For security reasons, we remove any JavaScript, images, and external references including CSS files which contain the style sheet information. As a result you only see the bare HTML content without backgrounds, colors and images.

To search for historical versions of a particular US government domain, select the “Government US” category in the Advanced menu:

You will then see the website with all crawled URLs visualized as tree:

At Intelligence X, transparency is paramount. Our users have full access to our data set and we are transparent where data is coming from. If you click on a search result there is a “Metadata” tab that shows you all the details.

Data Size

At the time of writing, the crawlers were running for less than 24 hours, even though the dataset is already growing quickly:

  • 160 GB of data
  • 10+ million selectors
  • 29,791 active .GOV domains
  • 13,208 active .MIL domains

Related articles

Newsletter 2020-11-17

Published on November 17, 2020 by

🎙️ Join the webinar with Media Sonar Tomorrow at 2 p.m. EST (= 20:00 CET) we are hosting a webinar with Media Sonar! Sign up here: https://mediasonar.com/intelligencex-osint-cyber-investigation/ The title is “How Analysts Use OSINT and Dark Web for Cyber Investigations”. Our CEO will talk about how you can use Intelligence X, and will give some


Newsletter 2020-10-19

Published on October 19, 2020 by

October 2020: Hunter Biden, Maltego Transform v4, Decentralized TLDs 🥳 It has been 2 years since the launch of Intelligence X! At this point we would like to thank our users & customers for their trust and we look forward to the future. -Intelligence X Team Make sure to follow us on Twitter for the


An OSINT investigation into the alleged Hunter Biden email

Published on October 14, 2020 by

Disclaimer: Intelligence X is politically neutral. This investigation is based on public information (open source intelligence). tl;dr: It appears that the email addresses appearing in the alleged email are accurate. This does not validate nor refute the content of said email. The New York Post published today the two articles “Hunter Biden emails show leveraging


Search the blog: