We build and maintain an open repository of web crawl data that can be accessed and analyzed by anyone.
homepages.news — News Homepages documentation
An open-source archive that gathers, saves, shares and analyzes news homepages
Webrecorder: Web Archiving for All
Webrecorder provides open source solutions for everyone to archive the complex, interactive Web.
The Age of PageRank is Over | Kagi Blog
When Sergey Brin and Larry Page came up with the concept of PageRank in their seminal paper The Anatomy of a Large-Scale Hypertextual Web Search Engine ( http://infolab.stanford.edu/pub/papers/google.pdf ) (Sergey Brin and Lawrence Page, Stanford University, 1998) they profoundly changed the way we utilize the web.
atproto-aware concept search engine
a mockup of a webpage search engine that only indexes webpages that are referenced in atproto records. Surfaces related links based on social and community context.
Hister | Your Own Search Engine
Hister is a private, self hosted search engine for the pages you visit and the files you keep. Search from the web, terminal, command line, or MCP.
AT Explore
Explore and discover AT Protocol data with our fast, user-friendly browser. Search posts, profiles, and feeds across the decentralized social web — including apps like Bluesky.
Search Engine for Source Code - PublicWWW.com
Search engine for source code - ultimate solution for digital marketing and affiliate marketing research.
Home | Bellingcat's Online Investigation Toolkit
A toolkit for open source researchers
Introducing Sequoia: Publishing for the Open Web
Today I'm excited to release a new tool for the AT Protocol: Sequoia. This is a CLI tool that can take your existing self-hosted blog and publish it to the ATmosphere using Standard.site lexicons.
OWID Homepage
Research and data to make progress against the world’s largest problems.
Web Archiving: Playback Tools - Thomas Preece
Web Archiving: Playback Tools - Below I've listed some of the tools I found to playback web archives. The two most popular tools that I found were OpenWayback and PyWb. Of the tests I
The Magic of Small Databases
Notes on personal libraries, collections and small indexes on the web
I expected better from Google
Nico, Minitap’s CEO, shares what the team found in Google’s Artemis repository and why attribution matters for the open-source community.
atproto-aware concept search engine
wesleyfinck.org