Industry NewsTechnology

Google tech: from Web crawl to full sprint

Future-Proof: Navigate Threats, Seize Opportunities at ICNY 2018 | Jan 22-26 at the Marriott Marquis, Times Square, New York

Google is preparing a new bit of technology to help the company index the Web even faster. The company is going to be using a new publishing/subscribing protocol, dubbed PubSubHubbub. Let's get our geek on and figure out what we can from this. PubSubHubbub PubSubHubbub ... that big, long name pretty much sums up what it's for. It's a way for publishers (pub) and subscribers (sub) to communicate via a central repository (hub). Currently, when publishing via most modern content management systems, a signal is sent out to the Web letting search engines and other services (like feed readers) know that new content is available. This is called a ping. Then, at some point the search engine or other service goes to the source that sent out the ping. Finally, the original content publisher sends along all the new content. Notice that there are three steps to this communication: 1. Original content is published and a ping is automatically sent out. 2. A service responds to the pi...