10 000 000 000 000 000 bytes archived



October 25, activists and staff the Internet Archive has conducted a the ceremony regarding significant events: the Internet archive has exceeded 10 petabyte (1016 bytes). Thanks to this archive with the the time Machine we can see how to look famous sites many years ago, to find the saved copies of web pages or simply restore your site from a "free backup".

The Internet Archive announced the distribution of 80-terabyte samples sample for 2011 to everyone for research. File format WARC contain about 2.7 billion URIs. They include the entire text content and everything else that's failed to keep, including images, video, flash, etc.

Sampling:
Start date: 09 March 2011
End date: 23 December 2011
The number of unique URLS: 2 273 840 159
Number of hosts: 29 032 069

Spider Heritrix first download 1 million most popular sites by Alexa (Habr was already there), and then went on the links.



Another interesting fact that was announced at the ceremony. For the first time, all the literary heritage of the whole people is completely digitized and posted on the Internet. These people were Balinese.

Celebration the Internet Archive was graced by the legendary scientist and ideologist of programming, by Donald Knuth. He played the organ, opening ceremony.

Article based on information from habrahabr.ru

Комментарии

Отправить комментарий

Популярные сообщения из этого блога

Briefly on how to make your Qt geoservice plugin

Изображение
+ =? The next step after GPS module , became its practical application in my project. Maybe someone this post will be more interesting. First, some source data: Required: the Offline mapping service the Integration with QML Features: the the libosmscout — library providing the OSM data in the wrapper with the friendly API the Qt5Location with dev branch summary of the previous 160 series In Qt since time immemorial was a wonderful beam-process QtMobility and he was so wonderful that he lived, he lived, and bent. Yes, of course, he is still here, and even used my N9 and someone's Blackberry, but the fact that Digia will no longer support this API at all. But in Digia are working not fools, they gradually started to pull the pieces QtMobility in Qt5. One such component is a QtLocation. In Qt 5.3, you can see only a piece QtLocation, QtPositioning which refers to Digia. I must say nice stuff, gave her the NMEA from the local socket, and she...
Далее...

Database replication PostgreSQL-based SymmetricDS

In this article I will tell how to configure database replication for PostgreSQL. For the experiments we use a distribution of Linux CentOS 5.3, although this is not essential. we will use a version of PostgreSQL 8.4.7 and SymmetricDS-2.2.2. What is replication? In fact, it is a mechanism to automatically synchronize the contents of databases running on different servers. As a result of replication of these databases contain absolutely identical data. This is necessary for example in order to provide fault tolerance system (in the case of the fall of the first database server, the work enters the second), or to implement load balancing, different customers can serve different server. For replication you need at least two database servers, so prepare two identical servers with a PostgreSQL database on each. The first is the IP address 10.0.2.20, the second — 10.0.2.21, both gateway 10.0.2.2. You can do a virtual machine like VirtualBox to create two virtual servers and run...
Далее...

Developing for Sailfish OS: notifications for example apps for taking notes

Изображение
Hello! This article is a continuation of cycle of articles, dedicated to developing applications for the mobile platform Sailfish OS. This time we will talk about the app for taking notes, allowing the user to keep records, mark the tags, add images, photos, reminders, and sync with Evernote account. Let's start the article with an extensive user interface applications , and then move on to technical details . application Description The main application screen is a list of user records, where each list item shows the title of the notes, a description (or part of it, if the description does not fit completely), and the image if it is added. List items also have a context menu allowing you to delete the note or to open a dialog to edit it. And by clicking on a list item opens a screen showing all the information about this article. Talk details about the user interface of the application. The main application screen is a list of user records, where each list item shows...
Далее...