GI LogoGI Logo
  • Login
Digital Library
    • All of DSpace

      • Communities & Collections
      • Titles
      • Authors
      • By Issue Date
      • Subjects
    • This Collection

      • Titles
      • Authors
      • By Issue Date
      • Subjects
Digital Library Gesellschaft für Informatik e.V.
GI-DL
    • English
    • Deutsch
  • English 
    • English
    • Deutsch
View Item 
  •   DSpace Home
  • Lecture Notes in Informatics
  • Proceedings
  • INFORMATIK - Jahrestagung der Gesellschaft für Informatik e.V.
  • P307 - INFORMATIK 2020 - Back to the Future
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.
  •   DSpace Home
  • Lecture Notes in Informatics
  • Proceedings
  • INFORMATIK - Jahrestagung der Gesellschaft für Informatik e.V.
  • P307 - INFORMATIK 2020 - Back to the Future
  • View Item

Web Archive Analytics

Author:
Völske, Michael [DBLP] ;
Bevendorff, Janek [DBLP] ;
Kiesel, Johannes [DBLP] ;
Stein, Benno [DBLP] ;
Fröbe, Maik [DBLP] ;
Hagen, Matthias [DBLP] ;
Potthast, Martin [DBLP]
Abstract
Web archive analytics is the exploitation of publicly accessible web pages and their evolution for research purposes—to the extent organizationally possible for researchers. In order to better understand the complexity of this task, the first part of this paper puts the entirety of the world's captured, created, and replicated data (the “Global Datasphere”) in relation to other important data sets such as the public internet and its web pages, or what is preserved thereof by the Internet Archive. Recently, the Webis research group, a network of university chairs to which the authors belong, concluded an agreement with the Internet Archive to download a substantial part of its web archive for research purposes. The second part of the paper in hand describes our infrastructure for processing this data treasure: We will eventually host around 8 PB of web archive data from the Internet Archive and Common Crawl, with the goal of supplementing existing large scale web corpora and forming a non-biased subset of the 30 PB web archive at the Internet Archive.
  • Citation
  • BibTeX
Völske, M., Bevendorff, J., Kiesel, J., Stein, B., Fröbe, M., Hagen, M. & Potthast, M., (2021). Web Archive Analytics. In: Reussner, R. H., Koziolek, A. & Heinrich, R. (Hrsg.), INFORMATIK 2020. Gesellschaft für Informatik, Bonn. (S. 61-72). DOI: 10.18420/inf2020_05
@inproceedings{mci/Völske2021,
author = {Völske, Michael AND Bevendorff, Janek AND Kiesel, Johannes AND Stein, Benno AND Fröbe, Maik AND Hagen, Matthias AND Potthast, Martin},
title = {Web Archive Analytics},
booktitle = {INFORMATIK 2020},
year = {2021},
editor = {Reussner, Ralf H. AND Koziolek, Anne AND Heinrich, Robert} ,
pages = { 61-72 } ,
doi = { 10.18420/inf2020_05 },
publisher = {Gesellschaft für Informatik, Bonn},
address = {}
}
DateienGroesseFormatAnzeige
A8-1.pdf438.0Kb PDF View/Open

Sollte hier kein Volltext (PDF) verlinkt sein, dann kann es sein, dass dieser aus verschiedenen Gruenden (z.B. Lizenzen oder Copyright) nur in einer anderen Digital Library verfuegbar ist. Versuchen Sie in diesem Fall einen Zugriff ueber die verlinkte DOI: 10.18420/inf2020_05

Haben Sie fehlerhafte Angaben entdeckt? Sagen Sie uns Bescheid: Send Feedback

More Info

DOI: 10.18420/inf2020_05
ISBN: 978-3-88579-701-2
ISSN: 1617-5468
xmlui.MetaDataDisplay.field.date: 2021
Language: en (en)

Keywords

  • Big Data Analytics
  • Web Archive
  • Internet Archive
  • Webis Infrastructure
Collections
  • P307 - INFORMATIK 2020 - Back to the Future [128]

Show full item record


About uns | FAQ | Help | Imprint | Datenschutz

Gesellschaft für Informatik e.V. (GI), Kontakt: Geschäftsstelle der GI
Diese Digital Library basiert auf DSpace.

 

 


About uns | FAQ | Help | Imprint | Datenschutz

Gesellschaft für Informatik e.V. (GI), Kontakt: Geschäftsstelle der GI
Diese Digital Library basiert auf DSpace.