TABLE OF CONTENTS
TABLE OF CONTENTS
„
7
LIST OF ABBREV1ATIONS
9
LISTS OF F1GURES AND TABLES
11
PREFACE
15
CHAPTER 1
THE DEEP WEB
17
1.1 THE TERM "DEEP WEB"
1.2 SIZEOF THE DEEP WEB
1.3 TYPES OF INFORMATION ON THE DEEP WEB
1.3.1 FREE OF CHARGE DATABASES ON THE DEEP WEB
1.3.2 COMMERCIAL DATABASES ON THE DEEP WEB
1.4 TOP1CSON THE DEEP WEB
1.5 QUALITY OF INFORMATION ON THE DEEP WEB
1.6 WEB 2.0
1.7. THEDARKWEB
17
22
25
27
27
28
29
30
33
CHAPTER 2
CRAWLING AND INDEXING THE DEEP AND SURFACE WEB
37
2.1 CRAWLING AND INDEXING THE SURFACE WEB
2.2 CRAWLING AND INDEXING THE DEEP WEB
2.2.1 RESOURCE DISCOVERY PROBLEM.
2.2.2 THE DEEP WEB CRAWLER
2.2.3 OAI-PMH, MODOA1
2.3 PEER-TO-PEER NETWORKS
2.4 CONTENT-BASEDMUS1C, IMAGE AND VIDEO RETRIEVAL
2.4.1 MUSIC INFORMATION RETRIEVAL
2.4.2 IMAGE AND VIDEO CONTENT RETRIEVAL
37
40
41
48
52
54
55
56
5«
CHAPTER 3
DEEP WEB SEARCH TOOLS
61
3.1 DEEP WEB SEARCH TOOLS CLASSIFICATION
3.2 "PURE" HYBRIDS
3.2.1 HUMAN-POWERED SEARCH ENGINES
3.2.2 DW METASEARCH ENGINES
3.2.3 WEB D1RECTORIES
3.2.4 FEDERATED SEARCH, CROSS-DATABASE SEARCH (DWPORTALS)
3.3 "PURE" DW TOOLS
3.3.1 SPEC1ALITY SEARCH ENGINES (FOCUSED CRAWLERS)
3 3.2 REPOSITORY DIRECTORIES
3.3.3 ARCHIVES. REPOS1TORIES AND DIGITAL LIBRARIES
3.3.4 LIBRARY PORTALS.
3.3.5 REAL-TIMESEARCHABLEDATABASES.
3.3 6 COMMERCIAL SEARCH TOOLS
3.4 CITING AND THE DEEP WEB
61
64
64
65
67
68
81
81
»5
97
IM
101
102
105
CHAPTER 4
CROSSWALKS FROM THE SURFACE WEB TO THE DEEP WEB - GENERAL SEARCH TOOLS
WITH CROSSWALKS AMENDMENTS
„
107
4.1 GOOGLE
4.2 YAHOO!
4.3 WINDOWS LIVE SEARCH (MSN)
4.4 STRATEGIES ON HOW TO CREATE CROSSWALKS FROM THE SW
Bibliografische Informationen
http://d-nb.info/991114655
TO THE DW
digitalisiert durch
109
118
123
133
CHAPTER 5
CROSSWALKS FROM THE DEEP WEB TO THE SURFACE WEB: SINGULAR DATABASES AND
COMMERCIAL INFORMATION PROVIDERS WITH CROSSWALKS AMENDMENTS
137
5.1 METHODS ON HOW TO CREATE CROSSWALKS FROM SINGULAR DATABASES AND
COMMERCIAL PROVIDERS TO SW
137
5.1.2 COOPERATION WITH SEARCH ENGINES
148
5.1.3 METADATA CREATION
155
5.1.4 DOORWAY PAGES
158
5.2 PRACTICAL STRATEGIES ON HOW TO CREATE CROSSWALKS FROM THE DEEP WEB TO THE
SURFACE WEB
163
CHAPTER 6
DISCUSSION AND CONCLUSION
166
BIBLIOGRAPH V
172
GLOSSARY
180
NAME REGISTRY
182