Introduction to Building a Search Engine
Getting started with Search Engine
-
What is a Search Engine? (3:11)
-
Features of a good search engines (6:06)
-
Brief history of Search Engines (2:34)
-
Different between Search Engine and Web Directory (2:19)
-
What is a Metasearch Engine? (1:58)
-
What is Social Search? (2:58)
-
What is Filter Bubble? (3:12)
-
Open source search engines (2:52)
-
How Search Engines work? (4:42)
Web Crawler
-
Introduction to Web Crawler (10:58)
-
HTTP 301 vs HTTP 302 Redirects (2:44)
-
DNS Caching (5:14)
-
Multithreading vs Asynchronous Crawling (3:35)
-
Data Compression and Caching (2:25)
-
Webgraph (5:26)
-
robots.txt and sitemap.xml (9:29)
-
Crawling policy (10:00)
-
Crawler Identification (4:18)
-
Crawling the deep web (3:12)
-
Spider traps (3:58)
-
Popular libraries (5:01)
-
Open source web crawlers (1:36)
Parser
Indexing
Text Processing
Getting deep into Search Engines
Search Engine Storage
Search Engine Optimization
Apache Solr
Bye, Bye Lesson
