Tiny Search Engine

I built a search engine application that crawls webpages, indexes them, and allows users to query through an interface, ranking the pages by relevance. It consists three subsystems:

1. Crawler: crawls the web from a seed URL to a given maxDepth and caches the content of the pages it finds in a given directory

2. Indexer: reads files from the given directory, builds an index that maps from words to URLs and writes that index to a given file.

3. Querier: returns webpages from query expressed as a set of words (optionally combined by AND, OR), and outputs a ranked list of URLs in which the given combination of words appear.