How does a search engine work How would you design your sear
How does a search engine work? How would you design your search engine? ( short , creative answer)
Solution
search engine work on three basic stages
1)crawling: during this crawling stage it get the data from the web,it scans the images,page title,content,keyword
2)indexing: after crawling is done it will be placed in the big database
3)Ranking and retrival: when you search query it will get the related query and displays you
if i desing a search engine i would design like this
=>instead of getting data from all the servers . i will get the configuration of that servers and stores in the database which saves me lot of space ,so when user types a query then it go to the respective server and there the crwaling is done and indexing is done according to the priority level in each server (like selecting most similar pages in server1,and goes on) and the getting thoes into our database and ranking and retrival is done.
