1/4
Looks like no tags are added yet.
Name | Mastery | Learn | Test | Matching | Spaced |
---|
No study sessions yet.
What Is a search engine?
a program that searches through a database of internet addresses to locate resources based on the client’s criteria
What do search engines rely on?
an index of web pages
What is used to build an index?
web crawler/spider
How is a website indexed by a search engine?
web crawler/spider visits page either by:
selecting it from an existing link
following a link
records info e.g. text/meta tags/description etc.
records position of each word within page & stores them in an index
follows links to other sites
What can be used to instruct spiders/web crawlers?
robots.txt file