Back to courses
Technology beginner

How Search Engines Work

Duration0 hours
Modules7
Get started — free →

Course outline

Module 1 Module 1: Crawling the Web

Crawling the Web

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. What is the primary job of a web crawler in a search engine?
  • A. To rank web pages by relevance to a query
  • B. To discover and fetch web pages by following links ✓
  • C. To display search results to the user
  • D. To sell advertising space on search results pages

Why: Crawlers, also called spiders or bots, discover new and updated pages by following links from known pages and downloading their content. Ranking and display happen later in the search pipeline.

Q2. What file tells crawlers which parts of a website they are allowed or not allowed to access?
  • A. sitemap.xml
  • B. robots.txt ✓
  • C. index.html
  • D. htaccess

Why: The robots.txt file sits at the root of a site and gives crawlers rules about which paths they may crawl. It is a voluntary standard that well-behaved crawlers respect.

Q3. What is a sitemap in the context of crawling?
  • A. A visual diagram of a website's layout for visitors
  • B. A file listing URLs on a site to help crawlers find pages ✓
  • C. A list of pages that have been penalized by search engines
  • D. A tool that measures how fast a page loads

Why: An XML sitemap lists the important URLs on a site, helping crawlers discover pages that may not be easily reached through internal links.

Q4. Why might a crawler be unable to see content that is loaded only by JavaScript after the page loads?
  • A. JavaScript is always blocked by search engines
  • B. Crawling and rendering JavaScript can be delayed or incomplete, so content may be missed ✓
  • C. JavaScript makes pages load faster, so crawlers skip them
  • D. Crawlers only read image files, not text

Why: Search engines may need extra resources to render JavaScript, which can delay indexing or cause some dynamically loaded content to be missed. Server-rendered or static HTML is generally easier for crawlers to read.

Q5. What is crawl budget?
  • A. The amount of money a site pays to be crawled faster
  • B. The number of pages a search engine is willing and able to crawl on a site within a given time ✓
  • C. The total file size of a website
  • D. The number of backlinks pointing to a site

Why: Crawl budget reflects how many URLs a crawler will fetch from a site in a period, shaped by the site's size, server capacity, and perceived importance. It matters most for large sites with many pages.

Module 2 Module 2: Indexing Content

Indexing Content

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. What is the main purpose of indexing in a search engine?
  • A. To rank web pages by user popularity
  • B. To store and organize information about web pages so they can be quickly retrieved ✓
  • C. To block spam websites from appearing online
  • D. To translate web pages into different languages

Why: Indexing creates an organized database of the content found on web pages, allowing the search engine to quickly find relevant pages when a user submits a query.

Q2. What is the name of the program that discovers and reads web pages for a search engine?
  • A. A crawler (also called a spider or bot) ✓
  • B. A ranking algorithm
  • C. A query processor
  • D. A cache server

Why: Crawlers, also called spiders or bots, follow links across the web to discover pages, which are then processed and added to the index.

Q3. Which of the following is typically stored in a search index for each word?
  • A. The user's search history
  • B. The list of documents containing that word ✓
  • C. The advertising budget of the website
  • D. The server location of the website

Why: Search indexes often use an inverted index structure, which maps each word to the list of documents (and positions) where it appears, enabling fast lookups.

Q4. Why might a web page not appear in a search engine's index?
  • A. Because it has too many images
  • B. Because it is blocked from crawling, has a noindex directive, or has never been discovered ✓
  • C. Because it uses a popular font
  • D. Because it was published more than a year ago

Why: Pages may be excluded if robots.txt blocks crawlers, a noindex meta tag is present, or no crawlable links lead to the page so the crawler never finds it.

Q5. What does the process of parsing accomplish during indexing?
  • A. It breaks down page content into structured components such as words, links, and metadata ✓
  • B. It deletes duplicate copies of the search engine
  • C. It sends search results to the user's browser
  • D. It calculates the cost of online advertising

Why: Parsing analyzes the raw HTML of a page, extracting text, links, headings, and metadata so that this information can be stored and organized in the index.

Module 3 Module 3: Ranking Algorithms

Ranking Algorithms

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. What is the primary purpose of a search engine ranking algorithm?
  • A. To store copies of every webpage on the internet
  • B. To determine the order in which search results are displayed for a query
  • C. To translate search queries into different languages
  • D. To track the physical location of web servers

Why: Ranking algorithms decide which results appear first, aiming to show the most relevant and useful pages for a given query.

Q2. Which of the following is a common signal that search engines use to evaluate a page's relevance?
  • A. The color scheme of the website
  • B. The number of images on the homepage only
  • C. The presence of the search keywords in the page's content and title ✓
  • D. The date the domain was registered in a foreign country

Why: Keyword presence in titles, headings, and body content helps search engines judge how closely a page matches what the user is looking for.

Q3. What do search engines mean by a backlink?
  • A. A link that takes users back to the previous page they visited
  • B. A link from one website to another website ✓
  • C. A link that is hidden from search engine crawlers
  • D. A link that only works in older browsers

Why: Backlinks are links from external sites pointing to your site. Search engines often treat them as votes of confidence that can boost ranking.

Q4. Which factor relates to how quickly a webpage loads for users?
  • A. Page speed ✓
  • B. Keyword density
  • C. Domain age
  • D. Font size

Why: Page speed is a ranking factor because slow pages provide a poor user experience, so search engines tend to favor faster-loading pages.

Q5. Why do search engines consider mobile-friendliness when ranking pages?
  • A. Most searches now come from mobile devices, so users need pages that display well on phones ✓
  • B. Mobile pages are cheaper for search engines to store
  • C. Desktop computers can no longer access the internet
  • D. Mobile-friendly pages automatically receive paid advertising placement

Why: Since a large share of searches happen on mobile devices, search engines prioritize pages that work well on smaller screens.

Module 4 Module 4: Query Processing

Query Processing

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. What is the first step a search engine typically takes when processing a user's query?
  • A. Ranking all indexed pages by PageRank
  • B. Tokenizing the query into individual terms ✓
  • C. Crawling the web for new pages
  • D. Displaying ads based on the user's location

Why: Query processing begins by breaking the raw query string into tokens (individual words or terms) so each can be analyzed and matched against the index.

Q2. What is the purpose of stop word removal during query processing?
  • A. To correct spelling mistakes in the query
  • B. To remove very common words like 'the' and 'of' that add little meaning to matching ✓
  • C. To translate the query into another language
  • D. To expand the query with synonyms

Why: Stop words such as 'the', 'a', and 'of' appear in almost every document, so removing them reduces noise and speeds up retrieval without much loss of meaning.

Q3. What does stemming do to the terms in a query?
  • A. It reduces words to their root or base form, such as 'running' to 'run' ✓
  • B. It adds prefixes to words to make them more specific
  • C. It sorts the query terms alphabetically
  • D. It counts how many times each word appears on the web

Why: Stemming strips suffixes to reduce related word forms to a common root, allowing a query for 'running' to also match documents containing 'runs' or 'ran'.

Q4. Why do search engines apply spelling correction to queries?
  • A. To reduce the number of indexed pages
  • B. To handle user typos by suggesting or substituting likely intended terms ✓
  • C. To make queries longer for better ad targeting
  • D. To convert all queries to uppercase

Why: Users often misspell words, so spelling correction maps misspelled terms to likely intended words, improving the chance of retrieving relevant results.

Q5. What is query expansion?
  • A. Splitting a long query into several separate searches
  • B. Adding related terms such as synonyms to the original query to improve recall ✓
  • C. Increasing the number of results shown on the page
  • D. Deleting all words except the longest one

Why: Query expansion adds related terms, like synonyms or closely associated words, so documents that use different vocabulary for the same concept can still be retrieved.

Module 5 Module 5: Relevance Signals

Relevance Signals

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. Which of the following is considered a primary relevance signal used by search engines to judge how well a page matches a query?
  • A. The number of images on the page
  • B. The presence of the query terms in the page's title and headings ✓
  • C. The page's background color
  • D. The length of the URL's domain registration period

Why: Search engines look for query terms in prominent places such as the title tag and headings, because these locations usually indicate what a page is about. Visual design, images, and domain registration length are not core relevance signals.

Q2. What does TF-IDF stand for in the context of relevance scoring?
  • A. Text Format Index District Frequency
  • B. Term Frequency-Inverse Document Frequency ✓
  • C. Total Free Information Data Filter
  • D. Topic Field Indexing and Ranking Function

Why: TF-IDF stands for Term Frequency-Inverse Document Frequency. It scores how often a term appears in a document, weighted down for terms that appear across many documents, so distinctive words count more toward relevance.

Q3. Why does a search engine typically give more weight to a query term that appears in the anchor text of links pointing to a page?
  • A. Anchor text is always longer than body text
  • B. Anchor text describes the linked page from an outside perspective, suggesting what the page is about ✓
  • C. Anchor text is hidden from users so it cannot be manipulated
  • D. Anchor text is only used for images

Why: When other sites link to a page using certain words, those words act as a description of the destination written by others. This external description is a useful signal of what the page is about.

Q4. Which factor is most associated with a page being relevant to a query like 'how to repot a succulent'?
  • A. The page contains a step-by-step guide that uses the query's key terms and related vocabulary ✓
  • B. The page has been online for more than twenty years
  • C. The page contains only a single word
  • D. The page loads its content entirely through a video file

Why: A page that directly addresses the query, using its key terms and closely related language such as 'repotting,' 'soil,' and 'pot,' signals strong topical match. Age, length alone, and format do not establish relevance.

Q5. What is the main purpose of synonyms and related terms in relevance matching?
  • A. To make pages load faster
  • B. To let search engines match pages that discuss a topic even when they use different wording than the query ✓
  • C. To replace all query words with random words
  • D. To block pages from appearing in results

Why: Search engines recognize that people and writers express the same idea in different ways. Matching synonyms and related terms lets relevant pages appear even when their exact wording differs from the query.

Module 6 Module 6: Link Analysis

Link Analysis

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. What is the main idea behind link analysis in search engines?
  • A. Counting the number of words on a page
  • B. Using hyperlinks between pages to estimate a page's importance and authority ✓
  • C. Measuring how fast a page loads for users
  • D. Checking the spelling of words in the page content

Why: Link analysis treats hyperlinks as signals of endorsement. Pages that receive many links from other pages are generally considered more important.

Q2. What is the PageRank algorithm best known for?
  • A. Ranking pages by their color scheme
  • B. Scoring pages based on the quantity and quality of links pointing to them ✓
  • C. Translating page content into other languages
  • D. Blocking spam emails from reaching users

Why: PageRank, developed by Larry Page and Sergey Brin, assigns each page a score based on the links it receives, giving more weight to links from highly ranked pages.

Q3. What is an inbound link (backlink)?
  • A. A link that a page sends out to another website
  • B. A link from one website pointing to a page on another website ✓
  • C. A link that only works inside a single page
  • D. A link used to navigate between mobile apps

Why: A backlink is a link from an external page pointing to your page. Search engines often treat backlinks as votes of confidence.

Q4. Why do links from highly authoritative websites typically carry more weight?
  • A. Because they are always longer than other links
  • B. Because they are placed at the top of the page
  • C. Because authoritative sites' endorsements pass more ranking value through the link graph ✓
  • D. Because search engines charge those sites a fee

Why: In link analysis, a link's value depends partly on the importance of the page giving it. A link from an authoritative source transfers more ranking signal than one from an obscure page.

Q5. What is a link farm, and why do search engines penalize it?
  • A. A group of pages that manipulate rankings by artificially exchanging links, and search engines penalize it as spam ✓
  • B. A service that hosts websites on farms in rural areas, and search engines penalize it for slow speed
  • C. A tool that measures how many visitors a site receives, and search engines penalize it for privacy issues
  • D. A directory of images used in search results, and search engines penalize it for copyright reasons

Why: Link farms are networks of sites created solely to inflate link counts. Since they don't reflect genuine editorial endorsement, search engines treat them as manipulation and may penalize them.

Module 7 Module 7: Search Results Pages

Search Results Pages

Introduction

Core content I

Core content II

Core content III

Summary

Further learning

Knowledge check

Q1. What is the primary purpose of a search engine results page (SERP)?
  • A. To store copies of every webpage on the internet
  • B. To display a ranked list of pages that match a user's query ✓
  • C. To sell advertising space to individual websites only
  • D. To track the physical location of the user's device

Why: A SERP displays a ranked list of pages that the search engine has determined are relevant to the user's query, which is its core function.

Q2. Which element of a SERP typically appears at the very top and is often labeled as 'Ad' or 'Sponsored'?
  • A. Organic search results
  • B. Paid advertisements ✓
  • C. Related searches
  • D. Knowledge panel

Why: Paid advertisements are usually placed at the top of the SERP and are labeled as ads or sponsored so users can distinguish them from organic results.

Q3. What are organic search results?
  • A. Results that the user has paid to have displayed
  • B. Results ranked by the search engine based on relevance and quality rather than payment ✓
  • C. Results that only appear for users in a specific country
  • D. Results that are shown only after the user clicks a button

Why: Organic results are determined by the search engine's ranking algorithm based on relevance and quality signals, not by advertisers paying for placement.

Q4. What is a featured snippet on a SERP?
  • A. A paid banner advertisement at the bottom of the page
  • B. A short excerpt pulled from a webpage and displayed above the regular results to answer a query ✓
  • C. A list of the user's previous searches
  • D. A map showing the locations of nearby businesses

Why: A featured snippet is a brief answer extracted from a web page and shown prominently at the top of the results to answer the user's question directly.

Q5. What does the meta description shown beneath a page title in search results do?
  • A. It controls the exact ranking position of the page
  • B. It provides a brief summary of the page's content to help users decide whether to click ✓
  • C. It automatically translates the page into the user's language
  • D. It blocks the page from appearing in search results

Why: The meta description offers a short summary of the page that appears under the title in results, helping users judge relevance, though it does not directly determine ranking.

Stay in the loop on this course.

We’ll email you when new modules or related material drops. No spam.

Built with Fragment Language. Sovereign architecture — no third-party trackers.
FragRun.mfgAFImemoryFGOwnership: B-Systems.ee