The page exists but is not returned
Search its title and inspect the localised index. If absent, fix inclusion or extraction. If present, examine indexed terms before creating duplicate content.
In-depth practical guides
Build representative queries, check results by language and improve journeys without confusing the existence of search with successful discovery.
Updated :

AI-generated illustration
Internal search serves different intentions: finding a known profile, exploring a topic or choosing a tool. A returned result does not prove useful content is visible. Connect each query to a task and check title, excerpt, destination and language. A documented set of meaningful questions is more useful than a score based on purposeless queries.
Select important content in each main family: guide, profile, category, tool and dossier. Describe the need and pages that actually answer it. Include a need with no known answer to test empty results.
Test exact title, everyday expression, specialist term and shorter wording. Include accents, apostrophes, non-Latin characters and abbreviations actually used. Variants should represent plausible usage rather than merely mirror editorial vocabulary.
Search from all six interfaces. Check filter labels, excerpts, messages and destination language. For a localised corpus, results should not silently lead to another language version.
Record the expected page’s position and whether its title is recognisable. Open it and confirm useful content still exists. Stale excerpts, deleted profiles and overly broad categories can mislead despite seemingly good rankings.
Test empty query, no results, active filter, pagination and back navigation. Confirm query and language retention. Use the keyboard and check that the form’s label describes the action and messages remain understandable.
Distinguish missing content, stale index, vocabulary differences, wrong links and unsuitable ranking. Apply the corresponding fix. Rebuild the index and repeat tasks to verify improvement and catch regressions elsewhere.
A broad intent may have several useful pages. Before testing, separate directly useful answers, acceptable supporting material and irrelevant results. Record whether the reader wants an explanation, a profile or a downloadable template. This evaluates ranking without artificially requiring one URL for every wording.
Reading workshop
A fictional five-result set calculates precision, recall and reciprocal rank without changing denominators midway.
Fictional data and records for learning: none of these results comes from a live service query.
The ranking is A, B, C, D, E. The relevance reference contains C, E and F. Only the first three results are inspected: k=3 and m=3 results actually retained.
If the table exceeds the screen, scroll horizontally; arrow keys work when the region is focused.
| Calculation element | Scenario value | Interpretation | Check to retain |
|---|---|---|---|
| Results through the cutoff | A, B, C; m=3 | E exists in the ranking but remains outside the cutoff. | Fix the cutoff before calculation and retain original order. |
| Relevant reference set | C, E, F; three answers | F is absent from the returned results. | Retain judgment rationales and the corpus version. |
| Intersection at k=3 | C only; one relevant result retrieved | Precision = 1/3; recall = 1/3. | Here precision divides by m, the number actually retained through k; declare this convention. |
| First relevant result | C at rank 3; reciprocal rank RR = 1/3 | This is one query, not an MRR average. | Do not present this isolated case as overall search-engine performance. |
One query, exact ASCII identifiers (letters, digits, dot, hyphen, colon or underscore), at most 32 characters. One identifier per line; surrounding whitespace and blank lines ignored. Up to 20 ranked results and 100 relevant references, without duplicates. Cutoff k from 1 to 20.
m is the number actually supplied up to k. Precision = relevant results found / m; recall = relevant results found / reference size. A zero denominator leaves the rate undefined. Reciprocal rank is 1/first relevant rank, or zero without a hit.
| Rank | Exact identifier | Supplied judgment |
|---|---|---|
| 1 | A | Absent from the reference |
| 2 | B | Absent from the reference |
| 3 | C | Relevant in the reference |
Supplied judgments define this calculation; documents outside the reference are treated as nonrelevant. An incomplete reference does not give global recall. No search engine is queried. This reciprocal rank is not mean MRR; when m is smaller than k, precision uses m rather than a fixed-k denominator.
Open each proposition to compare its diagnosis. More checks may still be needed.
That uses all five results although the declared cutoff is three. It answers a different question.
Wrong denominator. The relevant reference has three items, and only one was retrieved within the cutoff.
Correct for this case with m=3. The fractions coincide for different reasons; they are not interchangeable.
Query: DEMO-Q03 Ranking: A, B, C, D, E Relevant reference: C, E, F Cutoff: k=3; actually retained: m=3 Intersection: C; count: 1 Precision: 1/3; recall: 1/3 First relevant: rank 3; RR: 1/3
A to F are invented identifiers. Judgments are assumptions of the exercise, not results of a real website evaluation.
Search its title and inspect the localised index. If absent, fix inclusion or extraction. If present, examine indexed terms before creating duplicate content.
Check that it limits the intended type and remains visible when there are no results. Offer removal or useful rewording, not invented results to fill the screen.
Compare its URL with the equivalent content. Fix parameters or routing and test pagination and return navigation. A translated title is insufficient if the destination resets language.
Illustrative case: identical titles open either a method or a blank document. Test understanding the method and obtaining the template separately. Rank for the task and show the result type; a technically correct link can still open the wrong kind of answer.
Test example: API should not match a page solely because the word capital contains those letters. Check short words as units, then acronyms in titles and body text. Keep one relevant case and one excluded case so a change does not inflate recall artificially.
Worked exercise
Fictional example: the values and documents teach the method and do not describe a real organisation.
Task: verify a many-to-one join. The relevance judgments below are exercise inputs.
If the table exceeds the screen, scroll horizontally; arrow keys work when the region is focused.
| Rank | Fictional result | Task supported |
|---|---|---|
| 1 | General article | No |
| 2 | Join checking guide | Yes |
| 3 | Entity profile | No |
| 4 | Worked join case | Yes |
| 5 | Cardinality checks | Yes |
Precision at five is 3/5, or 60%. The first useful result is at rank 2; reciprocal rank is 1/2. These measures distinguish list noise from access to the first useful answer.
A result mentioning joins without explaining the check does not satisfy this task. Reassess it if the content changes.
Keep query, task, five destinations, relevance judgments and check date.
DOCUMENTED REFERENCE
Two rankings may retrieve the same number of relevant documents while placing them at very different positions. This exercise separates quality within the first k results, coverage of the collection and the wait for the first useful result.
| Reference | Value or form | What it identifies |
|---|---|---|
| Corpus | A–H · R = 4 | In this original exercise, all eight documents A–H are judged for one query. A grade above zero is relevant: B, C, D and F, giving R = 4. |
| P@k / Recall@k | hits / k · hits / R | Precision divides relevant retrieved results by k. Recall uses all four relevant documents in the collection, including those not returned. |
| RR@k | 1 / first relevant rank | RR@k is the reciprocal rank of the first relevant result within the window, or zero if none appears. This is a per-query measure, not a mean MRR. |
| AP@k · R denominator | Σ P@i × rel(i) / R | The convention here is AP@k = the sum of precision at relevant ranks through k, divided by R. Unretrieved relevant documents contribute zero. Some tools use a different denominator. |
Original exercise: fixed grades for one query, with no personal data or request sent to an engine. A = 0, B = 3, C = 1, D = 2, E = 0, F = 3, G = 0, H = 0. IDs do not represent real documents.
Enter 1–8 distinct IDs A–H, separated by commas. Omitted documents remain in the reference collection.
Calculations stay in your browser. The two explorers are independent.
Initial ranking A,C,E,B; k = 4. The ideal reference also includes D and F, absent from the returned list.
P@k = hits/k; Recall@k = hits/4; RR@k = 1/first relevant rank (otherwise 0); AP@k = Σ[rel(i) × P@i]/4
| Rank | Document | Grade | Cumulative relevant documents | Precision at rank | AP contribution |
|---|---|---|---|---|---|
| 1 | A | 0 | 0 | 0 | 0 |
| 2 | C | 1 | 1 | 0.5 | 0.125 |
| 3 | E | 0 | 1 | 0.333333 | 0 |
| 4 | B | 3 | 2 | 0.5 | 0.125 |
| Document | Grade | Relevant if grade > 0 |
|---|---|---|
| A | 0 | No |
| B | 3 | Yes |
| C | 1 | Yes |
| D | 2 | Yes |
| E | 0 | No |
| F | 3 | Yes |
| G | 0 | No |
| H | 0 | No |
Teaching example, not a measurement of a real engine. Document IDs must be unique and fully ordered; there is no implicit tie handling. Results are rounded to six decimals; calculations use unrounded values.
A,C,E,B and B,A,E,C each contain two relevant documents in four results. Both precision and recall are 0.5, but the first success is at rank 2 or rank 1, so RR@4 is 0.5 or 1.
Documentation consulted on .
Cover main families and intentions, then actual problem cases. Add queries revealing distinct gaps. Count alone does not establish representativeness.
No. Honest empty results with visible filters and useful suggestions beat irrelevant matches. Then examine whether the need warrants valuable new content.
Repeat the same tasks and compare success, useful-page rank and required steps. Keep environment and corpus version; more results can hide lower relevance.
Index useful searchable content and parameters needed for identity. Exclude errors, stale content and valueless technical states. Check that corpus updates trigger the intended rebuild.
Use the public questions, the operations described by the guides and some useful synonyms. Adding cases without expected response also allows you to check the understanding of the empty results.
DEEPER READING / PRACTICE
A page exists, but natural requests do not make it appear. The control must test the reader’s words, variants and filters with explicit expectations.
Updated on .
Create navigation, subject and method requests. Check the presence of the expected result, relevance of the description, destination and behavior of the filters.
A search may seem effective on accurate titles but fail on the usual formulations. An old index may ignore a recently added content.
The search paper combines query, intention, expected result and observed result. Corpus updates trigger a verification of new useful formulations.