---
title: "Crawl Logs | Ceisium Docs"
description: "Track crawl status, page outcomes, failures, retries, and coverage."
canonical: https://ceisium.com/docs/crawl-logs/
---

> For the complete documentation and public content index, see [llms.txt](/llms.txt). This page is the Markdown alternative to the canonical HTML page.

## Start

1.  [Quickstart Create a project, crawl it, query the API, and embed search.](https://ceisium.com/docs/)
2.  [Search API Auth, request fields, response shape, pagination, errors, and examples.](https://ceisium.com/docs/search-api/)
3.  [UI Components Install search UI patterns and wire them to a Ceisium Search project.](https://ceisium.com/docs/ui-components/)
4.  [Analytics Read search events, no-result queries, popular queries, and engagement.](https://ceisium.com/docs/analytics/)

## Search quality

1.  [Benchmark Results, response times, and methods for our search comparison.](https://ceisium.com/docs/benchmark/)

## Observability

1.  [Crawl Logs Track crawl status, page outcomes, failures, retries, and coverage.](https://ceisium.com/docs/crawl-logs/)
2.  [Usage Review API requests, crawl volume, indexing usage, and plan limits.](https://ceisium.com/docs/usage/)

1.  [Home](https://ceisium.com/)
2.  /
3.  [Docs](https://ceisium.com/docs/)
4.  /
5.  Crawl Logs

Updated Sep 27, 2026

# Crawl Logs

Track crawl status, page outcomes, failures, retries, and coverage.

Browse docs

## Start

1.  [Quickstart](https://ceisium.com/docs/)
2.  [Search API](https://ceisium.com/docs/search-api/)
3.  [UI Components](https://ceisium.com/docs/ui-components/)
4.  [Analytics](https://ceisium.com/docs/analytics/)

## Search quality

1.  [Benchmark](https://ceisium.com/docs/benchmark/)

## Observability

1.  [Crawl Logs](https://ceisium.com/docs/crawl-logs/)
2.  [Usage](https://ceisium.com/docs/usage/)

Crawl Logs show what Ceisium Search found, indexed, skipped, or failed during a crawl.

![Ceisium Crawl logs page showing source selection, run filters, crawl statuses, page counts, and recent Next.js App Router crawl jobs.](https://ceisium.com/docs/crawl-logs-dashboard.webp)

Crawl Logs list recent crawl runs with status, timing, source scope, and page outcome counts.

![Ceisium Crawl logs page showing source selection, run filters, crawl statuses, page counts, and recent Next.js App Router crawl jobs.](https://ceisium.com/docs/crawl-logs-dashboard.webp)

Crawl Logs list recent crawl runs with status, timing, source scope, and page outcome counts.

## Run states

State

Meaning

Queued

Crawl is waiting to start.

Running

Ceisium Search is fetching and indexing pages.

Completed

Crawl finished and page counts are ready.

Failed

Crawl stopped before completing. Check the error and source settings.

## Page counts

Count

Meaning

Discovered

URLs found during crawl.

Indexed

Pages added to search.

Skipped

Pages ignored because of scope, duplicate URLs, or unsupported content.

Failed

Pages Ceisium Search tried but could not fetch or index.

![Ceisium URL details drawer showing indexed, skipped, failed, and total URL counts with a folder tree of indexed Next.js App Router documentation pages.](https://ceisium.com/docs/crawl-logs-url-details.webp)

Open URL details to inspect individual indexed, skipped, and failed URLs for a crawl.

![Ceisium URL details drawer showing indexed, skipped, failed, and total URL counts with a folder tree of indexed Next.js App Router documentation pages.](https://ceisium.com/docs/crawl-logs-url-details.webp)

Open URL details to inspect individual indexed, skipped, and failed URLs for a crawl.

## Next.js example

For a source that includes `/docs/app` and its child paths on `https://nextjs.org`, check for pages such as:

TXT

```
/docs/app/docs/app/getting-started/installation/docs/app/guides/json-ld/docs/app/api-reference/functions/use-params
```

If `/docs/app/guides/json-ld` is missing, check include and exclude paths before rerunning the crawl.

## Debug flow

1.  Open the latest crawl.
2.  Filter URL events to `Failed` and `Skipped`.
3.  Check whether the missing page is outside the source path.
4.  Adjust source scope.
5.  Run crawl again.

[Previous Benchmark](https://ceisium.com/docs/benchmark/) [Next Usage](https://ceisium.com/docs/usage/)

Copy page

Copy page Copy page as Markdown for LLMs [ ![](https://www.google.com/s2/favicons?domain=chatgpt.com&sz=32)Open in ChatGPT ↗ Ask questions about this page ](https://chatgpt.com/?q=Use%20this%20documentation%20page%20as%20context%20and%20help%20me%20answer%20questions%20about%20it%3A%20Crawl%20Logs%20https%3A%2F%2Fceisium.com%2Fdocs%2Fcrawl-logs%2F)[ ![](https://www.google.com/s2/favicons?domain=claude.ai&sz=32)Open in Claude ↗ Ask questions about this page](https://claude.ai/new?q=Use%20this%20documentation%20page%20as%20context%20and%20help%20me%20answer%20questions%20about%20it%3A%20Crawl%20Logs%20https%3A%2F%2Fceisium.com%2Fdocs%2Fcrawl-logs%2F)