IndexingCrawlerIdServingDocumentIdentifier

Description

Attributes List

This module has the following attributes (case-insensitive ascending order):

Attributes

1. doubleIndexingExperimentId (type: String.t, default: nil)
   - Only for double indexing experiments. This field is set for duplicated documents so that docjoin users will not see duplicated docs.
2. dupExperimentId (type: String.t, default: nil)
   - Only for Experimental clusters, not relevant for production serving data: Index-Dups can run experiments in Quality Clusters where different versions of the same document (e.g. with different signals) are serving in parallel. They are uniquely identified by the dup-experiment-IDs. This is for experimental clusters only. In prod-versions the member will not be set.
3. key (type: String.t, default: nil)
   - The primary identifier of a production document is the document key, which is the same as the row-key in Alexandria, and represents a URL and its crawling context. The document key is the unique identifier for each document, but multiple document keys can cover the same URL (e.g. crawled with different device types). In your production code, please always assume that the document key is the only way to uniquely identify a document. Link for more background information: http://go/url The document key is populated for all docs in indexing since 2014-03. ## Recommended way of reading: const string& doc_key = cdoc.doc().id().key(); ## CHECK(!doc_key.empty()); Note: For older DocJoins (e.g. historical DocJoins), the field is not populated. In those scenarios it is recommended to use the function 'GetDocumentKeyFromCompositeDoc' in '//indexing/crawler_id/utils/compositedoc/compositedoc_util.h' instead.

Type

Function

Data sourced from HexDocs : GoogleApi.ContentWarehouse.V1.Model.IndexingCrawlerIdServingDocumentIdentifier

• ‹ IndexingConverterShingleFingerprint
• IndexingDocjoinerAnchorPhraseSpamInfo ›

Possibly related Links