CrawlerChangerateUrlChangerate

Description

The next available field number is 22. To access the best estimate of change period, please use GetChangePeriod in predict-change-rate.h to select between this and other change period estimates below.

Attributes List

This module has the following attributes (case-insensitive ascending order):

Attributes

1. approximatedPosterior (type: GoogleApi.ContentWarehouse.V1.Model.CrawlerChangerateMultipleComponentDistribution, default: nil)
   - The approximated posterior distribution.
2. averageChangeSignificance (type: float(), default: nil)
   - The "significance" of the average change we saw of this document (from 0 to 1). Influenced by content changes. This can be used for prioritizing the crawl (higher significance first).
3. changeperiod (type: integer(), default: nil)
   - //////////////////////////////////////////////////////////////////////////// The classic changerate estimation. //////////////////////////////////////////////////////////////////////////// The classic estimate of change period (in seconds). It is computed by inserted a "fake" change and no-change interval as a prior distribution. This field is generally not used and should NOT be accessed directly. See above for correct method for determining the change period estimate.
4. confidence (type: float(), default: nil)
   - The confidence (between 0 and 1) in the changeperiod guess.
5. globalBasedChangePeriod (type: integer(), default: nil)
   - //////////////////////////////////////////////////////////////////////////// The changerate estimation based on the global prior. //////////////////////////////////////////////////////////////////////////// The global-based changeperiod. This is our estimate (in seconds) for the average time between changes. It is computed using the new prior method based on global_based_prior_period and the global_based_prior_strength specified below. This is used for computing pattern priors. Use pattern_based_change_period or changeperiod fields for all other purposes.
6. globalBasedChangePeriodConfidence (type: float(), default: nil)
   - The 'confidence' of the global-based changeperiod. This is the n-th root of the posterior evaluated at MAP point, where n is the number of history intervals. For now, it is hard to interpret the meaning of the absolute values of 'average' posterior cross different sets of data.
7. globalBasedPriorPeriod (type: float(), default: nil)
   - The 2 parameters below specify the prior employed in calculating the global_based_change_period. These values are precomputed through an offline analysis and specified via flags.
8. globalBasedPriorStrength (type: float(), default: nil)
   -
9. lastChangeSignificance (type: float(), default: nil)
   - The "significance" of the last change we saw of this document (from 0 to 1). Influenced by content changes, etc. This can be used for prioritizing the crawl (higher significance first).
10. lastChanged (type: integer(), default: nil)
    - The last time (unix timestamp) we saw a changed copy of the document. Provided iff we have seen the page change.
11. lastFetched (type: integer(), default: nil)
    - The last time (unix timestamp) we saw a fetched copy of the document.
12. numIntervals (type: integer(), default: nil)
    - The number of intervals we've seen for this document (where an interval is two different versions).
13. patternBasedChangePeriod (type: integer(), default: nil)
    - //////////////////////////////////////////////////////////////////////////// The changerate estimation based on the pattern prior. //////////////////////////////////////////////////////////////////////////// The pattern-based changeperiod. This is our estimate (in seconds) for the average time between changes. It is calculated based on the pattern_based_prior_period and pattern_based_prior_strength below. This quantity will eventually replace the old changeperiod calculation.
14. patternBasedChangePeriodConfidence (type: float(), default: nil)
    - The same as global_based_change_period_confidence, except it is computed using pattern based priors.
15. patternBasedLowerChangePeriod (type: integer(), default: nil)
    - The lower edge of a confidence interval for the pattern-based change period.
16. patternBasedPriorPeriod (type: float(), default: nil)
    - The 2 parameters below specify the prior employed in calculating the pattern_based_change_period. These values are calculated in a separate process and looked up based on the URL pattern.
17. patternBasedPriorStrength (type: float(), default: nil)
    -
18. patternChangePeriodVersion (type: integer(), default: nil)
    - The version number of the algorithm, refer to ChangePeriodVersion for more information.
19. type (type: integer(), default: nil)
    - //////////////////////////////////////////////////////////////////////////// Basic information of a document. //////////////////////////////////////////////////////////////////////////// The type of the document determined by crawl histories, refer to TYPE for more information.
20. ugcChangePeriod (type: integer(), default: nil)
    - //////////////////////////////////////////////////////////////////////////// The UGC changerate estimation. //////////////////////////////////////////////////////////////////////////// Information on change period generated from user generated content (UGC) change history.
21. ugcChangePeriodConfidence (type: float(), default: nil)
    -

Type

Function

Data sourced from HexDocs : GoogleApi.ContentWarehouse.V1.Model.CrawlerChangerateUrlChangerate

• ‹ CrawlerChangerateUrlChange
• CrawlerChangerateUrlHistory ›

Possibly related Links