NlpSemanticParsingAnnotationEvalData

Posted on by Darth Autocrat

GoogleApi.ContentWarehouse.V1.Model.NlpSemanticParsingAnnotationEvalData

Table of Contents ▼

Jump to a specific part of the page:

Description

Annotators whose semantics are represented via a protocol message should add to that message a field or extension of this type and set it using Annotator::PopulateAnnotationEvalData to enable span-based evaluation metrics in training. Evaluation is done based on token spans. The byte span aligns with the token span and is used when saving examples. Background: In some settings, the examples used to induce/train a grammar do not specify complete semantics of an annotation. For example, some examples that come from Ewok specify only the span associated with each annotation. This message allows evaluation metrics to test the span by embedding it in the semantics. LINT.IfChange

Attributes List

This module has the following attributes (case-insensitive ascending order):

View Attributes

Attributes

  1. additionalSpans (type: list(GoogleApi.ContentWarehouse.V1.Model.NlpSemanticParsingAnnotationEvalData), default: nil)
    - Additional spans after the first. Empty in all additional_spans.
  2. numBytes (type: integer(), default: nil)
    -
  3. numTokens (type: integer(), default: nil)
    -
  4. startByte (type: integer(), default: nil)
    - Byte position within the utterance. Safe to use across different components of the NLU stack as long as said components have access to the same query.
  5. startToken (type: integer(), default: nil)
    - Token position. This is cleared when normalizing examples for storage because tokenization changes over time. DO NOT use these two fields across components that use different tokenizations.

Type

@type t() :: %GoogleApi.ContentWarehouse.V1.Model.NlpSemanticParsingAnnotationEvalData{
additionalSpans: [#t:t/0()] | nil,
numBytes: integer() | nil,
numTokens: integer() | nil,
startByte: integer() | nil,
startToken: integer() | nil
}

Function

@spec decode(struct(), keyword()) :: struct()

Data sourced from HexDocs : GoogleApi.ContentWarehouse.V1.Model.NlpSemanticParsingAnnotationEvalData