ImageRepositoryContentBasedVideoMetadata

GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata


Table of Contents ▼

Jump to a specific part of the page:

Description

Next Tag: 52

Attributes List

This module has the following attributes (case-insensitive ascending order):

View Attributes

Attributes

  1. aresClassificationRequestTimestamp (type: DateTime.t, default: nil)
    - Timestamp of the last successful Ares classification request.
  2. videoPreviewBytes (type: list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview), default: nil)
    - video_preview_bytes is only exported as virtual dataset by IE VideoUnderstanding and should not be persisted. It will be used by downstream IE functions to push for serving.
  3. loudnessData (type: GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData, default: nil)
    - When Transcode itag 140 is requested, MediaAnalyzer (as the part of Viper graph) generates audio info including loudness_data, which is then published to Streamer. For Audio news client, we extract this loudness data from Streamer to this field.
  4. cloudSpeechSignals (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals, default: nil)
    - Transcript generated from Cloud Speech API
  5. featureSetData (type: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData, default: nil)
    - Video Understanding Golden features. (go/amarna-video-signals#golden-signals) Note: Golden6 features (names matching "video_") are DEPRECATED. Please migrate to Golden7 ("VideoFeatures."). For more context, see go/golden7/migrating-from-golden6 and go/amarna-golden-feature-tracker. Signals popluated in Raffia cdoc.doc_videos are configured in cs/symbol:AMARNA_EXPORTED_GOLDEN7_FEATURES.
  6. videoPornScoreV4 (type: number(), default: nil)
    - The video porn confidence score extracted from WhisperV4 featureSet: "VideoFeatures.whisper_v4_labels", with CR2 label: "/tns/porn".
  7. transcriptAsr (type: GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData, default: nil)
    - Speech related metadata The transcript_asr field is generated from the YT caption's SPEECH_RECOGNIZER asset.
  8. lmsPreviewFramePerdocs (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs, default: nil)
    - LMS preview frame perdocs. Timestamps of the frame perdocs are from the original video, not from the preview.
  9. signalsBlob (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob, default: nil)
    - Amarna signals blob that contains large-size signals like VCA frame-level signals.
  10. s3LanguageIdentification (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals, default: nil)
    -
  11. frameLevelStarburstEmbeddings (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings, default: nil)
    - Frame-level Starburst embeddings. They are IE only signals for short videos initially and will be supported for all videos later. (go/frame-level-sbv5-on-ie)
  12. golden7SoapboxTracksBlobInfo (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo, default: nil)
    - Information on frame-level people feature blob. (go/vpf-frame-features)
  13. videoStreamInfo (type: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData, default: nil)
    - Deprecated, please use media_info.
  14. thumbnailerData (type: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData, default: nil)
    -
  15. transcodeMetadata (type: list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata), default: nil)
    - Metadata about each transcode requested.
  16. truncationInfo (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo, default: nil)
    - Data about whether or not the video was truncated.
  17. speechProperties (type: GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto, default: nil)
    -
  18. mediaInfo (type: GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo, default: nil)
    - Information about the media file, such as duration, resolution, and detail about each audio/video stream. Note that it contains no PII.
  19. venomId (type: String.t, default: nil)
    - The video id in the venom pipeline for STAMP purposes. DEPRECATED: Use transcode_metadata or venom_processing_info instead, which includes the ID and contains information for all clients.
  20. s3Asr (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals, default: nil)
    - Trnascript generated through AMARNA_CLOUD_SPEECH asset in Venom. Note that AMARNA_CLOUD_SPEECH uses S3 as the speech engine backend, similar to YT caption's SPEECH_RECOGNIZER asset. However, they may use different S3 models.
  21. venomProcessingInfo (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo, default: nil)
    - Information about the video's status in Venom, including IDs and processing times.
  22. safesearchVideoContentSignals (type: GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals, default: nil)
    - Contains SafeSearch video classification outputs which are vertical_name/float pairs.
  23. videoPornScore (type: number(), default: nil)
    - The video porn confidence score extracted from Whisper featureSet: "video_labels:whisper_v3", with CR2 label: "/cr2/1".
  24. thumbnailQualityScore (type: GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore, default: nil)
    - Thumbnail quality score predict how visual pleasing a thumbnail is, based on the model trained with deep neural networks.(go/thumb_features_dd) Note the signal currently only available for Youtube videos.
  25. languageIdentification (type: GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults, default: nil)
    -
  26. representativeFrameData (type: GoogleApi.ContentWarehouse.V1.Model.ImageData, default: nil)
    -
  27. videoDurationSec (type: float(), default: nil)
    - Set from the video header if truncated, or is the verified length if completely crawled.
  28. inlinePlayback (type: GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata, default: nil)
    - Metadata related to Inline playback on the Interest Feed. This field is filled by Hamilton.
  29. signalsBlobInfo (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo, default: nil)
    - Information for the amarna signals blob.
  30. audioOnly (type: boolean(), default: nil)
    - Both audio- and audio-video-files are treated as videos during indexing (whether they share a container format, like .mp4, or not, like .mp3). This bool indicates that there's no video track, just an audio track.
  31. golden7SoapboxSummary (type: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData, default: nil)
    - Golden7 video-level people features. (go/ypf-video-features)
  32. videoAnchorSet (type: GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets, default: nil)
    - Video anchor sets hold set of anchors with multiple anchor types and sequence of VideoAnchor which contains metadata about the anchor, such as thumbnail, perdoc data.
  33. amarnaDocid (type: String.t, default: nil)
    - A hash of the video bytes used as a key to Amarna's video_metadata table.
  34. multiThumbnailsFramePerdocs (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs, default: nil)
    - multi_thumbnails_frame_perdocs contains perdocs(go/vss-signals#perdoc) for all frame thumbnails generated by multiple frames per minutes. See more details in go/multiple-thumbnails-per-minutes.
  35. videoPreviews (type: list(GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata), default: nil)
    - video_previews contain the preview metadata but no bytes. It exits for IE and non-IE cases.
  36. legosAnnotationData (type: GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets, default: nil)
    - Legos results
  37. youtubeProcessingFilter (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter, default: nil)
    - Contains lists of reasons why YT videos were filtered from specific processing.
  38. unwantedContent (type: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent, default: nil)
    - If set, video has been deleted using the deletion service (MediaDeletionService).
  39. searchDocid (type: String.t, default: nil)
    - 64 bit docid used for retrieving video previews.
  40. videoTranscriptAnnotations (type: GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations, default: nil)
    - VideoTranscriptAnnotations holds sentence segmented text and timing information to be used for VideoAnswers (go/video-answers). Note that only punctuated_transcript, timing_info, and lang field are filled, and other fields will be filled in the later stage.

Type

@type t() :: %GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata{
amarnaDocid: String.t() | nil,
aresClassificationRequestTimestamp: DateTime.t() | nil,
audioOnly: boolean() | nil,
cloudSpeechSignals: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil,
featureSetData: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil,
frameLevelStarburstEmbeddings: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings.t() | nil,
golden7SoapboxSummary: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil,
golden7SoapboxTracksBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil,
inlinePlayback: GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata.t() | nil,
languageIdentification: GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults.t() | nil,
legosAnnotationData: GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets.t() | nil,
lmsPreviewFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil,
loudnessData: GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData.t() | nil,
mediaInfo: GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo.t() | nil,
multiThumbnailsFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil,
representativeFrameData: GoogleApi.ContentWarehouse.V1.Model.ImageData.t() | nil,
s3Asr: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil,
s3LanguageIdentification: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals.t() | nil,
safesearchVideoContentSignals: GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals.t() | nil,
searchDocid: String.t() | nil,
signalsBlob: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob.t() | nil,
signalsBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil,
speechProperties: GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto.t() | nil,
thumbnailQualityScore: GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore.t() | nil,
thumbnailerData: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData.t() | nil,
transcodeMetadata: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata.t() ] | nil,
transcriptAsr: GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData.t() | nil,
truncationInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo.t() | nil,
unwantedContent: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent.t() | nil,
venomId: String.t() | nil,
venomProcessingInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo.t() | nil,
videoAnchorSet: GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets.t() | nil,
videoDurationSec: float() | nil,
videoPornScore: number() | nil,
videoPornScoreV4: number() | nil,
videoPreviewBytes: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview.t() ] | nil,
videoPreviews: [GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata.t()] | nil,
videoStreamInfo: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData.t() | nil,
videoTranscriptAnnotations: GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations.t() | nil,
youtubeProcessingFilter: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter.t() | nil
}

Function

@spec decode(struct(), keyword()) :: struct()

Data sourced from HexDocs : GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata