GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata
Table of Contents ▼
Jump to a specific part of the page:
Description
Next Tag: 52
Attributes List
This module has the following attributes (case-insensitive ascending order):
View Attributes
- amarnaDocid
- aresClassificationRequestTimestamp
- audioOnly
- cloudSpeechSignals
- featureSetData
- frameLevelStarburstEmbeddings
- golden7SoapboxSummary
- golden7SoapboxTracksBlobInfo
- inlinePlayback
- languageIdentification
- legosAnnotationData
- lmsPreviewFramePerdocs
- loudnessData
- mediaInfo
- multiThumbnailsFramePerdocs
- representativeFrameData
- s3Asr
- s3LanguageIdentification
- safesearchVideoContentSignals
- searchDocid
- signalsBlob
- signalsBlobInfo
- speechProperties
- thumbnailerData
- thumbnailQualityScore
- transcodeMetadata
- transcriptAsr
- truncationInfo
- unwantedContent
- venomId
- venomProcessingInfo
- videoAnchorSet
- videoDurationSec
- videoPornScore
- videoPornScoreV4
- videoPreviewBytes
- videoPreviews
- videoStreamInfo
- videoTranscriptAnnotations
- youtubeProcessingFilter
Attributes
-
aresClassificationRequestTimestamp
(type:DateTime.t
, default:nil
)
- Timestamp of the last successful Ares classification request. -
videoPreviewBytes
(type:list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview)
, default:nil
)
- video_preview_bytes is only exported as virtual dataset by IE VideoUnderstanding and should not be persisted. It will be used by downstream IE functions to push for serving. -
loudnessData
(type:GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData
, default:nil
)
- When Transcode itag 140 is requested, MediaAnalyzer (as the part of Viper graph) generates audio info including loudness_data, which is then published to Streamer. For Audio news client, we extract this loudness data from Streamer to this field. -
cloudSpeechSignals
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals
, default:nil
)
- Transcript generated from Cloud Speech API -
featureSetData
(type:GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData
, default:nil
)
- Video Understanding Golden features. (go/amarna-video-signals#golden-signals) Note: Golden6 features (names matching "video_") are DEPRECATED. Please migrate to Golden7 ("VideoFeatures."). For more context, see go/golden7/migrating-from-golden6 and go/amarna-golden-feature-tracker. Signals popluated in Raffia cdoc.doc_videos are configured in cs/symbol:AMARNA_EXPORTED_GOLDEN7_FEATURES. -
videoPornScoreV4
(type:number()
, default:nil
)
- The video porn confidence score extracted from WhisperV4 featureSet: "VideoFeatures.whisper_v4_labels", with CR2 label: "/tns/porn". -
transcriptAsr
(type:GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData
, default:nil
)
- Speech related metadata The transcript_asr field is generated from the YT caption's SPEECH_RECOGNIZER asset. -
lmsPreviewFramePerdocs
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs
, default:nil
)
- LMS preview frame perdocs. Timestamps of the frame perdocs are from the original video, not from the preview. -
signalsBlob
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob
, default:nil
)
- Amarna signals blob that contains large-size signals like VCA frame-level signals. -
s3LanguageIdentification
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals
, default:nil
)
- -
frameLevelStarburstEmbeddings
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings
, default:nil
)
- Frame-level Starburst embeddings. They are IE only signals for short videos initially and will be supported for all videos later. (go/frame-level-sbv5-on-ie) -
golden7SoapboxTracksBlobInfo
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo
, default:nil
)
- Information on frame-level people feature blob. (go/vpf-frame-features) -
videoStreamInfo
(type:GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData
, default:nil
)
- Deprecated, please use media_info. -
thumbnailerData
(type:GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData
, default:nil
)
- -
transcodeMetadata
(type:list(GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata)
, default:nil
)
- Metadata about each transcode requested. -
truncationInfo
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo
, default:nil
)
- Data about whether or not the video was truncated. -
speechProperties
(type:GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto
, default:nil
)
- -
mediaInfo
(type:GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo
, default:nil
)
- Information about the media file, such as duration, resolution, and detail about each audio/video stream. Note that it contains no PII. -
venomId
(type:String.t
, default:nil
)
- The video id in the venom pipeline for STAMP purposes. DEPRECATED: Use transcode_metadata or venom_processing_info instead, which includes the ID and contains information for all clients. -
s3Asr
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals
, default:nil
)
- Trnascript generated through AMARNA_CLOUD_SPEECH asset in Venom. Note that AMARNA_CLOUD_SPEECH uses S3 as the speech engine backend, similar to YT caption's SPEECH_RECOGNIZER asset. However, they may use different S3 models. -
venomProcessingInfo
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo
, default:nil
)
- Information about the video's status in Venom, including IDs and processing times. -
safesearchVideoContentSignals
(type:GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals
, default:nil
)
- Contains SafeSearch video classification outputs which are vertical_name/float pairs. -
videoPornScore
(type:number()
, default:nil
)
- The video porn confidence score extracted from Whisper featureSet: "video_labels:whisper_v3", with CR2 label: "/cr2/1". -
thumbnailQualityScore
(type:GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore
, default:nil
)
- Thumbnail quality score predict how visual pleasing a thumbnail is, based on the model trained with deep neural networks.(go/thumb_features_dd) Note the signal currently only available for Youtube videos. -
languageIdentification
(type:GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults
, default:nil
)
- -
representativeFrameData
(type:GoogleApi.ContentWarehouse.V1.Model.ImageData
, default:nil
)
- -
videoDurationSec
(type:float()
, default:nil
)
- Set from the video header if truncated, or is the verified length if completely crawled. -
inlinePlayback
(type:GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata
, default:nil
)
- Metadata related to Inline playback on the Interest Feed. This field is filled by Hamilton. -
signalsBlobInfo
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo
, default:nil
)
- Information for the amarna signals blob. -
audioOnly
(type:boolean()
, default:nil
)
- Both audio- and audio-video-files are treated as videos during indexing (whether they share a container format, like .mp4, or not, like .mp3). This bool indicates that there's no video track, just an audio track. -
golden7SoapboxSummary
(type:GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData
, default:nil
)
- Golden7 video-level people features. (go/ypf-video-features) -
videoAnchorSet
(type:GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets
, default:nil
)
- Video anchor sets hold set of anchors with multiple anchor types and sequence of VideoAnchor which contains metadata about the anchor, such as thumbnail, perdoc data. -
amarnaDocid
(type:String.t
, default:nil
)
- A hash of the video bytes used as a key to Amarna's video_metadata table. -
multiThumbnailsFramePerdocs
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs
, default:nil
)
- multi_thumbnails_frame_perdocs contains perdocs(go/vss-signals#perdoc) for all frame thumbnails generated by multiple frames per minutes. See more details in go/multiple-thumbnails-per-minutes. -
videoPreviews
(type:list(GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata)
, default:nil
)
- video_previews contain the preview metadata but no bytes. It exits for IE and non-IE cases. -
legosAnnotationData
(type:GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets
, default:nil
)
- Legos results -
youtubeProcessingFilter
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter
, default:nil
)
- Contains lists of reasons why YT videos were filtered from specific processing. -
unwantedContent
(type:GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent
, default:nil
)
- If set, video has been deleted using the deletion service (MediaDeletionService). -
searchDocid
(type:String.t
, default:nil
)
- 64 bit docid used for retrieving video previews. -
videoTranscriptAnnotations
(type:GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations
, default:nil
)
- VideoTranscriptAnnotations holds sentence segmented text and timing information to be used for VideoAnswers (go/video-answers). Note that only punctuated_transcript, timing_info, and lang field are filled, and other fields will be filled in the later stage.
Type
@type t() :: %GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata{
amarnaDocid: String.t() | nil,
aresClassificationRequestTimestamp: DateTime.t() | nil,
audioOnly: boolean() | nil,
cloudSpeechSignals: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil,
featureSetData: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil,
frameLevelStarburstEmbeddings: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings.t() | nil,
golden7SoapboxSummary: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil,
golden7SoapboxTracksBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil,
inlinePlayback: GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata.t() | nil,
languageIdentification: GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults.t() | nil,
legosAnnotationData: GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets.t() | nil,
lmsPreviewFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil,
loudnessData: GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData.t() | nil,
mediaInfo: GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo.t() | nil,
multiThumbnailsFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil,
representativeFrameData: GoogleApi.ContentWarehouse.V1.Model.ImageData.t() | nil,
s3Asr: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil,
s3LanguageIdentification: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals.t() | nil,
safesearchVideoContentSignals: GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals.t() | nil,
searchDocid: String.t() | nil,
signalsBlob: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob.t() | nil,
signalsBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil,
speechProperties: GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto.t() | nil,
thumbnailQualityScore: GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore.t() | nil,
thumbnailerData: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData.t() | nil,
transcodeMetadata: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata.t() ] | nil,
transcriptAsr: GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData.t() | nil,
truncationInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo.t() | nil,
unwantedContent: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent.t() | nil,
venomId: String.t() | nil,
venomProcessingInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo.t() | nil,
videoAnchorSet: GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets.t() | nil,
videoDurationSec: float() | nil,
videoPornScore: number() | nil,
videoPornScoreV4: number() | nil,
videoPreviewBytes: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview.t() ] | nil,
videoPreviews: [GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata.t()] | nil,
videoStreamInfo: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData.t() | nil,
videoTranscriptAnnotations: GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations.t() | nil,
youtubeProcessingFilter: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter.t() | nil
}
amarnaDocid: String.t() | nil,
aresClassificationRequestTimestamp: DateTime.t() | nil,
audioOnly: boolean() | nil,
cloudSpeechSignals: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil,
featureSetData: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil,
frameLevelStarburstEmbeddings: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFrameLevelStarburstEmbeddings.t() | nil,
golden7SoapboxSummary: GoogleApi.ContentWarehouse.V1.Model.DrishtiFeatureSetData.t() | nil,
golden7SoapboxTracksBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil,
inlinePlayback: GoogleApi.ContentWarehouse.V1.Model.VideoCrawlVideoInlinePlaybackMetadata.t() | nil,
languageIdentification: GoogleApi.ContentWarehouse.V1.Model.VideoTimedtextS4ALIResults.t() | nil,
legosAnnotationData: GoogleApi.ContentWarehouse.V1.Model.VideoLegosLegosAnnotationsSets.t() | nil,
lmsPreviewFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil,
loudnessData: GoogleApi.ContentWarehouse.V1.Model.VideoStorageLoudnessData.t() | nil,
mediaInfo: GoogleApi.ContentWarehouse.V1.Model.VideoMediaInfo.t() | nil,
multiThumbnailsFramePerdocs: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFramePerdocs.t() | nil,
representativeFrameData: GoogleApi.ContentWarehouse.V1.Model.ImageData.t() | nil,
s3Asr: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaCloudSpeechSignals.t() | nil,
s3LanguageIdentification: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryS3LangIdSignals.t() | nil,
safesearchVideoContentSignals: GoogleApi.ContentWarehouse.V1.Model.SafesearchVideoContentSignals.t() | nil,
searchDocid: String.t() | nil,
signalsBlob: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlob.t() | nil,
signalsBlobInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryAmarnaSignalsBlobInfo.t() | nil,
speechProperties: GoogleApi.ContentWarehouse.V1.Model.IndexingSpeechSpeechPropertiesProto.t() | nil,
thumbnailQualityScore: GoogleApi.ContentWarehouse.V1.Model.VideoThumbnailsThumbnailScore.t() | nil,
thumbnailerData: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperThumbnailerColumnData.t() | nil,
transcodeMetadata: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryApiItagSpecificMetadata.t() ] | nil,
transcriptAsr: GoogleApi.ContentWarehouse.V1.Model.PseudoVideoData.t() | nil,
truncationInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryFileTruncationInfo.t() | nil,
unwantedContent: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryUnwantedContent.t() | nil,
venomId: String.t() | nil,
venomProcessingInfo: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVenomProcessingInfo.t() | nil,
videoAnchorSet: GoogleApi.ContentWarehouse.V1.Model.VideoContentSearchVideoAnchorSets.t() | nil,
videoDurationSec: float() | nil,
videoPornScore: number() | nil,
videoPornScoreV4: number() | nil,
videoPreviewBytes: [ GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryVideoPreviewsVideoPreview.t() ] | nil,
videoPreviews: [GoogleApi.ContentWarehouse.V1.Model.ImageBaseVideoPreviewMetadata.t()] | nil,
videoStreamInfo: GoogleApi.ContentWarehouse.V1.Model.VideoPipelineViperVSIColumnData.t() | nil,
videoTranscriptAnnotations: GoogleApi.ContentWarehouse.V1.Model.QualityWebanswersVideoTranscriptAnnotations.t() | nil,
youtubeProcessingFilter: GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryYoutubeProcessingFilter.t() | nil
}
Function
@spec decode(struct(), keyword()) :: struct()Data sourced from HexDocs : GoogleApi.ContentWarehouse.V1.Model.ImageRepositoryContentBasedVideoMetadata