id: https://nde.nl/ontology/hc/class/VideoTextContent name: video_text_content_class title: Video Text Content Class imports: - linkml:types - ./VideoPost - ../slots/character_count - ../slots/content_language - ../slots/content_title - ../slots/generated_by - ../slots/generation_method - ../slots/generation_timestamp - ../slots/is_verified - ../slots/model_provider - ../slots/model_version - ../slots/overall_confidence - ../slots/processing_duration_seconds - ../slots/source_video - ../slots/source_video_url - ../slots/specificity_annotation - ../slots/template_specificity - ../slots/verification_date - ../slots/verified_by - ../slots/word_count - ./SpecificityAnnotation - ./TemplateSpecificityScores prefixes: linkml: https://w3id.org/linkml/ hc: https://nde.nl/ontology/hc/ schema: http://schema.org/ dcterms: http://purl.org/dc/terms/ prov: http://www.w3.org/ns/prov# crm: http://www.cidoc-crm.org/cidoc-crm/ skos: http://www.w3.org/2004/02/skos/core# oa: http://www.w3.org/ns/oa# default_prefix: hc classes: VideoTextContent: class_uri: crm:E73_Information_Object abstract: true description: "Abstract base class for all textual/derived content from videos.\n\n**DEFINITION**:\n\nVideoTextContent\ \ is the abstract parent for all text that is extracted,\ntranscribed, or derived from video content. This includes:\n\ \n| Subclass | Source | Description |\n|----------|--------|-------------|\n| VideoTranscript | Audio | Full text transcription\ \ of spoken content |\n| VideoSubtitle | Audio | Time-coded caption entries (SRT/VTT) |\n| VideoAnnotation | Visual\ \ | CV/multimodal-derived descriptions |\n\n**PROVENANCE REQUIREMENTS**:\n\nAll video-derived text MUST include comprehensive\ \ provenance:\n\n1. **Source**: Which video was processed (`source_video`)\n2. **Method**: How was content generated\ \ (`generation_method`)\n3. **Agent**: Who/what generated it (`generated_by`)\n4. **Time**: When was it generated (`generation_timestamp`)\n\ 5. **Version**: Tool/model version (`model_version`)\n6. **Quality**: Overall confidence (`overall_confidence`)\n\n\ **PROV-O ALIGNMENT**:\n\nMaps to W3C PROV-O for provenance tracking:\n\n```turtle\n:transcript a hc:VideoTranscript\ \ ;\n prov:wasGeneratedBy :asr_activity ;\n prov:wasAttributedTo :whisper_model ;\n prov:generatedAtTime \"\ 2025-12-01T10:00:00Z\" ;\n prov:wasDerivedFrom :source_video .\n```\n\n**CIDOC-CRM E73_Information_Object**:\n\n\ - E73 is the base for all identifiable immaterial items\n- Includes texts, computer programs, songs, recipes\n- VideoTextContent\ \ are E73 instances derived from video (E73)\n\n**GENERATION METHODS**:\n\n| Method | Description | Typical Confidence\ \ |\n|--------|-------------|-------------------|\n| ASR_AUTOMATIC | Automatic speech recognition | 0.75-0.95 |\n| ASR_ENHANCED\ \ | ASR with post-processing | 0.85-0.98 |\n| MANUAL_TRANSCRIPTION | Human transcription | 0.98-1.0 |\n| MANUAL_CORRECTION\ \ | Human-corrected ASR | 0.95-1.0 |\n| CV_AUTOMATIC | Computer vision detection | 0.60-0.90 |\n| MULTIMODAL | Combined\ \ audio+visual AI | 0.70-0.95 |\n| OCR | Optical character recognition | 0.80-0.98 |\n| PLATFORM_PROVIDED | From YouTube/Vimeo\ \ API | 0.85-0.95 |\n\n**HERITAGE INSTITUTION CONTEXT**:\n\nVideo text content is critical for:\n- **Accessibility**:\ \ Deaf/HoH users need accurate captions\n- **Discovery**: Full-text search over video collections\n- **Preservation**:\ \ Text outlasts video format obsolescence\n- **Research**: Analyzing spoken content at scale\n- **Translation**: Multilingual\ \ access to heritage content\n\n**LANGUAGE SUPPORT**:\n\n- `content_language`: Primary language of text content\n- May\ \ differ from video's default_audio_language if translated\n- ISO 639-1 codes (e.g., \"nl\", \"en\", \"de\")\n" exact_mappings: - crm:E73_Information_Object close_mappings: - prov:Entity related_mappings: - schema:CreativeWork - dcterms:Text slots: - character_count - content_language - content_title - generated_by - generation_method - generation_timestamp - is_verified - model_provider - model_version - overall_confidence - processing_duration_seconds - source_video - source_video_url - specificity_annotation - template_specificity - verification_date - verified_by - word_count slot_usage: source_video: slot_uri: prov:wasDerivedFrom description: 'Reference to the VideoPost from which this content was derived. PROV-O: wasDerivedFrom links derived content to source. Links to the video''s unique identifier (post_id). ' range: string required: true examples: - value: FbIoC-Owy-M description: YouTube video ID as source reference source_video_url: slot_uri: schema:url description: 'URL of the source video. Convenience field for direct video access. Derived from source_video but stored for quick reference. ' range: uri required: false examples: - value: https://www.youtube.com/watch?v=FbIoC-Owy-M description: Full YouTube video URL content_language: slot_uri: dcterms:language description: 'Primary language of the text content. Dublin Core: language for content language. ISO 639-1 code. May differ from video''s audio language if this is a translation or localization. ' range: string required: true examples: - value: nl description: Dutch language content - value: en description: English translation content_title: slot_uri: dcterms:title description: 'Title or label for this text content. Dublin Core: title for content name. Examples: - "Rijksmuseum Tour - Full Transcript" - "Dutch Subtitles - Auto-generated" - "Scene Annotations - CV Model v2.1" ' range: string required: false examples: - value: De Vrijheidsroute Ep.3 - Dutch Transcript description: Descriptive title for transcript generated_by: slot_uri: prov:wasAttributedTo description: 'The agent (model, service, person) that generated this content. PROV-O: wasAttributedTo identifies the responsible agent. **Examples**: - AI Models: "openai/whisper-large-v3", "google/speech-to-text" - Services: "YouTube Auto-captions", "Rev.com" - Human: "transcriber:jane.doe@museum.nl" ' range: string required: true examples: - value: openai/whisper-large-v3 description: OpenAI Whisper ASR model - value: YouTube Auto-captions description: Platform-provided captions - value: manual:curator@rijksmuseum.nl description: Human transcriber generation_method: slot_uri: prov:wasGeneratedBy description: 'The method used to generate this content. PROV-O: wasGeneratedBy for generation activity type. See GenerationMethodEnum for standardized values. ' range: GenerationMethodEnum required: true examples: - value: ASR_AUTOMATIC description: Automatic speech recognition - value: MANUAL_TRANSCRIPTION description: Human transcription generation_timestamp: slot_uri: prov:generatedAtTime description: 'When this content was generated. PROV-O: generatedAtTime for creation timestamp. ISO 8601 datetime. Critical for versioning and reproducibility. ' range: datetime required: true examples: - value: '2025-12-01T10:30:00Z' description: Generated December 1, 2025 at 10:30 UTC model_version: slot_uri: schema:softwareVersion description: 'Version of the model or tool used for generation. Schema.org: softwareVersion for version tracking. Critical for reproducibility and quality assessment. ' range: string required: false examples: - value: large-v3 description: Whisper model version - value: v2.3.1 description: Software version number model_provider: slot_uri: schema:provider description: 'Provider or vendor of the generation model/service. Schema.org: provider for service provider. ' range: string required: false examples: - value: OpenAI description: Model provider - value: Google Cloud description: Cloud service provider overall_confidence: slot_uri: hc:overallConfidence description: 'Overall confidence score for the generated content. Range: 0.0 (no confidence) to 1.0 (complete certainty) Aggregated from per-segment confidence scores or provided by the generation model. **Thresholds** (suggested): - > 0.9: High quality, production-ready - 0.75-0.9: Good, may have minor errors - 0.6-0.75: Usable, should be reviewed - < 0.6: Low quality, needs significant correction ' range: float required: false minimum_value: 0.0 maximum_value: 1.0 examples: - value: 0.92 description: High confidence ASR output is_verified: slot_uri: hc:isVerified description: 'Whether content has been verified by a human. - **true**: Human-reviewed and approved - **false**: Not yet verified (default for AI-generated) Critical for quality assurance in heritage contexts. ' range: boolean required: false ifabsent: 'false' examples: - value: true description: Human-verified transcript verified_by: slot_uri: prov:wasAttributedTo description: 'Identity of the person who verified the content. Only populated when is_verified = true. ' range: string required: false examples: - value: curator@rijksmuseum.nl description: Staff member who verified verification_date: slot_uri: dcterms:dateAccepted description: 'Date when content was verified. Dublin Core: dateAccepted for approval date. ' range: datetime required: false examples: - value: '2025-12-02T15:00:00Z' description: Verified December 2, 2025 processing_duration_seconds: slot_uri: hc:processingDuration description: 'Time taken to generate this content, in seconds. Useful for performance monitoring and cost estimation. ' range: float required: false minimum_value: 0.0 examples: - value: 45.3 description: Processed in 45.3 seconds word_count: slot_uri: hc:wordCount description: 'Total number of words in the text content. Useful for content sizing and analysis. ' range: integer required: false minimum_value: 0 examples: - value: 1523 description: 1,523 words in transcript character_count: slot_uri: hc:characterCount description: 'Total number of characters in the text content. Includes spaces. Useful for storage estimation. ' range: integer required: false minimum_value: 0 examples: - value: 8742 description: 8,742 characters specificity_annotation: range: SpecificityAnnotation inlined: true template_specificity: range: TemplateSpecificityScores inlined: true comments: - Abstract base for all video-derived text content - Comprehensive PROV-O provenance tracking - Confidence scoring for AI-generated content - Verification workflow support - Critical for heritage accessibility and discovery see_also: - https://www.w3.org/TR/prov-o/ - http://www.cidoc-crm.org/cidoc-crm/E73_Information_Object enums: GenerationMethodEnum: description: 'Methods for generating video-derived text content. Standardized values for provenance tracking. ' permissible_values: ASR_AUTOMATIC: description: Automatic speech recognition (raw output) ASR_ENHANCED: description: ASR with post-processing (punctuation, normalization) MANUAL_TRANSCRIPTION: description: Fully human-transcribed content MANUAL_CORRECTION: description: Human-corrected ASR output CV_AUTOMATIC: description: Computer vision detection (raw output) CV_ENHANCED: description: CV with post-processing or filtering MULTIMODAL: description: Combined audio+visual AI processing OCR: description: Optical character recognition from video frames PLATFORM_PROVIDED: description: Content from platform API (YouTube, Vimeo captions) HYBRID: description: Combination of automated and manual methods UNKNOWN: description: Generation method not recorded