Commit graph

581 commits

Author SHA1 Message Date
kempersc
ca3ce0bd11 align datamap targetSlot values with formal schema slot module names
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m36s
2026-02-11 14:28:51 +01:00
kempersc
ea5beabb61 Update manifest.json timestamp, enhance LinkML interfaces with structured aliases and multilingual metadata, and improve CSS for aliases and translations sections 2026-02-11 13:57:50 +01:00
kempersc
0e157cf1e0 Update generated timestamp in manifest.json
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m36s
2026-02-11 12:27:23 +01:00
kempersc
ce103100d4 Refactor code structure and optimize performance across multiple modules
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m7s
2026-02-11 12:22:00 +01:00
kempersc
820d3969bb Refactor code structure for improved readability and maintainability 2026-02-11 12:11:59 +01:00
kempersc
d3a65a496c Refactor slot names and descriptions across multiple YAML files for consistency and clarity
- Updated slot names to improve semantic clarity:
  - `has_type` changed to `categorized_as`
  - `has_location` changed to `located_at`
  - `coordinates` changed to `has_coordinates`
  - `country` changed to `in_country`
  - `like_count` changed to `has_quantity`

- Adjusted descriptions and annotations for slots to enhance understanding and alignment with ontology standards.

- Modified imports in `WomensArchives.yaml` and `WomensArchivesRecordSetTypes.yaml` to reflect new slot names.

- Enhanced multilingual support in `has_record_set` slot definition with additional translations and structured aliases.

- General cleanup and standardization of slot definitions across various classes including `Wikidata`, `Youtube`, and `WorkExperience`.
2026-02-11 11:54:34 +01:00
kempersc
e5fc1a3fb4 Add new slot definitions for preparation and preservation processes
- Introduced `prepared_by` slot to identify the individual or organization responsible for preparing an item, specimen, or document, with ontology alignment to CIDOC-CRM, PROV-O, Schema.org, and FOAF.
- Added `prepared_on` slot to capture the date when a sample or document was prepared, including mappings to DC Terms and Schema.org.
- Created `preserve` slot to define actions related to maintaining and protecting entities from harm or decay, with references to CIDOC-CRM and other ontologies.
- Implemented `provide` slot to document the act of supplying resources or services, with related mappings to Schema.org and PROV-O.
- Established `provide_to` slot to identify recipients of services or resources, with ontology alignment to Schema.org and CIDOC-CRM.
- Added `receive` slot to capture the act of accepting delivery of objects or services.
- Introduced `recommend` slot for suggesting courses of action or services.
- Created `started_on` slot to record the initiation date of activities or processes, with mappings to PROV and Schema.org.
2026-02-11 11:20:12 +01:00
kempersc
b905b6bbb0 Add new slot definitions for refer_to, remove, reported_on, signed_by, and specified_as
- Introduced `refer_to` slot to link identifiers to entities, with ontology alignment to CIDOC-CRM and DCTerms.
- Added `remove` slot for recording objects removed during deaccessioning, aligned with CIDOC-CRM properties.
- Created `reported_on` slot to capture URIs of reports documenting entities, with mappings to CIDOC-CRM and Schema.org.
- Implemented `signed_by` slot to identify individuals who signed documents, referencing RiC-O and Schema.org.
- Established `specified_as` slot to indicate the precision level of place references, with broad mappings to CRM and DQV.
2026-02-10 23:34:46 +01:00
kempersc
8a078a1e88 Add new slot definitions for 'recur_at', 'registered_at', 'return', 'track', 'transmission', and 'use_material'
- Introduced 'recur_at' to specify time intervals, frequencies, or spatial locations of repeated occurrences, with ontology alignments to Schema.org and DCTerms.
- Added 'registered_at' to denote the timestamp of record registration, aligning with Schema.org and DCTerms properties.
- Created 'return' to signify the action of sending items back to their origin, with mappings to Schema.org and CIDOC-CRM.
- Defined 'track' to indicate the maintenance of object identity across frames or time intervals, with relevant mappings to SOSA.
- Established 'transmission' to describe the process of passing knowledge or skills, aligning with CIDOC-CRM and Schema.org.
- Implemented 'use_material' to specify substances or materials used in creating or modifying objects, with close mappings to CIDOC-CRM and Schema.org.
2026-02-10 13:54:48 +01:00
kempersc
07a3d47f3e Add new slot definitions for has_numerator, has_reference_system, has_selector, in_country, integrate, supported_by, and used_for
- Created `has_numerator` to represent the numerator in ratios, rates, or percentages, including ontology alignment with Schema.org and DQV.
- Introduced `has_reference_system` for specifying the Coordinate Reference System (CRS) for spatial datasets, with mappings to RiC-O and DCTerms.
- Added `has_selector` to define CSS selectors or XPath patterns for webpage elements, aligning with OA and Schema.org properties.
- Defined `in_country` to relate entities to their sovereign state or territory, with close mappings to Schema.org and GeoNames.
- Established `integrate` to describe organizational placement and integration of heritage entities, capturing ownership, reporting, and governance aspects.
- Created `supported_by` to identify entities providing assistance or funding, with mappings to Schema.org and DCTerms.
- Introduced `used_for` to relate objects or resources to their intended purpose or function, aligning with CIDOC-CRM properties.
2026-02-09 16:22:24 +01:00
kempersc
86a627fcb7 Update schemas and mappings in LinkML files
- Updated the generated timestamp in manifest.json.
- Modified imports in AccessPolicy.yaml, Activity.yaml, ApplicantRequirement.yaml, ConfidenceMeasure.yaml, ConnectionNetwork.yaml, ConnectionSourceMetadata.yaml, CurrentArchiveRecordSetType.yaml, CustodianArchiveRecordSetType.yaml, CustodianLegalNameClaim.yaml, CustodianNameConsensus.yaml, DarkArchiveRecordSetType.yaml, DepositArchiveRecordSetType.yaml, DigitalArchiveRecordSetType.yaml, DigitalPlatform.yaml, DimArchivesRecordSetType.yaml, DiocesanArchiveRecordSetType.yaml, Expenses.yaml, FindingAid.yaml, Label.yaml, PaymentMethod.yaml, PersonalCollectionType.yaml, Policy.yaml, Provenance.yaml, ProvenanceBlock.yaml, StorageConditionPolicy.yaml, TaxScheme.yaml, TransferPolicy.yaml, UnspecifiedType.yaml, WebPortal.yaml to reflect new slot names and remove deprecated ones.
- Enhanced ontology alignment in analyze.yaml, categorized_as.yaml, collect.yaml, has_activity.yaml, has_annotation.yaml, has_name.yaml, has_note.yaml, has_subject.yaml, has_title.yaml, and identified_by.yaml with additional mappings and clarifications.
2026-02-09 09:20:55 +01:00
kempersc
69a22e2b5a Refactor and expand LinkML slot definitions
- Deleted the `rights_statement_url` slot definition as it is no longer needed.
- Added multiple new slots including `has_legal_basis`, `has_statement`, `impose`, `pose_condition`, and `reviewed_through` with detailed descriptions and ontology alignments.
- Updated existing slots to improve clarity and consistency, including renaming `close_mappings` to `related_mappings` in several definitions.
- Enhanced the `require` slot with additional aliases for better usability.
- Improved documentation and comments across all slot definitions to clarify their purpose and usage.
2026-02-08 23:37:44 +01:00
kempersc
8f77f62585 update slot imports in classes 2026-02-08 19:22:13 +01:00
kempersc
ecfddcd239 Refactor and consolidate slot definitions in the LinkML schema
- Deleted obsolete slot definitions: supersedes_or_superseded, takes_or_took_comission, takes_or_took_place_at, transmits_or_transmitted_through, uses_or_used, uses_or_used_technique, was_acquired_through.
- Introduced new slot definitions: state, store, supersede, take_comission, take_place_at, transmit_through, use.
- Updated descriptions, annotations, and mappings for clarity and alignment with ontology standards.
- Ensured compliance with naming conventions and broadened ranges where necessary to enhance usability and flexibility.
2026-02-08 17:18:29 +01:00
kempersc
b076018495 Add new LinkML slot definitions for approximate, has_basionym, has_position, hold, identified_as, initiate_on, is_location_of, ranked_through, and warrant
- Created `approximate.yaml` to define the slot for estimated values.
- Introduced `has_basionym.yaml` for the original validly published name in taxonomy.
- Added `has_position.yaml` to specify roles or titles within organizations.
- Defined `hold.yaml` to indicate items or collections held by heritage institutions.
- Created `identified_as.yaml` for external classifications assigned to entities.
- Introduced `initiate_on.yaml` to denote the start date or condition of processes.
- Added `is_location_of.yaml` to specify geographic positions of entities or events.
- Defined `ranked_through.yaml` to describe mechanisms for determining relative positions.
- Created `warrant.yaml` to provide justifiable reasons for actions or beliefs.
2026-02-08 16:20:09 +01:00
kempersc
db923769f6 Update LinkML slot definitions with multilingual support, ontology alignment, and improved descriptions 2026-02-08 14:00:57 +01:00
kempersc
cc57a9297d Add new LinkML slot definitions for various attributes
- Introduced `has_extent` to specify the physical or digital size of materials.
- Added `has_fonds` to define the aggregated body of records from a specific creator.
- Created `has_period` for named periods within coverage.
- Defined `has_place` to associate a geographic location with an entity.
- Implemented `has_series` for archival series within fonds.
- Added `has_index_number` to specify index numbers associated with records.
- Introduced `measured_through` to specify instruments or methods used for measurements.
- Created `has_organizer` to identify agents or organizations that organized events.
- Defined `has_origin` to specify the origin or source of an entity.
- Implemented `has_publication_date` for the date when an entity was published.
- Added `has_michelin_star` to indicate whether a restaurant has Michelin stars.
- Created `has_investment` to specify investment amounts associated with entities.
- Introduced `require` to specify necessary conditions for entities.
- Defined `has_restriction` for restrictions or limitations on entities.
2026-02-08 13:55:52 +01:00
kempersc
90842851c2 Add slot definitions for 'updated_at' and 'written_in' with multilingual support and ontology alignment
- Created 'updated_at.yaml' to record the last modified date and time of entities, including multilingual descriptions and structured aliases.
- Created 'written_in.yaml' to specify the language in which content is composed, covering both natural and programming languages, with detailed comments and close ontology mappings.
2026-02-07 11:22:05 +01:00
kempersc
74ded96b84 Update LinkML schemas with revised descriptions, added multilingual support, and removed deprecated slots
- Updated `manifest.json` with new generation timestamp.
- Revised descriptions for `has_administration`, `has_affiliation`, `has_alignment`, and `has_fee` slots to enhance clarity and precision.
- Removed obsolete slots: `has_administration_description`, `has_administration_name`, `has_admission_fee`, `has_affected_territory`, and `has_alternative_observed_name`.
- Introduced new slot `has_alias` to capture alternative names for entities.
- Added `amended_with` slot to document amendment history with detailed descriptions.
- Ensured all slots have multilingual support for better accessibility.
2026-02-04 12:26:59 +01:00
kempersc
e0326878a2 fix: add missing literal_form key in structured_aliases for 37 slot files
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m9s
2026-02-04 01:03:57 +01:00
kempersc
5178b24f99 fix: update manifest to only include slots from 20260202_matang directory
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m20s
2026-02-04 00:59:38 +01:00
kempersc
6435786556 edit slots 2026-02-04 00:24:46 +01:00
kempersc
1f7f3c6a4d Refactor ontology schema: Remove obsolete slot 'analyzes_or_analyzed', add new slots for 'accept', 'affect', 'aggregate_from', 'allocate', 'allow', and 'analyze'; introduce AttestationConfidenceEnum for lexical attestations; migrate annotations to structured slots; enhance documentation for clarity and usability.
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m40s
2026-02-02 17:28:22 +01:00
kempersc
e6b15c27b3 Update generated timestamp in manifest.json for accuracy 2026-02-02 15:57:43 +01:00
kempersc
a83f04d9c4 Refactor code structure for improved readability and maintainability 2026-02-02 15:57:17 +01:00
kempersc
fc405445c6 Refactor and update schema definitions
- Removed obsolete slots: `has_or_had_custodian_observation`, `provider`, and `specificity_annotation`.
- Updated `has_or_had_score` slot to use `SpecificityScore` class and modified its description and examples.
- Added new slots: `end_seconds`, `end_time`, `has_archive_path`, `has_or_had_custodian_name`, `protocol_name`, and `protocol_version`.
- Introduced a script `check_annotation_types.py` to validate the presence and structure of `custodian_types` in YAML files.
- Added a script `update_specificity.py` to automate updates related to `SpecificityAnnotation` to `SpecificityScore`.
2026-02-01 19:55:38 +01:00
kempersc
01e382b53b Update generated timestamp in manifest.json for accuracy 2026-02-01 02:04:00 +01:00
kempersc
41481f6b21 Implement feature X to enhance user experience and fix bug Y in module Z 2026-01-31 23:55:48 +01:00
kempersc
7e0622c755 chore: clean up code structure and remove redundant changes 2026-01-31 21:24:53 +01:00
kempersc
88b325fcdd Refactor YAML schemas to enhance clarity and consistency, adding new slots for authors, fields, and language codes. 2026-01-31 20:27:06 +01:00
kempersc
cb1f9104b6 Update manifest.json timestamp for accuracy 2026-01-31 20:07:24 +01:00
kempersc
787ff6a8d8 Update manifest.json timestamp and refactor YAML schemas for improved clarity and consistency 2026-01-31 18:14:51 +01:00
kempersc
532ee80634 Update manifest.json timestamp and refactor YAML schemas for improved clarity and functionality 2026-01-31 12:29:53 +01:00
kempersc
eb4eac24ce Update manifest.json timestamp and refactor YAML schemas for improved clarity and consistency 2026-01-31 01:23:46 +01:00
kempersc
c567a03833 Update manifest.json timestamp and enhance YAML schemas with new slots for improved clarity and functionality 2026-01-31 01:03:56 +01:00
kempersc
4effcb73b9 Update manifest.json timestamp and refactor YAML schemas for clarity and consistency 2026-01-31 00:59:56 +01:00
kempersc
ca4a54181e Refactor schema files to improve clarity and maintainability
- Updated WorldCatIdentifier.yaml to remove unnecessary description and ensure consistent formatting.
- Enhanced WorldHeritageSite.yaml by breaking long description into multiple lines for better readability and removed unused attributes.
- Simplified WritingSystem.yaml by removing redundant attributes and ensuring consistent formatting.
- Cleaned up XPathScore.yaml by removing unnecessary attributes and ensuring consistent formatting.
- Improved YoutubeChannel.yaml by breaking long description into multiple lines for better readability.
- Enhanced YoutubeEnrichment.yaml by breaking long description into multiple lines for better readability.
- Updated YoutubeVideo.yaml to break long description into multiple lines and removed legacy field name.
- Refined has_or_had_affiliation.yaml by removing unnecessary comments and ensuring clarity.
- Cleaned up is_or_was_retrieved_at.yaml by removing unnecessary comments and ensuring clarity.
- Added rules for generic slots and avoiding rough edits in schema files to maintain structural integrity.
- Introduced changes_or_changed_through.yaml to define a new slot for linking entities to change events.
2026-01-31 00:46:23 +01:00
kempersc
4034c2a00a Refactor schema slots across multiple classes to improve consistency and clarity
- Removed unused slots from TaxonomicAuthority, TechnicalFeature, TelevisionArchive, TentativeWorldHeritageSite, Threat, TimeSpan, Title, TradeRegister, TradeUnionArchive, TradeUnionArchiveRecordSetType, TransferEvent, UNESCODomain, UnitIdentifier, UniversityArchive, UnspecifiedType, UserCommunity, Venue, Vereinsarchiv, Verlagsarchiv, VerlagsarchivRecordSetType, Version, Verwaltungsarchiv, VideoAnnotationTypes, VideoAudioAnnotation, VideoFrame, VideoPost, VideoSubtitle, VideoTextContent, Warehouse, WebArchive, WebClaim, WebClaimsBlock, WebLink, WebPortal, WebPortalTypes, WomensArchives, WordCount, WorldHeritageSite, WritingSystem, and XPathScore.
- Introduced new slot is_or_was_retrieved_at for tracking data retrieval timestamps.
2026-01-31 00:28:09 +01:00
kempersc
56a7001e45 Update manifest.json timestamp and refactor descriptions in YAML schema files for clarity 2026-01-31 00:22:16 +01:00
kempersc
6203d19875 Refactor YAML schemas for clarity and consistency
- Removed unnecessary line breaks and whitespace in descriptions across multiple classes including Taxon, TaxonomicAuthority, TechnicalFeature, TradeRegister, TransferEvent, UNESCODomain, UnspecifiedType, UserCommunity, Version, VideoAnnotationTypes, VideoFrame, VideoTextContent, WebArchive, WebClaimsBlock, WebLink, WebPortal, and WordCount.
- Updated descriptions to enhance readability and maintain a uniform style.
- Migrated attributes and slots as per the latest schema rules, ensuring alignment with the defined standards.
- Improved documentation for better understanding of class purposes and usage scenarios.
2026-01-31 00:21:50 +01:00
kempersc
0c5211e40a removed convenience slots 2026-01-31 00:15:53 +01:00
kempersc
14375c583e added hidden slots 2026-01-30 23:56:19 +01:00
kempersc
1b76a3cfe4 Update manifest.json timestamp and add new slots for geographic scope and digital access 2026-01-30 00:50:06 +01:00
kempersc
9bd71f20c8 Update manifest.json timestamp and refactor range definitions in YAML schema files 2026-01-30 00:32:36 +01:00
kempersc
f7bf1cc5ae Refactor schema slots and classes
- Deleted obsolete slot definitions: statement_summary, statement_text, statement_type, status_name, supersede_articles, supersede_condition, supersede_name, temporal_dynamics, total_amount, typical_contents, use_cases, was_acquired_through, was_fetched_at, was_retrieved_at.
- Updated existing slot definitions for states_or_stated to enhance clarity and structure.
- Introduced new classes: Article, ConditionofAccess, FinancialStatementType, MaximumQuantity, Series, Summary, Type, and their respective slots to improve schema organization and usability.
- Added new slots: changes_or_changed_through, has_or_had_condition_of_access, has_or_had_heritage_type, is_or_was_part_of_series, is_or_was_retrieved_at, maximum_of_maximum to capture additional metadata and relationships.
2026-01-30 00:29:31 +01:00
kempersc
2f44857028 Refactor LinkML schemas and slots for consistency and clarity
- Updated imports in FindingAid.yaml to remove unnecessary entries and added new slots for arrangement level and provenance path.
- Replaced 'full_name' with 'has_or_had_label' in LegalName.yaml and ProfileData.yaml for uniformity.
- Enhanced slot definitions in various YAML files, including ceases_or_ceased_through, has_or_had_arrangement_level, has_or_had_assessment, and others, to include metadata and improve structure.
- Removed the script fix_linkml_metadata.py as it is no longer needed.
- Added new script fix_specific_dead_links.py to handle specific mapping updates for extraction metadata and full name fields across multiple YAML files.
2026-01-29 18:17:47 +01:00
kempersc
fcb704c97e Update generated timestamp in manifest.json
All checks were successful
Deploy Frontend / build-and-deploy (push) Successful in 2m18s
DSPy RAG Evaluation / Layer 1 - Unit Tests (push) Successful in 5m16s
DSPy RAG Evaluation / Layer 2 - DSPy Module Tests (push) Successful in 7m6s
DSPy RAG Evaluation / Layer 3 - Integration Tests (push) Successful in 5m21s
DSPy RAG Evaluation / Layer 4 - Comprehensive Evaluation (push) Successful in 6m28s
DSPy RAG Evaluation / Quality Gate (push) Successful in 1s
2026-01-29 17:55:50 +01:00
kempersc
1516d509cf Add metadata to LinkML class definitions and update prefixes
- Added `id`, `name`, `title`, and `description` fields to multiple LinkML class YAML files.
- Standardized prefixes across all class definitions.
- Introduced a new script `fix_linkml_metadata.py` to automate the addition of metadata to class files.
- Updated existing class files to ensure compliance with the new metadata structure.
2026-01-29 17:40:47 +01:00
kempersc
7cf10084b4 Implement scripts for schema modifications and ontology verification
- Added `fix_dual_class_link.py` to remove dual class link references from specified YAML files.
- Created `fix_specific_ghosts.py` to apply specific replacements in YAML files based on defined mappings.
- Introduced `migrate_staff_count.py` to migrate staff count references to a new structure in specified YAML files.
- Developed `migrate_type_slots.py` to replace type-related slots with new identifiers across YAML files.
- Implemented `scan_ghost_references.py` to identify and report ghost references to archived slots and classes in YAML files.
- Added `verify_ontology_terms.py` to verify the presence of ontology terms in specified ontology files against schema definitions.
2026-01-29 17:10:25 +01:00
kempersc
2a349b11bb Update generated timestamp in manifest.json 2026-01-29 13:33:56 +01:00