Release information¶
Current release¶
Release date: 1/6/2022
ELG-SHARE schema version: v3.0.2
ELG platform feature updates¶
assignment of DOIs for ELG-hosted data and ELG-compatible services
export for MS-OWL/RDF, and, for metdata records with DOIs, to DataCite/XML and DataCite/JSON
support for upload of .tar, and .gz files
new stylesheet to match the new website
improvements on consumer’s grid (aggregation of data on “my downloads” & “my usage”
stylistic improvements on grid
stylistic improvements on view page
subfaceting of the facet “service functions”
removal of the facet “intended application”
minor bug fixes
Schema changes¶
Increase of the size of creationDetails
Changes required for XML metadata records¶
None
Release v2.1.0¶
Release date: 5/4/2022
ELG-SHARE schema version: v3.0.1
ELG platform feature updates¶
addition of tombstone page for deleted and unpublished metadata records
bulk service registration & technical validation for ELG-compatible services
action for making metadata records out of generic records through the django admin UI
move/copy technical metadata (parameters & samples) to code samples tab
adding links to previous version for metadata records added without explicit “replaces” relation
added display of version at lookup stage
minor bug fixes
Schema changes¶
None
Changes required for XML metadata records¶
None
Release v2.0.7¶
Overview¶
Release date: 14/3/2022
ELG-SHARE schema version: v3.0.1
ELG platform feature updates¶
Consumer’s grid with basic functionalities
Stylistic changes on grid layout
Updates on landing page: addition of “share”, “cite” and “counts” (of views, downloads, times used)
Addition of the glottolog code for languages and language varieties without an ISO code
Update of ISO vocabularies and removal of deprecated values
Change of the “language” facet to two subfacets
Change of the “condition of use” facet values to tick option
Additional validation rules in the import of XML files and editor (e.g., for duplicate values)
Export of inverse relations in the XML files
Enrichment of the index for free text search with synonyms for language and synonyms for service functions
Schema changes¶
Addition of inverse relations as materialized ones (for import and export purposes)
Addition of relations:
qualifiedAttribution
,isSupplementTo
,isSupplementedBy
Removal of the
distributionLocation
element
Changes required for XML metadata records¶
Replace
distributionLocation
withaccessLocation
Release v2.0.6¶
Overview¶
Release date: 18/12/2021
ELG-SHARE schema version: v3.0.0
ELG platform feature updates¶
Updates at the backend, editor and landing pages required for schema 3.0.0
Updates in validation rules required to import records marked as for information
Calculation of
lingualityType
based on the number of languages (taking into account values of collective languages)Addition of flag for computed elements
Validation rule for blocking duplicate language values
Suppressed script on
languageTag
Integration of the XML validation step in the upload procedure for metadata files
Different view pages for curators and administrators (e.g., allowing them to view hidden elements in accordance with the access rights on the metadata)
Schema changes¶
Catering for an enhanced description of models:
merged all types of models (e.g. n-gram models, ML models) into
Model
added new elements (e.g. to describe the training process)
introduced the
unspecifiedPart
which replaces the media-type specific parts for models
Catering for metadata records imported from other catalogues with poorer information or more general schemas; these changes are allowed mainly for metadata records marked as for information:
changed the optionality status for specific elements
introduced the
unspecifiedPart
which may be used as an alternative when the media type value of a resource is not encoded in the original metadataadded elements with free text values as an alternative to elements with controlled value vocabularies or combined elements that cannot be distinguished from the source metadata record (e.g. when size is encoded as a free text combining amount and size unit together)
Detailed list of changes¶
Changes specific to language descriptions
introduced the element
ldSubclass
to distinguish between grammars, models and other (uncategorized) language descriptionsmade the
LanguageDescriptionSubclass
recommended upon conditions (depending on the value ofldSubclass
)replaced the
MLModel
node withModel
; it has the same elements and the additional elements:modelFunction
(mandatory),modelType
,requiresLR
,hasOriginalSource
,trainingProcessDetails
,biasDetails
NGramModel
has been moved under theModel
nodefor models,
unspecifiedPart
replaces media-type specific parts (i.e.LanguageDescriptionTextPart
,LanguageDescriptionImagePart
andLanguageDescriptionVideoPart
)for models,
distributionUnspecifiedFeature
replaces all media-type distribution featuresthe elements
perplexity
,typesystem
andmethod
have been made optional.
Changes for all resource types
moved
compliesWith
underLanguageResource
, with optionality status ‘recommended’made
personalDataIncluded
andsensitiveDataIncluded
optional for language descriptionschanged data type for three elements:
personalDataIncluded
,sensitiveDataIncluded
andanonymized
take values from a controlled vocabularyadded elements (all optional or recommended):
packageFormat
: onDatasetDistribution
&SoftwareDistribution
mimetype
: onDistributionTextFeature
,DistributionAudioFeature
,DistributionVideoFeature
,DistributionImageFeature
,DistributionUnspecifiedFeature
additionalHWrequirements
: onlanguageDescription
spatial
: onCorpus, ``LanguageDescription
,LexicalConceptualResource
temporal
: onCorpus
,LanguageDescription
,LexicalConceptualResource
organizationShortName
: onGenericOrganization
projectShortName
: onGenericProject
added values for the following elements:
fundingType
,sourceChannelType
,originOfParticipants
,colourSpace
,accessRightsStatementScheme
andconditionOfUse
for the elements
function
andintendedApplication
removed the value http://w3id.org/meta-share/omtd-share/bPosTagging; instead, use the value http://w3id.org/meta-share/omtd-share/PosTagging
Changes specific to records marked as “for information”
unspecifiedPart
anddistributionUnspecifiedFeature
can be used as an alternative to media type specific parts and distribution features (respectively) when the media type is not known; this applies to corpora, lexical/conceptual resources and language descriptionssizeText
(free text) can be used onLanguageResource
name
can be used for persons related to resources
Changes required for XML metadata records¶
All metadata record examples and templates at https://gitlab.com/european-language-grid/platform/ELG-SHARE-schema have been updated to the most recent schema version. If you have uploaded XML files before with previous schema versions, please note that the following changes are required for any new XML files:
personalDataIncluded
,sensitiveDataIncluded
andanonymized
:change value
true
tohttp://w3id.org/meta-share/meta-share/yesP
,http://w3id.org/meta-share/meta-share/yesS
andhttp://w3id.org/meta-share/meta-share/yesA
respectivelychange value
false
tohttp://w3id.org/meta-share/meta-share/noP
,http://w3id.org/meta-share/meta-share/noS
andhttp://w3id.org/meta-share/meta-share/noA
respectively
compliesWith
: move toLanguageResource
before the elementLRSubclass
replace value
http://w3id.org/meta-share/omtd-share/bPosTagging
withhttp://w3id.org/meta-share/omtd-share/PosTagging
for models:
replace the following structure
<ms:LanguageDescription>
<ms:lrType>LanguageDescription</ms:lrType>
<ms:LanguageDescriptionSubclass>
<ms:MLModel>
<ms:ldSubclassType>MlModel</ms:ldSubclassType>
...
</ms:MLModel>
</ms:LanguageDescriptionSubclass>
with the structure presented below; i.e. add the element ldSubclass
, replace MlModel
with Model
, and add the elements modelType
and modelFunction
; if the source metadata record provides no information for these two elements, you can use the value http://w3id.org/meta-share/meta-share/unspecified
.
<ms:LanguageDescription>
<ms:lrType>LanguageDescription</ms:lrType>
<ms:ldSubclass>http://w3id.org/meta-share/meta-share/model</ms:ldSubclass>
<ms:LanguageDescriptionSubclass>
<ms:Model>
<ms:ldSubclassType>Model</ms:ldSubclassType>
<ms:modelType>...</ms:modelType>
<ms:modelFunction>...</ms:modelFunction>
...
</ms:Model>
</ms:LanguageDescriptionSubclass>
replace any of the following structures
<ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionTextPart>...</ms:LanguageDescriptionTextPart>
</ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionImagePart>...</ms:LanguageDescriptionImagePart>
</ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionVideoPart>...</ms:LanguageDescriptionVideoPart>
</ms:LanguageDescriptionMediaPart>
with the following
<ms:unspecifiedPart>...</ms:unspecifiedPart>
replace any of the following elements
<ms:distributionTextFeature>...</ms:distributionTextFeature>
<ms:distributionImageFeature>...</ms:distributionImageFeature>
<ms:distributionVideoFeature>...</ms:distributionVideoFeature>
with the element
<ms:distributionUnspecifiedFeature>...</ms:distributionUnspecifiedFeature>
for n-gram models:
replace the following structure
<ms:LanguageDescription>
<ms:lrType>LanguageDescription</ms:lrType>
<ms:LanguageDescriptionSubclass>
<ms:NGramModel>
<ms:ldSubclassType>NGramModel</ms:ldSubclassType>
...
</ms:NGramModel>
</ms:LanguageDescriptionSubclass>
with the structure presented below; i.e. add the element ldSubclass
, replace NGramModel
with Model
, move NGramModel
under Model
and add the elements modelType
and modelFunction
; if the source metadata record provides no information for these two elements, you can use the value http://w3id.org/meta-share/meta-share/unspecified
.
<ms:LanguageDescription>
<ms:lrType>LanguageDescription</ms:lrType>
<ms:ldSubclass>http://w3id.org/meta-share/meta-share/model</ms:ldSubclass>
<ms:LanguageDescriptionSubclass>
<ms:Model>
<ms:ldSubclassType>Model</ms:ldSubclassType>
<ms:modelType>...</ms:modelType>
<ms:modelFunction>...</ms:modelFunction>
...
<ms:NGramModel>
...
</ms:NGramModel>
</ms:Model>
</ms:LanguageDescriptionSubclass>
replace any of the following structures
<ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionTextPart>...</ms:LanguageDescriptionTextPart>
</ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionImagePart>...</ms:LanguageDescriptionImagePart>
</ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionMediaPart>
<ms:LanguageDescriptionVideoPart>...</ms:LanguageDescriptionVideoPart>
</ms:LanguageDescriptionMediaPart>
with the following
<ms:unspecifiedPart>...</ms:unspecifiedPart>
replace any of the following elements
<ms:distributionTextFeature>...</ms:distributionTextFeature>
<ms:distributionImageFeature>...</ms:distributionImageFeature>
<ms:distributionVideoFeature>...</ms:distributionVideoFeature>
with the element
<ms:distributionUnspecifiedFeature>...</ms:distributionUnspecifiedFeature>
for grammars
<ms:LanguageDescription>
<ms:lrType>LanguageDescription</ms:lrType>
<ms:LanguageDescriptionSubclass>
<ms:Grammar>
<ms:ldSubclassType>Grammar</ms:ldSubclassType>
...
</ms:Grammar>
</ms:LanguageDescriptionSubclass>
<ms:LanguageDescription>
<ms:lrType>LanguageDescription</ms:lrType>
<ms:ldSubclass>http://w3id.org/meta-share/meta-share/grammar</ms:ldSubclass>
<ms:LanguageDescriptionSubclass>
<ms:Grammar>
<ms:ldSubclassType>Grammar</ms:ldSubclassType>
...
</ms:Grammar>
</ms:LanguageDescriptionSubclass>
Release v2.0.5¶
Overview¶
Release date: 4/10/2021
ELG-SHARE schema version: v2.0.5
Schema changes¶
added option for free text values for the elements:
annotationType
,dataFormat
andsizeUnit
added element
bibliographicRecord
for adding bibtex record for documentschanged cardinality of
isDivisionOf
for organizations (i.e. allowing multiple parent organizations)
Changes required for XML metadata records¶
If you have uploaded XML files before with previous schema versions, please note that the following changes are required for any new XML files:
annotationType: replace
<ms:annotationType>...</ms:annotationType>
with the following if you use a value from the recommended vocabulary: https://european-language-grid.readthedocs.io/en/stable/Documentation/ELG-SHARE_xsd.html#annotationTypeRecommended
<ms:annotationType>
<ms:annotationTypeRecommended>...</ms:annotationTypeRecommended>
</ms:annotationType>
or use the following for free text
<ms:annotationType>
<ms:annotationTypeOther>free text</ms:annotationTypeOther>
</ms:annotationType>
dataFormat: replace
<ms:dataFormat>...</ms:dataFormat>
with the following if you use a value from the recommended vocabulary: https://european-language-grid.readthedocs.io/en/stable/Documentation/ELG-SHARE_xsd.html#dataFormatRecommended
<ms:dataFormat>
<ms:dataFormatRecommended>...</ms:dataFormatRecommended>
</ms:dataFormat>
or use the following for free text
<ms:dataFormat>
<ms:dataFormatOther>free text</ms:dataFormatOther>
</ms:dataFormat>
sizeUnit: replace
<ms:sizeUnit>...</ms:sizeUnit>
with the following if you use a value from the recommended vocabulary: https://european-language-grid.readthedocs.io/en/stable/Documentation/ELG-SHARE_xsd.html#sizeUnitRecommended
<ms:sizeUnit>
<ms:sizeUnitRecommended>...</ms:sizeUnitRecommended>
</ms:sizeUnit>
or use the following for free text
<ms:sizeUnit>
<ms:sizeUnitOther>free text</ms:sizeUnitOther>
</ms:sizeUnit>