{"id":34949,"date":"2025-02-10T10:48:09","date_gmt":"2025-02-10T09:48:09","guid":{"rendered":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/"},"modified":"2025-02-10T11:04:34","modified_gmt":"2025-02-10T10:04:34","slug":"oai-clarino-uib-no-lb-2021042101","status":"publish","type":"language-resource","link":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/","title":{"rendered":""},"content":{"rendered":"


\n<\/p>\n

oai:clarino.uib.no:lb-2021042101<\/identifier>2024-12-04T12:58:04Z<\/datestamp>FIN-CLARIN<\/setSpec><\/header>\n


\n


\nmetashareToCmdi.xsl remove_metashare_namespace.xsl<\/MdCreator>
\n2024-02-20<\/MdCreationDate>
\nurn:nbn:fi:lb-2021042101<\/MdSelfLink>
\nclarin.eu:cr1:p_1360931019836<\/MdProfile><\/p>\n

<\/Header>Resource<\/ResourceType>http:\/\/urn.fi\/urn:nbn:fi:lb-2021042102<\/ResourceRef><\/ResourceProxy>
\n<\/ResourceProxyList>
\n
\n<\/Resources>
\n
\n
\n
\n Finnish Tagtools 1.5<\/resourceName>
\n This software package provides finnish-postag, a part-of-speech and morphology tagger for Finnish, and finnish-nertag, a named entity recogniser for Finnish.
\nThis software is also installed in CSC’s computing environment (module load finnish-tagtools).<\/p>\n

Both tools take running text from standard input and produce tabular output (one token per line) to standard output. See –help messages for more details.<\/p>\n

An installer is provided in the form of a Makefile. More information can be found in the README-file in the download folder.<\/p>\n

ChangeLog:<\/p>\n

1.1 Initial release<\/p>\n

1.2: Intermediate version (not published at the Language Bank)<\/p>\n

1.3<\/p>\n

General
\n– finnish-nertag and finnish-postag tokenize identically; tokenization no longer allows multi-word tokens
\n– fixed tokenization-related bugs
\n– added new version of OMorFi
\n– fixed several glaring FinnPOS-related bugs and improved POS tagging and lemmatization
\n– reduced the size of omorfi_tokenize.pmatch and ftb.omorfi.model<\/p>\n

finnish-nertag:
\n – implemented nested annotations
\n – added options –no-tokenize, –show-analyses and –show-nested
\n – more reliable and extensive lemma normalization with normalize-lemmas.py
\n – Capture() memory is wiped at XML closing tags such as <\/text>, <\/body> etc.
\n – FiNER rules:
\n – added sub category EnamexPrsAnm (animals)
\n – restored EnamexPrsTit (titles)
\n – restored and expanded numerical expressions (NumexMsrXxx, NumexMsrCur)
\n – rewrote and expanded EnamexProXxx rules to include foods and cultivars
\n – TimexTmeDat: years that are divisble by 10 are now recognized more reliably
\n – greatly improved recall and precision
\n – fixed the all-caps bug: consecutive all-caps input strings no longer cause finnish-nertag to slow down or freeze<\/p>\n

1.3.1 Maintenance update
\n – Uses now natively compiled hfst-pmatch if found in path (The pre compiled version can be slow)
\n – added –no-tokenize option to finnish-postag
\n1.3.2 Bugfix update
\n – Fixes bug in finnish-tokenize<\/p>\n

1.4.0
\n – Updated NER rules and tests for them<\/p>\n

1.5.0
\n – bio-tagging added
\n – new FinnPos model for disambiguating morphology<\/p>\n

1.5.1
\n – tests fixed according to changes in disambiguating morphology<\/description>
\n finnish-tagtools<\/resourceShortName>
\n http:\/\/urn.fi\/urn:nbn:fi:lb-2021042102<\/url>
\n NOT_DEFINED_FOR_V2<\/metaShareId>
\n http:\/\/urn.fi\/urn:nbn:fi:lb-2021042101<\/identifier>
\n <\/identificationInfo>
\n
\n available-unrestrictedUse<\/availability>\n \n GPL<\/licence>\n downloadable<\/distributionAccessMedium>
\n http:\/\/urn.fi\/<\/downloadLocation>\n \n licensor<\/role>
\n
\n FIN-CLARIN<\/organizationName>
\n FIN-CLARIN<\/organizationShortName>
\n University of Helsinki<\/departmentName>
\n
\n finclarin@helsinki.fi<\/email>
\n http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>
\n University of Helsinki<\/city>
\n Finland<\/country>
\n <\/communicationInfo>
\n <\/organizationInfo>\n <\/licensorOrganization>\n
\n distributionRightsHolder<\/role>
\n
\n FIN-CLARIN<\/organizationName>
\n FIN-CLARIN<\/organizationShortName>
\n University of Helsinki<\/departmentName>
\n
\n finclarin@helsinki.fi<\/email>
\n http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>
\n University of Helsinki<\/city>
\n Finland<\/country>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/distributionRightsHolderOrganization>\n <\/licenceInfo>\n <\/distributionInfo>
\n
\n contactPerson<\/role>\n \n Hardwick<\/surname>
\n Sam<\/givenName>
\n male<\/sex>
\n
\n sam.hardwick@iki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/contactPerson>
\n
\n contactPerson<\/role>\n \n The Language Bank of Finland<\/surname>
\n User support at CSC – IT Center for Science Ltd.<\/givenName>
\n unknown<\/sex>
\n
\n kielipankki@csc.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n CSC – Tieteen tietotekniikan keskus Oy<\/organizationName>
\n CSC \u2014 IT Center for Science Ltd<\/organizationName>
\n CSC<\/organizationShortName>
\n Kielipankki<\/departmentName>
\n Language Bank of Finland<\/departmentName>
\n
\n kielipankki@csc.fi<\/email>
\n http:\/\/www.csc.fi\/english<\/url><\/p>\n

P.O. Box 405<\/address>\n

FI-02101<\/zipCode>
\n Espoo<\/city>
\n Finland<\/country>
\n +358 (0)9 457 2001<\/telephoneNumber>
\n +358 (0)9 457 2302<\/faxNumber>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/contactPerson>
\n
\n 2018-11-14<\/metadataCreationDate>
\n English<\/metadataLanguageName>
\n en<\/metadataLanguageId>
\n 2021-10-13<\/metadataLastDateUpdated>
\n Link to resource group page added<\/revision>
\n
\n metadataCreator<\/role>\n \n Dieckmann<\/surname>
\n Ute<\/givenName>
\n unknown<\/sex>
\n
\n ute.dieckmann@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n FIN-CLARIN<\/organizationName>
\n FIN-CLARIN<\/organizationShortName>
\n University of Helsinki<\/departmentName>
\n
\n finclarin@helsinki.fi<\/email>
\n http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>
\n University of Helsinki<\/city>
\n Finland<\/country>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/metadataCreator>
\n
\n metadataCreator<\/role>\n \n Hardwick<\/surname>
\n Sam<\/givenName>
\n male<\/sex>
\n
\n sam.hardwick@iki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/metadataCreator>
\n
\n metadataCreator<\/role>\n \n Matthiesen<\/surname>
\n Martin<\/givenName>
\n
\n firstname.surname@csc.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n CSC – Tieteen tietotekniikan keskus Oy<\/organizationName>
\n CSC \u2014 IT Center for Science Ltd<\/organizationName>
\n CSC<\/organizationShortName>
\n Kielipankki<\/departmentName>
\n
\n kielipankki@csc.fi<\/email>
\n http:\/\/www.csc.fi\/english<\/url>
\n https:\/\/ror.org\/04m8m1253<\/url><\/p>\n

P.O. Box 405<\/address>\n

FI-02101<\/zipCode>
\n Espoo<\/city>
\n Finland<\/country>
\n +358 (0)9 457 2001<\/telephoneNumber>
\n +358 (0)9 457 2302<\/faxNumber>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/metadataCreator>
\n <\/metadataInfo>
\n
\n 1.5<\/version>
\n 2021-04-21<\/lastDateUpdated>
\n Approximately annually<\/updateFrequency>
\n <\/versionInfo>
\n
\n
\n humanUse<\/actualUse>
\n morphologicalAnalysis<\/useNLPSpecific>
\n morphosyntacticTagging<\/useNLPSpecific>
\n namedEntityRecognition<\/useNLPSpecific>
\n <\/actualUseInfo>
\n <\/usageInfo>
\n
\n
\n documentation<\/role>
\n Resource group page: http:\/\/urn.fi\/urn:nbn:fi:lb-2021101101<\/documentUnstructured>
\n <\/documentationUnstructured>
\n <\/resourceDocumentationInfo>
\n
\n
\n resourceCreator<\/role>\n \n Hardwick<\/surname>
\n Sam<\/givenName>
\n male<\/sex>
\n
\n sam.hardwick@iki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/resourceCreatorPerson>
\n <\/resourceCreationInfo>
\n
\n IsNewVersionOf<\/relationType>
\n
\n Finnish Tagtools 1.4 http:\/\/urn.fi\/urn:nbn:fi:lb-201908161<\/targetResourceNameURI>
\n <\/relatedResource>
\n <\/relationInfo>
\n
\n IsPreviousVersionOf<\/relationType>
\n
\n Finnish Tagtools 1.6 http:\/\/urn.fi\/urn:nbn:fi:lb-2024021401<\/targetResourceNameURI>
\n <\/relatedResource>
\n <\/relationInfo>
\n
\n toolService<\/resourceType>
\n suiteOfTools<\/toolServiceType>
\n true<\/languageDependent>
\n
\n text<\/mediaType>
\n writtenLanguage<\/modalityType>
\n Finnish<\/languageName>
\n fi<\/languageId>
\n UTF-8<\/characterEncoding>
\n paragraph<\/segmentationLevel>
\n <\/inputInfo>
\n
\n text<\/mediaType>
\n writtenLanguage<\/modalityType>
\n Finnish<\/languageName>
\n fi<\/languageId>
\n UTF-8<\/characterEncoding>
\n lemmatization<\/annotationType>
\n morphosyntacticAnnotation-posTagging<\/annotationType>
\n semanticAnnotation-namedEntities<\/annotationType>
\n TSV<\/annotationFormat>
\n word<\/segmentationLevel>
\n <\/outputInfo>
\n
\n linux<\/operatingSystem>
\n <\/toolServiceOperationInfo>
\n
\n Python<\/implementationLanguage>
\n C++<\/implementationLanguage>
\n bash<\/implementationLanguage>
\n hfst-pmatch<\/formalism>\n
\n OmorFI https:\/\/github.com\/flammie\/omorfi<\/targetResourceNameURI>
\n <\/originalSource>
\n
\n FinnPos https:\/\/github.com\/mpsilfve\/FinnPos<\/targetResourceNameURI>
\n <\/originalSource>
\n
\n HFST https:\/\/github.com\/hfst\/hfst<\/targetResourceNameURI>
\n <\/originalSource>
\n
\n FiNER https:\/\/github.com\/Traubert\/FiNer-rules\/blob\/master\/finer-readme.md<\/targetResourceNameURI>
\n <\/originalSource>
\n <\/toolServiceCreationInfo>
\n <\/toolServiceInfo>
\n<\/resourceInfo><\/Components><\/CMD><\/metadata><\/record><\/p>\n","protected":false},"template":"","categories":[],"tags":[],"language-resource-type":[],"language-resource-origin":[7558],"class_list":["post-34949","language-resource","type-language-resource","status-publish","hentry"],"yoast_head":"\n- Spr\u00e5kbanken<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/\" \/>\n<meta property=\"og:locale\" content=\"nb_NO\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/\" \/>\n<meta property=\"og:site_name\" content=\"Spr\u00e5kbanken\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-10T10:04:34+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Ansl. lesetid\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutter\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/\",\"name\":\"- Spr\u00e5kbanken\",\"isPartOf\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\"},\"datePublished\":\"2025-02-10T09:48:09+00:00\",\"dateModified\":\"2025-02-10T10:04:34+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/#breadcrumb\"},\"inLanguage\":\"nb-NO\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Resources from the resource bank\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/\",\"name\":\"Spr\u00e5kbanken\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nb-NO\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Spr\u00e5kbanken","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/","og_locale":"nb_NO","og_type":"article","og_url":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/","og_site_name":"Spr\u00e5kbanken","article_modified_time":"2025-02-10T10:04:34+00:00","twitter_card":"summary_large_image","twitter_misc":{"Ansl. lesetid":"3 minutter"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/","url":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/","name":"- Spr\u00e5kbanken","isPartOf":{"@id":"https:\/\/www.nb.no\/sprakbanken\/#website"},"datePublished":"2025-02-10T09:48:09+00:00","dateModified":"2025-02-10T10:04:34+00:00","breadcrumb":{"@id":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/#breadcrumb"},"inLanguage":"nb-NO","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2021042101\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.nb.no\/sprakbanken\/"},{"@type":"ListItem","position":2,"name":"Resources from the resource bank","item":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/"}]},{"@type":"WebSite","@id":"https:\/\/www.nb.no\/sprakbanken\/#website","url":"https:\/\/www.nb.no\/sprakbanken\/","name":"Spr\u00e5kbanken","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nb-NO"}]}},"lang":"nb","translations":{"nb":34949,"en":34952},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource\/34949","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource"}],"about":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/types\/language-resource"}],"wp:attachment":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/media?parent=34949"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/categories?post=34949"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/tags?post=34949"},{"taxonomy":"language-resource-type","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-type?post=34949"},{"taxonomy":"language-resource-origin","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-origin?post=34949"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}