{"id":35723,"date":"2025-02-10T10:50:09","date_gmt":"2025-02-10T09:50:09","guid":{"rendered":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401-2\/"},"modified":"2025-06-26T05:10:32","modified_gmt":"2025-06-26T03:10:32","slug":"oai-clarino-uib-no-lb-2024021401","status":"publish","type":"language-resource","link":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/","title":{"rendered":""},"content":{"rendered":"


\n<\/p>\n

oai:clarino.uib.no:lb-2024021401<\/identifier>2025-06-25T11:01:14Z<\/datestamp>FIN-CLARIN<\/setSpec><\/header>\n

metashareToCmdi.xsl remove_metashare_namespace.xsl<\/MdCreator>2024-02-17<\/MdCreationDate>urn:nbn:fi:lb-2024021401<\/MdSelfLink>clarin.eu:cr1:p_1360931019836<\/MdProfile>donatespeech-backend<\/MdCollectionDisplayName><\/Header>Resource<\/ResourceType> http:\/\/urn.fi\/urn:nbn:fi:lb-2025062402<\/ResourceRef><\/ResourceProxy><\/ResourceProxyList><\/Resources>Finnish Tagtools 1.6<\/resourceName>This software package provides finnish-postag, a part-of-speech and morphology tagger for Finnish, and finnish-nertag, a named entity recogniser for Finnish.
\nThis software is also installed in CSC’s computing environment (module load finnish-tagtools).<\/p>\n

Both tools take running text from standard input and produce tabular output (one token per line) to standard output. See –help messages for more details.<\/p>\n

An installer is provided in the form of a Makefile. More information can be found in the README-file in the download folder.<\/p>\n

ChangeLog:<\/p>\n

1.1 Initial release<\/p>\n

1.2: Intermediate version (not published at the Language Bank)<\/p>\n

1.3<\/p>\n

General
\n– finnish-nertag and finnish-postag tokenize identically; tokenization no longer allows multi-word tokens
\n– fixed tokenization-related bugs
\n– added new version of OMorFi
\n– fixed several glaring FinnPOS-related bugs and improved POS tagging and lemmatization
\n– reduced the size of omorfi_tokenize.pmatch and ftb.omorfi.model<\/p>\n

finnish-nertag:
\n – implemented nested annotations
\n – added options –no-tokenize, –show-analyses and –show-nested
\n – more reliable and extensive lemma normalization with normalize-lemmas.py
\n – Capture() memory is wiped at XML closing tags such as <\/text>, <\/body> etc.
\n – FiNER rules:
\n – added sub category EnamexPrsAnm (animals)
\n – restored EnamexPrsTit (titles)
\n – restored and expanded numerical expressions (NumexMsrXxx, NumexMsrCur)
\n – rewrote and expanded EnamexProXxx rules to include foods and cultivars
\n – TimexTmeDat: years that are divisble by 10 are now recognized more reliably
\n – greatly improved recall and precision
\n – fixed the all-caps bug: consecutive all-caps input strings no longer cause finnish-nertag to slow down or freeze<\/p>\n

1.3.1 Maintenance update
\n – Uses now natively compiled hfst-pmatch if found in path (The pre compiled version can be slow)
\n – added –no-tokenize option to finnish-postag
\n1.3.2 Bugfix update
\n – Fixes bug in finnish-tokenize<\/p>\n

1.4.0
\n – Updated NER rules and tests for them<\/p>\n

1.5.0
\n – bio-tagging added
\n – new FinnPos model for disambiguating morphology<\/p>\n

1.5.1
\n – tests fixed according to changes in disambiguating morphology<\/p>\n

1.6.0
\n – support for the –max-recursion and —time-cutoff options in hfst-pmatch, which in the default setting prevent the NER rules from searching more than 500 levels deep, which produced a pretty big speedup
\n – Possibility to give a strict time cutoff if you want each invocation to hfst-pmatch to finish within a given amount of time
\n – NER rules are much smaller in this version, due to a lot of size optimizations, by a factor of about 60
\n – requires a new enough version of hfst-pmatch. 3.15.3<\/description>finnish-tagtools<\/resourceShortName>http:\/\/urn.fi\/urn:nbn:fi:lb-2024021402<\/url>NOT_DEFINED_FOR_V2<\/metaShareId>http:\/\/urn.fi\/urn:nbn:fi:lb-2024021401<\/identifier><\/identificationInfo>available-unrestrictedUse<\/availability>GPL<\/licence>downloadable<\/distributionAccessMedium>http:\/\/urn.fi\/<\/downloadLocation>licensor<\/role>FIN-CLARIN<\/organizationName>FIN-CLARIN<\/organizationShortName>University of Helsinki<\/departmentName>finclarin@helsinki.fi<\/email>http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>University of Helsinki<\/city>Finland<\/country><\/communicationInfo><\/organizationInfo><\/licensorOrganization>distributionRightsHolder<\/role>FIN-CLARIN<\/organizationName>FIN-CLARIN<\/organizationShortName>University of Helsinki<\/departmentName>finclarin@helsinki.fi<\/email>http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>University of Helsinki<\/city>Finland<\/country><\/communicationInfo><\/organizationInfo><\/distributionRightsHolderOrganization><\/licenceInfo><\/distributionInfo>contactPerson<\/role>The Language Bank of Finland<\/surname>User support at CSC – IT Center for Science Ltd.<\/givenName>unknown<\/sex>kielipankki@csc.fi<\/email><\/communicationInfo>affiliation<\/role>CSC – Tieteen tietotekniikan keskus Oy<\/organizationName>CSC \u2014 IT Center for Science Ltd<\/organizationName>CSC<\/organizationShortName>Kielipankki<\/departmentName>Language Bank of Finland<\/departmentName>kielipankki@csc.fi<\/email>http:\/\/www.csc.fi\/english<\/url><\/p>\n

P.O. Box 405<\/address>\n

FI-02101<\/zipCode>Espoo<\/city>Finland<\/country>+358 (0)9 457 2001<\/telephoneNumber>+358 (0)9 457 2302<\/faxNumber><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/contactPerson>contactPerson<\/role>Hardwick<\/surname>Sam<\/givenName>sam.hardwick@csc.fi<\/email><\/communicationInfo><\/personInfo><\/contactPerson>2018-11-14<\/metadataCreationDate>English<\/metadataLanguageName>en<\/metadataLanguageId>2025-06-25<\/metadataLastDateUpdated>metadataCreator<\/role>Dieckmann<\/surname>Ute<\/givenName>unknown<\/sex>ute.dieckmann@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>FIN-CLARIN<\/organizationName>FIN-CLARIN<\/organizationShortName>University of Helsinki<\/departmentName>finclarin@helsinki.fi<\/email>http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>University of Helsinki<\/city>Finland<\/country><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/metadataCreator><\/metadataInfo>1.6<\/version>2020-12-09<\/lastDateUpdated>Approximately annually<\/updateFrequency><\/versionInfo>humanUse<\/actualUse>morphologicalAnalysis<\/useNLPSpecific>morphosyntacticTagging<\/useNLPSpecific>namedEntityRecognition<\/useNLPSpecific><\/actualUseInfo><\/usageInfo>documentation<\/role>Resource group page: http:\/\/urn.fi\/urn:nbn:fi:lb-2021101101<\/documentUnstructured><\/documentationUnstructured><\/resourceDocumentationInfo>resourceCreator<\/role>Hardwick<\/surname>Sam<\/givenName>sam.hardwick@csc.fi<\/email><\/communicationInfo><\/personInfo><\/resourceCreatorPerson><\/resourceCreationInfo>IsNewVersionOf<\/relationType>Finnish Tagtools 1.5 http:\/\/urn.fi\/urn:nbn:fi:lb-2021042101<\/targetResourceNameURI><\/relatedResource><\/relationInfo>toolService<\/resourceType>suiteOfTools<\/toolServiceType>true<\/languageDependent>text<\/mediaType>writtenLanguage<\/modalityType>Finnish<\/languageName>fi<\/languageId>UTF-8<\/characterEncoding>paragraph<\/segmentationLevel><\/inputInfo>text<\/mediaType>writtenLanguage<\/modalityType>Finnish<\/languageName>fi<\/languageId>UTF-8<\/characterEncoding>lemmatization<\/annotationType>morphosyntacticAnnotation-posTagging<\/annotationType>semanticAnnotation-namedEntities<\/annotationType>TSV<\/annotationFormat>word<\/segmentationLevel><\/outputInfo>linux<\/operatingSystem><\/toolServiceOperationInfo>Python<\/implementationLanguage>C++<\/implementationLanguage>bash<\/implementationLanguage>hfst-pmatch<\/formalism>OmorFI https:\/\/github.com\/flammie\/omorfi<\/targetResourceNameURI><\/originalSource>FinnPos https:\/\/github.com\/mpsilfve\/FinnPos<\/targetResourceNameURI><\/originalSource>HFST https:\/\/github.com\/hfst\/hfst<\/targetResourceNameURI><\/originalSource>FiNER https:\/\/github.com\/Traubert\/FiNer-rules\/blob\/master\/finer-readme.md<\/targetResourceNameURI><\/originalSource><\/toolServiceCreationInfo><\/toolServiceInfo><\/resourceInfo><\/Components><\/CMD><\/metadata><\/record><\/p>\n","protected":false},"template":"","categories":[],"tags":[],"language-resource-type":[],"language-resource-origin":[7565],"class_list":["post-35723","language-resource","type-language-resource","status-publish","hentry"],"yoast_head":"\n- Spr\u00e5kbanken<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/\" \/>\n<meta property=\"og:locale\" content=\"nb_NO\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/\" \/>\n<meta property=\"og:site_name\" content=\"Spr\u00e5kbanken\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-26T03:10:32+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Ansl. lesetid\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutter\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/\",\"name\":\"- Spr\u00e5kbanken\",\"isPartOf\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\"},\"datePublished\":\"2025-02-10T09:50:09+00:00\",\"dateModified\":\"2025-06-26T03:10:32+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/#breadcrumb\"},\"inLanguage\":\"nb-NO\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Resources from the resource bank\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/\",\"name\":\"Spr\u00e5kbanken\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nb-NO\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Spr\u00e5kbanken","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/","og_locale":"nb_NO","og_type":"article","og_url":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/","og_site_name":"Spr\u00e5kbanken","article_modified_time":"2025-06-26T03:10:32+00:00","twitter_card":"summary_large_image","twitter_misc":{"Ansl. lesetid":"3 minutter"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/","url":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/","name":"- Spr\u00e5kbanken","isPartOf":{"@id":"https:\/\/www.nb.no\/sprakbanken\/#website"},"datePublished":"2025-02-10T09:50:09+00:00","dateModified":"2025-06-26T03:10:32+00:00","breadcrumb":{"@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/#breadcrumb"},"inLanguage":"nb-NO","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2024021401\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.nb.no\/sprakbanken\/"},{"@type":"ListItem","position":2,"name":"Resources from the resource bank","item":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/"}]},{"@type":"WebSite","@id":"https:\/\/www.nb.no\/sprakbanken\/#website","url":"https:\/\/www.nb.no\/sprakbanken\/","name":"Spr\u00e5kbanken","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nb-NO"}]}},"lang":"en","translations":{"nb":35720,"en":35723},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource\/35723","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource"}],"about":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/types\/language-resource"}],"wp:attachment":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/media?parent=35723"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/categories?post=35723"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/tags?post=35723"},{"taxonomy":"language-resource-type","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-type?post=35723"},{"taxonomy":"language-resource-origin","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-origin?post=35723"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}