{"id":35135,"date":"2025-02-10T10:48:39","date_gmt":"2025-02-10T09:48:39","guid":{"rendered":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/"},"modified":"2025-02-10T11:05:01","modified_gmt":"2025-02-10T10:05:01","slug":"oai-clarino-uib-no-lb-2022011701","status":"publish","type":"language-resource","link":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/","title":{"rendered":""},"content":{"rendered":"


\n<\/p>\n

oai:clarino.uib.no:lb-2022011701<\/identifier>2024-12-04T13:12:17Z<\/datestamp>FIN-CLARIN<\/setSpec><\/header>\n


\n


\nmetashareToCmdi.xsl remove_metashare_namespace.xsl<\/MdCreator>
\n2022-11-17<\/MdCreationDate>
\nurn:nbn:fi:lb-2022011701<\/MdSelfLink>
\nclarin.eu:cr1:p_1360931019836<\/MdProfile><\/p>\n

<\/Header>Resource<\/ResourceType>http:\/\/urn.fi\/urn:nbn:fi:lb-2022011702<\/ResourceRef><\/ResourceProxy>
\n<\/ResourceProxyList>
\n
\n<\/Resources>
\n
\n
\n
\n HeLI-OTS 1.2<\/resourceName>
\n HeLI off-the-shelf language identifier with language models for 200 languages. The program will read the <infile> and classify the language of each line as one of the 200 languages it knows and writes the results, one ISO 639-3 code per line, into file <outfile>. It can identify c. 3000 sentences per second using one core on a 2021 laptop and around 3 gigabytes of memory.<\/p>\n

Usage:
\njava -jar HeLI.jar -r <infile> -w <outfile><\/p>\n

The program will read the <infile> and classify the language of each line as one of the 200 languages it knows
\nand writes the results, one ISO 639-3 code per line, into file <outfile>.<\/p>\n

You can use the -c option to make the program print a confidence score for the identification after each language code.<\/p>\n

Usage:
\njava -jar HeLI.jar -c -r <infile> -w <outfile><\/p>\n

You can give the list of comma-separated ISO 639-3 identifiers for relevant languages after -l option.<\/p>\n

Usage:
\njava -jar HeLI.jar -r <infile> -w <outfile> -l fin,swe,eng<\/p>\n

You can give the number of top-scored languages to print after the -t option. (overrides confidence)<\/p>\n

Usage:
\njava -jar HeLI.jar -r <infile> -w <outfile> -l fin,swe,eng -t 2<\/p>\n

If you omit both of the filenames, the program will read the standard input one line at a time and write the result to standard output.<\/p>\n

Producing and publishing this software has been partly supported by The Finnish Research Impact Foundation Tandem Industry Academia -funding in cooperation with Lingsoft.<\/description>
\n heli-ots-v1-2<\/resourceShortName>
\n http:\/\/urn.fi\/urn:nbn:fi:lb-2022011702<\/url>
\n NOT_DEFINED_FOR_V2<\/metaShareId>
\n http:\/\/urn.fi\/urn:nbn:fi:lb-2022011701<\/identifier>
\n <\/identificationInfo>
\n
\n available-unrestrictedUse<\/availability>\n \n ApacheLicence_2.0<\/licence>\n downloadable<\/distributionAccessMedium>
\n https:\/\/doi.org\/10.5281\/zenodo.4780898<\/downloadLocation>\n \n licensor<\/role>
\n
\n University of Helsinki<\/organizationName>
\n UHEL<\/organizationShortName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>\n <\/licensorOrganization>\n
\n distributionRightsHolder<\/role>
\n
\n University of Helsinki<\/organizationName>
\n UHEL<\/organizationShortName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/distributionRightsHolderOrganization>\n <\/licenceInfo>\n
\n iprHolder<\/role>\n \n Jauhiainen<\/surname>
\n Tommi<\/givenName>
\n
\n firstname.lastname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n UHEL<\/organizationShortName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/iprHolderPerson>
\n
\n iprHolder<\/role>\n \n Jauhiainen<\/surname>
\n Heidi<\/givenName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/iprHolderPerson>
\n
\n iprHolder<\/role>
\n
\n University of Helsinki<\/organizationName>
\n UHEL<\/organizationShortName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/iprHolderOrganization>
\n <\/distributionInfo>
\n
\n contactPerson<\/role>\n \n FIN-CLARIN<\/surname>
\n User support<\/givenName>
\n
\n fin-clarin@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n FIN-CLARIN<\/organizationName>
\n FIN-CLARIN<\/organizationShortName>
\n University of Helsinki<\/departmentName>
\n
\n fin-clarin@helsinki.fi<\/email>
\n http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>
\n University of Helsinki<\/city>
\n Finland<\/country>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/contactPerson>
\n
\n 2022-01-17<\/metadataCreationDate>
\n English<\/metadataLanguageName>
\n en<\/metadataLanguageId>
\n 2022-02-16<\/metadataLastDateUpdated>
\n relation to new version 1.3 added<\/revision>
\n
\n metadataCreator<\/role>\n \n Dieckmann<\/surname>
\n Ute<\/givenName>
\n unknown<\/sex>
\n
\n ute.dieckmann@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n FIN-CLARIN<\/organizationName>
\n FIN-CLARIN<\/organizationShortName>
\n University of Helsinki<\/departmentName>
\n
\n finclarin@helsinki.fi<\/email>
\n http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>
\n University of Helsinki<\/city>
\n Finland<\/country>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/metadataCreator>
\n <\/metadataInfo>
\n
\n 1.2<\/version>
\n <\/versionInfo>
\n
\n
\n nlpApplications<\/actualUse>
\n languageIdentification<\/useNLPSpecific>
\n Usage: java -jar HeLI.jar -r <infile> -w <outfile> The program will read the <infile> and classify the language of each line as one of the 200 languages it knows and writes the results, one ISO 639-3 code per line, into file <outfile>.<\/actualUseDetails>
\n <\/actualUseInfo>
\n <\/usageInfo>
\n
\n
\n documentation<\/role>
\n Resource group page: http:\/\/urn.fi\/urn:nbn:fi:lb-2022011801<\/documentUnstructured>
\n <\/documentationUnstructured>
\n <\/resourceDocumentationInfo>
\n
\n
\n resourceCreator<\/role>\n \n Jauhiainen<\/surname>
\n Tommi<\/givenName>
\n
\n firstname.lastname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n UHEL<\/organizationShortName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/resourceCreatorPerson>
\n
\n resourceCreator<\/role>\n \n Jauhiainen<\/surname>
\n Heidi<\/givenName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n
\n affiliation<\/role>
\n
\n University of Helsinki<\/organizationName>
\n
\n firstname.surname@helsinki.fi<\/email>
\n <\/communicationInfo>
\n <\/organizationInfo>
\n <\/affiliation>\n <\/personInfo>\n <\/resourceCreatorPerson>
\n <\/resourceCreationInfo>
\n
\n IsNewVersionOf<\/relationType>
\n
\n HeLI-OTS 1.1 http:\/\/urn.fi\/urn:nbn:fi:lb-2021062801<\/targetResourceNameURI>
\n <\/relatedResource>
\n <\/relationInfo>
\n
\n IsPreviousVersionOf<\/relationType>
\n
\n HeLI-OTS 1.3 http:\/\/urn.fi\/urn:nbn:fi:lb-2022021303<\/targetResourceNameURI>
\n <\/relatedResource>
\n <\/relationInfo>
\n
\n toolService<\/resourceType>
\n tool<\/toolServiceType>
\n Language identifier<\/toolServiceSubtype>
\n false<\/languageDependent>
\n
\n text<\/mediaType>
\n writtenLanguage<\/modalityType>
\n UTF-8<\/characterEncoding>
\n <\/inputInfo>
\n
\n text<\/mediaType>
\n languageDescription<\/resourceType>
\n writtenLanguage<\/modalityType>
\n UTF-8<\/characterEncoding>
\n ISO 639-3<\/tagset>
\n <\/outputInfo>
\n
\n os-independent<\/operatingSystem>
\n
\n Java<\/runningEnvironmentDetails>
\n <\/runningEnvironmentInfo>
\n <\/toolServiceOperationInfo>
\n
\n false<\/evaluated>
\n <\/toolServiceEvaluationInfo>
\n
\n Java<\/implementationLanguage>
\n <\/toolServiceCreationInfo>
\n <\/toolServiceInfo>
\n<\/resourceInfo><\/Components><\/CMD><\/metadata><\/record><\/p>\n","protected":false},"template":"","categories":[],"tags":[],"language-resource-type":[],"language-resource-origin":[7558],"class_list":["post-35135","language-resource","type-language-resource","status-publish","hentry"],"yoast_head":"\n- Spr\u00e5kbanken<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/\" \/>\n<meta property=\"og:locale\" content=\"nb_NO\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/\" \/>\n<meta property=\"og:site_name\" content=\"Spr\u00e5kbanken\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-10T10:05:01+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Ansl. lesetid\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutter\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/\",\"name\":\"- Spr\u00e5kbanken\",\"isPartOf\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\"},\"datePublished\":\"2025-02-10T09:48:39+00:00\",\"dateModified\":\"2025-02-10T10:05:01+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/#breadcrumb\"},\"inLanguage\":\"nb-NO\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Resources from the resource bank\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/\",\"name\":\"Spr\u00e5kbanken\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nb-NO\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Spr\u00e5kbanken","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/","og_locale":"nb_NO","og_type":"article","og_url":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/","og_site_name":"Spr\u00e5kbanken","article_modified_time":"2025-02-10T10:05:01+00:00","twitter_card":"summary_large_image","twitter_misc":{"Ansl. lesetid":"3 minutter"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/","url":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/","name":"- Spr\u00e5kbanken","isPartOf":{"@id":"https:\/\/www.nb.no\/sprakbanken\/#website"},"datePublished":"2025-02-10T09:48:39+00:00","dateModified":"2025-02-10T10:05:01+00:00","breadcrumb":{"@id":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/#breadcrumb"},"inLanguage":"nb-NO","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-clarino-uib-no-lb-2022011701\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.nb.no\/sprakbanken\/"},{"@type":"ListItem","position":2,"name":"Resources from the resource bank","item":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/"}]},{"@type":"WebSite","@id":"https:\/\/www.nb.no\/sprakbanken\/#website","url":"https:\/\/www.nb.no\/sprakbanken\/","name":"Spr\u00e5kbanken","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nb-NO"}]}},"lang":"nb","translations":{"nb":35135,"en":35138},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource\/35135","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource"}],"about":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/types\/language-resource"}],"wp:attachment":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/media?parent=35135"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/categories?post=35135"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/tags?post=35135"},{"taxonomy":"language-resource-type","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-type?post=35135"},{"taxonomy":"language-resource-origin","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-origin?post=35135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}