{"id":35167,"date":"2025-02-10T10:48:43","date_gmt":"2025-02-10T09:48:43","guid":{"rendered":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303-2\/"},"modified":"2025-02-10T11:05:05","modified_gmt":"2025-02-10T10:05:05","slug":"oai-clarino-uib-no-lb-2022021303","status":"publish","type":"language-resource","link":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/","title":{"rendered":""},"content":{"rendered":"


\n<\/p>\n

oai:clarino.uib.no:lb-2022021303<\/identifier>2024-12-04T13:12:21Z<\/datestamp>FIN-CLARIN<\/setSpec><\/header>\n

metashareToCmdi.xsl remove_metashare_namespace.xsl<\/MdCreator>2022-11-17<\/MdCreationDate>urn:nbn:fi:lb-2022021303<\/MdSelfLink>clarin.eu:cr1:p_1360931019836<\/MdProfile><\/Header>Resource<\/ResourceType>http:\/\/urn.fi\/urn:nbn:fi:lb-2022021304<\/ResourceRef><\/ResourceProxy><\/ResourceProxyList><\/Resources>HeLI-OTS 1.3<\/resourceName>HeLI off-the-shelf language identifier with language models for 200 languages. The program will read the <infile> and classify the language of each line as one of the 200 languages it knows and writes the results, one ISO 639-3 code per line, into file <outfile>. It can identify c. 3000 sentences per second using one core on a 2021 laptop and around 3 gigabytes of memory.<\/p>\n

Usage:
\njava -jar HeLI.jar -r <infile> -w <outfile><\/p>\n

The program will read the <infile> and classify the language of each line as one of the 200 languages it knows
\nand writes the results, one ISO 639-3 code per line, into file <outfile>.<\/p>\n

You can use the -c option to make the program print a confidence score for the identification after each language code.<\/p>\n

Usage:
\njava -jar HeLI.jar -c -r <infile> -w <outfile><\/p>\n

You can give the list of comma-separated ISO 639-3 identifiers for relevant languages after -l option.<\/p>\n

Usage:
\njava -jar HeLI.jar -r <infile> -w <outfile> -l fin,swe,eng<\/p>\n

You can give the number of top-scored languages to print after the -t option. (overrides confidence)<\/p>\n

Usage:
\njava -jar HeLI.jar -r <infile> -w <outfile> -l fin,swe,eng -t 2<\/p>\n

If you omit both of the filenames, the program will read the standard input one line at a time and write the result to standard output.<\/p>\n

Producing and publishing this software has been partly supported by The Finnish Research Impact Foundation Tandem Industry Academia -funding in cooperation with Lingsoft.<\/description>heli-ots-v1-3<\/resourceShortName>http:\/\/urn.fi\/urn:nbn:fi:lb-2022021304<\/url>NOT_DEFINED_FOR_V2<\/metaShareId>http:\/\/urn.fi\/urn:nbn:fi:lb-2022021303<\/identifier><\/identificationInfo>available-unrestrictedUse<\/availability>ApacheLicence_2.0<\/licence>downloadable<\/distributionAccessMedium>https:\/\/doi.org\/10.5281\/zenodo.4780898<\/downloadLocation>licensor<\/role>University of Helsinki<\/organizationName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/licensorOrganization>distributionRightsHolder<\/role>University of Helsinki<\/organizationName>UHEL<\/organizationShortName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/distributionRightsHolderOrganization><\/licenceInfo>iprHolder<\/role>Jauhiainen<\/surname>Tommi<\/givenName>firstname.lastname@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>University of Helsinki<\/organizationName>UHEL<\/organizationShortName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/iprHolderPerson>iprHolder<\/role>Jauhiainen<\/surname>Heidi<\/givenName>firstname.surname@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>University of Helsinki<\/organizationName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/iprHolderPerson>iprHolder<\/role>University of Helsinki<\/organizationName>UHEL<\/organizationShortName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/iprHolderOrganization><\/distributionInfo>contactPerson<\/role>FIN-CLARIN<\/surname>User support<\/givenName>fin-clarin@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>FIN-CLARIN<\/organizationName>FIN-CLARIN<\/organizationShortName>University of Helsinki<\/departmentName>fin-clarin@helsinki.fi<\/email>http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>University of Helsinki<\/city>Finland<\/country><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/contactPerson>2021-06-02<\/metadataCreationDate>English<\/metadataLanguageName>en<\/metadataLanguageId>2022-02-15<\/metadataLastDateUpdated>metadataCreator<\/role>Dieckmann<\/surname>Ute<\/givenName>unknown<\/sex>ute.dieckmann@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>FIN-CLARIN<\/organizationName>FIN-CLARIN<\/organizationShortName>University of Helsinki<\/departmentName>finclarin@helsinki.fi<\/email>http:\/\/www.helsinki.fi\/fin-clarin<\/url><\/p>\n

PO Box 24 (Unioninkatu 40)<\/address>\n

00014<\/zipCode>University of Helsinki<\/city>Finland<\/country><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/metadataCreator><\/metadataInfo>1.3<\/version><\/versionInfo>nlpApplications<\/actualUse>languageIdentification<\/useNLPSpecific>Usage: java -jar HeLI.jar -r <infile> -w <outfile> The program will read the <infile> and classify the language of each line as one of the 200 languages it knows and writes the results, one ISO 639-3 code per line, into file <outfile>.<\/actualUseDetails><\/actualUseInfo><\/usageInfo>documentation<\/role>Resource group page: http:\/\/urn.fi\/urn:nbn:fi:lb-2022011801<\/documentUnstructured><\/documentationUnstructured><\/resourceDocumentationInfo>resourceCreator<\/role>Jauhiainen<\/surname>Tommi<\/givenName>firstname.lastname@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>University of Helsinki<\/organizationName>UHEL<\/organizationShortName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/resourceCreatorPerson>resourceCreator<\/role>Jauhiainen<\/surname>Heidi<\/givenName>firstname.surname@helsinki.fi<\/email><\/communicationInfo>affiliation<\/role>University of Helsinki<\/organizationName>firstname.surname@helsinki.fi<\/email><\/communicationInfo><\/organizationInfo><\/affiliation><\/personInfo><\/resourceCreatorPerson><\/resourceCreationInfo>IsNewVersionOf<\/relationType>HeLI-OTS 1.2 http:\/\/urn.fi\/urn:nbn:fi:lb-2022011701<\/targetResourceNameURI><\/relatedResource><\/relationInfo>toolService<\/resourceType>tool<\/toolServiceType>Language identifier<\/toolServiceSubtype>false<\/languageDependent>text<\/mediaType>writtenLanguage<\/modalityType>zul<\/languageId>yrk<\/languageId>yid<\/languageId>xmf<\/languageId>wln<\/languageId>vot<\/languageId>vol<\/languageId>vls<\/languageId>vie<\/languageId>uzn<\/languageId>urd<\/languageId>ura<\/languageId>ukr<\/languageId>uig<\/languageId>udm<\/languageId>tzh<\/languageId>tur<\/languageId>tuk<\/languageId>tso<\/languageId>tha<\/languageId>tgl<\/languageId>tgk<\/languageId>tet<\/languageId>tel<\/languageId>tca<\/languageId>tat<\/languageId>tam<\/languageId>swe<\/languageId>swa<\/languageId>srd<\/languageId>sqi<\/languageId>spa<\/languageId>sot<\/languageId>som<\/languageId>snd<\/languageId>sna<\/languageId>sms<\/languageId>smn<\/languageId>smj<\/languageId>sme<\/languageId>sma<\/languageId>slv<\/languageId>slk<\/languageId>sju<\/languageId>sjk<\/languageId>sjd<\/languageId>sin<\/languageId>shk<\/languageId>sgs<\/languageId>scn<\/languageId>sah<\/languageId>sag<\/languageId>rus<\/languageId>ron<\/languageId>roh<\/languageId>que<\/languageId>por<\/languageId>pon<\/languageId>pol<\/languageId>pnb<\/languageId>pms<\/languageId>pli<\/languageId>pfl<\/languageId>pes<\/languageId>pan<\/languageId>pam<\/languageId>oss<\/languageId>ori<\/languageId>olo<\/languageId>oci<\/languageId>nso<\/languageId>nob<\/languageId>nno<\/languageId>nld<\/languageId>nio<\/languageId>nhn<\/languageId>nep<\/languageId>nav<\/languageId>myv<\/languageId>mya<\/languageId>mwl<\/languageId>msa<\/languageId>mrj<\/languageId>mri<\/languageId>mon<\/languageId>mns<\/languageId>mlt<\/languageId>mlg<\/languageId>mkd<\/languageId>mhr<\/languageId>mdf<\/languageId>mcf<\/languageId>mcd<\/languageId>mar<\/languageId>mal<\/languageId>lus<\/languageId>lug<\/languageId>lud<\/languageId>ltz<\/languageId>lmo<\/languageId>liv<\/languageId>lit<\/languageId>lin<\/languageId>lav<\/languageId>lat<\/languageId>lao<\/languageId>ksh<\/languageId>krc<\/languageId>kpv<\/languageId>kor<\/languageId>koi<\/languageId>kir<\/languageId>khm<\/languageId>kca<\/languageId>kbp<\/languageId>kbd<\/languageId>kaz<\/languageId>kat<\/languageId>kan<\/languageId>kal<\/languageId>jpn<\/languageId>izh<\/languageId>ita<\/languageId>isl<\/languageId>ina<\/languageId>ilo<\/languageId>iku<\/languageId>ido<\/languageId>ibo<\/languageId>hye<\/languageId>huu<\/languageId>hus<\/languageId>hun<\/languageId>hsb<\/languageId>hmo<\/languageId>hin<\/languageId>heb<\/languageId>hbs<\/languageId>hat<\/languageId>guj<\/languageId>gsw<\/languageId>grn<\/languageId>gom<\/languageId>glv<\/languageId>glg<\/languageId>gle<\/languageId>gla<\/languageId>fry<\/languageId>fra<\/languageId>fin<\/languageId>fij<\/languageId>fao<\/languageId>ext<\/languageId>ewe<\/languageId>eus<\/languageId>est<\/languageId>epo<\/languageId>eng<\/languageId>ell<\/languageId>div<\/languageId>diq<\/languageId>deu<\/languageId>dan<\/languageId>cym<\/languageId>cos<\/languageId>cor<\/languageId>cnh<\/languageId>cmn<\/languageId>chy<\/languageId>chv<\/languageId>chr<\/languageId>cho<\/languageId>chk<\/languageId>che<\/languageId>ces<\/languageId>ceb<\/languageId>cdo<\/languageId>cbu<\/languageId>cat<\/languageId>bul<\/languageId>bre<\/languageId>bpy<\/languageId>bod<\/languageId>boa<\/languageId>ben<\/languageId>bel<\/languageId>bcl<\/languageId>bar<\/languageId>aze<\/languageId>asm<\/languageId>arn<\/languageId>arl<\/languageId>ara<\/languageId>amr<\/languageId>amh<\/languageId>ame<\/languageId>aii<\/languageId>afr<\/languageId>adz<\/languageId>abk<\/languageId>UTF-8<\/characterEncoding><\/inputInfo>text<\/mediaType>languageDescription<\/resourceType>writtenLanguage<\/modalityType>UTF-8<\/characterEncoding>ISO 639-3<\/tagset><\/outputInfo>os-independent<\/operatingSystem>Java<\/runningEnvironmentDetails><\/runningEnvironmentInfo><\/toolServiceOperationInfo>false<\/evaluated><\/toolServiceEvaluationInfo>Java<\/implementationLanguage><\/toolServiceCreationInfo><\/toolServiceInfo><\/resourceInfo><\/Components><\/CMD><\/metadata><\/record><\/p>\n","protected":false},"template":"","categories":[],"tags":[],"language-resource-type":[],"language-resource-origin":[7565],"class_list":["post-35167","language-resource","type-language-resource","status-publish","hentry"],"yoast_head":"\n- Spr\u00e5kbanken<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/\" \/>\n<meta property=\"og:locale\" content=\"nb_NO\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/\" \/>\n<meta property=\"og:site_name\" content=\"Spr\u00e5kbanken\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-10T10:05:05+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Ansl. lesetid\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutter\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/\",\"name\":\"- Spr\u00e5kbanken\",\"isPartOf\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\"},\"datePublished\":\"2025-02-10T09:48:43+00:00\",\"dateModified\":\"2025-02-10T10:05:05+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/#breadcrumb\"},\"inLanguage\":\"nb-NO\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Resources from the resource bank\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/\",\"name\":\"Spr\u00e5kbanken\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nb-NO\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Spr\u00e5kbanken","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/","og_locale":"nb_NO","og_type":"article","og_url":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/","og_site_name":"Spr\u00e5kbanken","article_modified_time":"2025-02-10T10:05:05+00:00","twitter_card":"summary_large_image","twitter_misc":{"Ansl. lesetid":"2 minutter"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/","url":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/","name":"- Spr\u00e5kbanken","isPartOf":{"@id":"https:\/\/www.nb.no\/sprakbanken\/#website"},"datePublished":"2025-02-10T09:48:43+00:00","dateModified":"2025-02-10T10:05:05+00:00","breadcrumb":{"@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/#breadcrumb"},"inLanguage":"nb-NO","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-clarino-uib-no-lb-2022021303\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.nb.no\/sprakbanken\/"},{"@type":"ListItem","position":2,"name":"Resources from the resource bank","item":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/"}]},{"@type":"WebSite","@id":"https:\/\/www.nb.no\/sprakbanken\/#website","url":"https:\/\/www.nb.no\/sprakbanken\/","name":"Spr\u00e5kbanken","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nb-NO"}]}},"lang":"en","translations":{"nb":35164,"en":35167},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource\/35167","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource"}],"about":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/types\/language-resource"}],"wp:attachment":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/media?parent=35167"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/categories?post=35167"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/tags?post=35167"},{"taxonomy":"language-resource-type","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-type?post=35167"},{"taxonomy":"language-resource-origin","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-origin?post=35167"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}