{"id":31507,"date":"2025-02-10T10:39:05","date_gmt":"2025-02-10T09:39:05","guid":{"rendered":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70-2\/"},"modified":"2025-02-10T10:55:54","modified_gmt":"2025-02-10T09:55:54","slug":"oai-nb-no-sbr-70","status":"publish","type":"language-resource","link":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/","title":{"rendered":"N-grams from NBdigital 2021"},"content":{"rendered":"


\n<\/p>\n

oai:nb.no:sbr-70<\/identifier>2023-08-08<\/datestamp><\/header>\n

Arne Martinus Lindstad<\/MdCreator>2021-10-30<\/MdCreationDate>https:\/\/www.nb.no\/sprakbanken\/oai?verb=GetRecord&identifier=oai:nb.no:sbr-70&metadataPrefix=cmdi<\/MdSelfLink>clarin.eu:cr1:p_1407745711925<\/MdProfile>Spr\u00e5kbanken NB<\/MdCollectionDisplayName><\/Header>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-digavis-unigram.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-digavis-bigram.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-digavis-trigram.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-digibok-unigram.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-digibok-bigram.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-digibok-trigram.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-metadata-digavis.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-metadata-digibok.csv.gz<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-totals.json<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-README-eng.md<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/ngram-2021-README-nob.md<\/ResourceRef><\/ResourceProxy>Resource<\/ResourceType>https:\/\/www.nb.no\/sbfil\/ngram\/ngram_2021\/2021_NBngram.pdf<\/ResourceRef><\/ResourceProxy><\/ResourceProxyList><\/Resources>corpus<\/resourceType>N-grammer fra NBdigital 2021<\/resourceName>N-grams from NBdigital 2021<\/resourceName>Dette korpuset inneholder n-grammer \u2013 unigrammer, bigrammer og trigrammer \u2013 fra alle b\u00f8ker og aviser som var blitt digitalisert ved Nasjonalbiblioteket per juli 2021. N-grammene er laget p\u00e5 basis av et materiale best\u00e5ende av om lag 580.000 b\u00f8ker og 3.400.000 aviser, til sammen ca. 122 milliarder «tokens» (ord og tegnsetting). N-grammene finnes p\u00e5 CSV-format (UTF-8-kodert).<\/p>\n

Kolonnene i CSV-filene med n-grammer er som f\u00f8lger:
\n– first – det f\u00f8rste ordet i n-grammet (i uni-, bi- og trigrammer)
\n– second – det andre ordet i n-grammet (i bi- og trigrammer)
\n– third – det tredje ordet i n-grammet (i trigrammer)
\n– lang – spr\u00e5kkode for n-grammet (gjelder kun b\u00f8ker, avisene har ingen spr\u00e5kklassifikasjon per n\u00e5)
\n– freq – den totale frekvensen for n-grammet i samlingen av b\u00f8ker eller aviser
\n– json – et dictionary med r\u00e5frekvens per \u00e5r<\/p>\n

totals.json inneholder totalfrekvenser innenfor \u00e5rganger i bok- og aviskorpuset. Med disse kan man lett regne ut relativfrekvenser for sammenlikning p\u00e5 tvers av \u00e5r som i NB N-gram.<\/p>\n

metadata-digibok.csv og metadata-digavis.csv inneholder enkle metadata for alle b\u00f8kene og avisene som inng\u00e5r i bok- og aviskorpuset. Hvis du er interessert i mer utf\u00f8rlige metadata, henviser vi til Oria eller NBs APIer under https:\/\/api.nb.no\/.<\/p>\n

Se dokumentasjonsfilene for mer informasjon.<\/description>This resource contains n-grams – i.e. unigrams, bigrams and trigrams – from all books and newspapers that had been digitized at the National Library of Norway up to July 2021. The n-grams have been extracted from a material consisting of approximately 580,000 books and 3,400,000 newspapers, amounting to a total of 122 billion tokens (words and punctuation). The n-grams are offered as CSV files (UTF-8-encoded).<\/p>\n

Columns in the n-gram CSV files:
\n– first – the first word (in uni-, bi- and trigrams)
\n– second – the second word (in bi- and trigrams)
\n– third – the third word (in trigrams)
\n– lang – the language of the n-gram (only regarding books, newspapers have no language classification as for now)
\n– freq – the total frequency of the n-gram in the collection of books or newspapers
\n– json – a dictionary with raw frequency for each year<\/p>\n

totals.json contains aggregated frequencies per year in the book and newspaper corpora. Using these numbers, relative frequencies can be calculated in order to compare frequencies over time as in NB N-gram.<\/p>\n

metadata-digibok.csv and metadata-digavis.csv contain simple metadata for the books and newspapers. If you need more extensive metadata, you could use Oria or the APIs at https:\/\/api.nb.no\/.<\/p>\n

See the documentation files for further information.<\/description>NBngram2021<\/resourceShortName>NBngram2021<\/resourceShortName>https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-nb-no-sbr-70\/<\/url>hdl:21.11146\/70<\/PID>sbr-70<\/identifier><\/identificationInfo>Public<\/userCategory>downloadable<\/distributionAccessMedium>https:\/\/www.nb.no\/sprakbanken\/ressurskatalog\/oai-nb-no-sbr-70\/<\/downloadLocation>Creative Commons (CC)<\/licenceFamily>Creative_Commons-ZERO (CC-ZERO)<\/licenceName>https:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/<\/licenceURL><\/licence>organization<\/actorType>Licensor<\/role>Nasjonalbiblioteket<\/organizationName>National Library of Norway<\/organizationName>NB<\/organizationShortName>NLN<\/organizationShortName>Spr\u00e5kbanken<\/departmentName>The Language Bank<\/departmentName><\/organizationInfo>sprakbanken@nb.no<\/email>https:\/\/www.nb.no\/sprakbanken\/<\/url><\/p>\n

P.O. Box 2674 Solli<\/address>\n

0203<\/zipCode>Oslo<\/city>Oslo<\/region>Norway<\/country><\/communicationInfo><\/actorInfo><\/licensor><\/licenceInfo><\/distributionInfo>organization<\/actorType>Contact<\/role>Nasjonalbiblioteket<\/organizationName>National Library of Norway<\/organizationName>NB<\/organizationShortName>NLN<\/organizationShortName>Spr\u00e5kbanken<\/departmentName>The Language Bank<\/departmentName><\/organizationInfo>sprakbanken@nb.no<\/email>https:\/\/www.nb.no\/sprakbanken\/<\/url><\/p>\n

P.O. Box 2674 Solli<\/address>\n

0203<\/zipCode>Oslo<\/city>Oslo<\/region>Norway<\/country><\/communicationInfo><\/actorInfo><\/contact>2021-10-29<\/metadataCreationDate>English<\/metadataLanguageName>en<\/metadataLanguageId>2023-08-08<\/metadataLastDateUpdated>person<\/actorType>Metadata Creator<\/role>Lindstad<\/surname>Arne Martinus<\/givenName>Nasjonalbiblioteket<\/organizationName>National Library of Norway<\/organizationName>NB<\/organizationShortName>NLN<\/organizationShortName>Spr\u00e5kbanken<\/departmentName>The Language Bank<\/departmentName><\/organizationInfo><\/affiliation><\/personInfo>sprakbanken@nb.no<\/email>https:\/\/www.nb.no\/sprakbanken\/<\/url><\/p>\n

P.O. Box 2674 Solli<\/address>\n

0203<\/zipCode>Oslo<\/city>Oslo<\/region>Norway<\/country><\/communicationInfo><\/actorInfo><\/metadataCreator><\/metadataInfo>2021<\/version>2021-10-28<\/lastDateUpdated><\/versionInfo>documentation<\/role>Documentation files in English and Norwegian. Metadata files accompanying the data.<\/documentUnstructured><\/documentationUnstructured><\/resourceDocumentationInfo>2021-06-01<\/creationStartDate>2021-10-28<\/creationEndDate>person<\/actorType>Resource Creator<\/role>Birkenes<\/surname>Magnus Breder<\/givenName>Nasjonalbiblioteket<\/organizationName>National Library of Norway<\/organizationName>NB<\/organizationShortName>NLN<\/organizationShortName>Spr\u00e5kbanken<\/departmentName>The Language Bank<\/departmentName><\/organizationInfo><\/affiliation><\/personInfo>sprakbanken@nb.no<\/email>https:\/\/www.nb.no\/sprakbanken\/<\/url><\/p>\n

P.O. Box 2674 Solli<\/address>\n

0203<\/zipCode>Oslo<\/city>Oslo<\/region>Norway<\/country><\/communicationInfo><\/actorInfo>person<\/actorType>Rsource Creator<\/role>Johnsen<\/surname>Lars<\/givenName>Nasjonalbiblioteket<\/organizationName>National Library of Norway<\/organizationName>NB<\/organizationShortName>NLN<\/organizationShortName>Spr\u00e5kbanken<\/departmentName>The Language Bank<\/departmentName><\/organizationInfo><\/affiliation><\/personInfo>sprakbanken@nb.no<\/email>https:\/\/www.nb.no\/sprakbanken\/<\/url><\/p>\n

P.O. Box 2674 Solli<\/address>\n

0203<\/zipCode>Oslo<\/city>Oslo<\/region>Norway<\/country><\/communicationInfo><\/actorInfo><\/resourceCreator><\/resourceCreationInfo><\/resourceCommonInfo>Ngram Corpus<\/corpusType>textNgram<\/mediaType>word<\/baseItem>3<\/order><\/ngramInfo>text\/csv<\/mimeType>8<\/size>files<\/sizeUnit><\/sizeInfo>42,1<\/size>gb<\/sizeUnit><\/sizeInfo>121834422207<\/size>tokens<\/sizeUnit><\/sizeInfo><\/sizePerTextFormat><\/textFormatInfo>application\/json<\/mimeType>1<\/size>files<\/sizeUnit><\/sizeInfo>18<\/size>kb<\/sizeUnit><\/sizeInfo><\/sizePerTextFormat><\/textFormatInfo>UTF-8<\/characterEncoding><\/characterEncodingInfo><\/corpusTextNgramInfo><\/corpusPartInfo>multilingual<\/lingualityType>other<\/multilingualityType>Independent text in several languages<\/multilingualityTypeDetails><\/lingualityInfo>nb<\/languageId>Norwegian Bokm\u00e5l<\/languageName><\/languageInfo>nn<\/languageId>Norwegian Nynorsk<\/languageName><\/languageInfo>se<\/languageId>Northern Sami<\/languageName><\/languageInfo>sma<\/languageId>Southern Sami<\/languageName><\/languageInfo>smj<\/languageId>Lule Sami<\/languageName><\/languageInfo>fkv<\/languageId>Kven<\/languageName><\/languageInfo>writtenLanguage<\/modalityType>Text from digitized books and newspapers.<\/modalityTypeDetails>121834422207<\/size>tokens<\/sizeUnit><\/sizeInfo>3980000<\/size>texts<\/sizeUnit><\/sizeInfo><\/sizePerModality><\/modalityInfo>121834422207<\/size>tokens<\/sizeUnit><\/sizeInfo>3980000<\/size>texts<\/sizeUnit><\/sizeInfo>1800-2021<\/timeCoverage><\/timeCoverageInfo><\/corpusPartGeneralInfo><\/corpusInfo><\/corpusProfile><\/Components><\/CMD><\/metadata><\/record><\/p>\n","protected":false},"template":"","categories":[],"tags":[],"language-resource-type":[7572],"language-resource-origin":[8313],"class_list":["post-31507","language-resource","type-language-resource","status-publish","hentry"],"yoast_head":"\nN-grams from NBdigital 2021 - Spr\u00e5kbanken<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/\" \/>\n<meta property=\"og:locale\" content=\"nb_NO\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"N-grams from NBdigital 2021\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/\" \/>\n<meta property=\"og:site_name\" content=\"Spr\u00e5kbanken\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-10T09:55:54+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Ansl. lesetid\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutter\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/\",\"name\":\"N-grams from NBdigital 2021 - Spr\u00e5kbanken\",\"isPartOf\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\"},\"datePublished\":\"2025-02-10T09:39:05+00:00\",\"dateModified\":\"2025-02-10T09:55:54+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/#breadcrumb\"},\"inLanguage\":\"nb-NO\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Resources from the resource bank\",\"item\":\"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"N-grams from NBdigital 2021\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.nb.no\/sprakbanken\/#website\",\"url\":\"https:\/\/www.nb.no\/sprakbanken\/\",\"name\":\"Spr\u00e5kbanken\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nb-NO\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"N-grams from NBdigital 2021 - Spr\u00e5kbanken","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/","og_locale":"nb_NO","og_type":"article","og_title":"N-grams from NBdigital 2021","og_url":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/","og_site_name":"Spr\u00e5kbanken","article_modified_time":"2025-02-10T09:55:54+00:00","twitter_card":"summary_large_image","twitter_misc":{"Ansl. lesetid":"4 minutter"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/","url":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/","name":"N-grams from NBdigital 2021 - Spr\u00e5kbanken","isPartOf":{"@id":"https:\/\/www.nb.no\/sprakbanken\/#website"},"datePublished":"2025-02-10T09:39:05+00:00","dateModified":"2025-02-10T09:55:54+00:00","breadcrumb":{"@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/#breadcrumb"},"inLanguage":"nb-NO","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/oai-nb-no-sbr-70\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.nb.no\/sprakbanken\/"},{"@type":"ListItem","position":2,"name":"Resources from the resource bank","item":"https:\/\/www.nb.no\/sprakbanken\/en\/resource-catalogue\/"},{"@type":"ListItem","position":3,"name":"N-grams from NBdigital 2021"}]},{"@type":"WebSite","@id":"https:\/\/www.nb.no\/sprakbanken\/#website","url":"https:\/\/www.nb.no\/sprakbanken\/","name":"Spr\u00e5kbanken","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nb.no\/sprakbanken\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nb-NO"}]}},"lang":"en","translations":{"nb":31501,"en":31507},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource\/31507","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource"}],"about":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/types\/language-resource"}],"wp:attachment":[{"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/media?parent=31507"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/categories?post=31507"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/tags?post=31507"},{"taxonomy":"language-resource-type","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-type?post=31507"},{"taxonomy":"language-resource-origin","embeddable":true,"href":"https:\/\/www.nb.no\/sprakbanken\/wp-json\/wp\/v2\/language-resource-origin?post=31507"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}