This resource contains n-grams – i.e. uni-, bi- and trigrams – from all books and newspapers that had been digitized at the National Library of Norway up to July 15 2022. The n-grams have been extracted from a material consisting of approximately 610,000 books and 4,000,000 newspapers, amounting to a total of 138.5 billion tokens (words and punctuation). The file format is UTF-8-encoded CSV.
Columns in the n-gram CSV files:
– first – the first word (in uni-, bi- and trigrams)
– second – the second word (in bi- and trigrams)
– third – the third word (in trigrams)
– lang – the language of the n-gram (only for books, the newspapers have no language classification as yet)
– freq – the total frequency of the n-gram in the collection of books and newspapers
– json – a dictionary with raw frequency for each year
totals.json contains aggregated frequencies per year in the book and newspaper corpora. Using them, relative frequencies can be calculated in order to compare frequencies over time as in NB N-gram.
metadata-digibok.csv and metadata-digavis.csv contain simple metadata for the books and newspapers. More extensive metadata can be obtained through Oria or the APIs at https://api.nb.no/.
See the documentation files for further information.
This resource contains n-grams – i.e. uni-, bi- and trigrams – from all books and newspapers that had been digitized at the National Library of Norway up to July 15 2022. The n-grams have been extracted from a material consisting of approximately 610,000 books and 4,000,000 newspapers, amounting to a total of 138.5 billion tokens (words and punctuation). The file format is UTF-8-encoded CSV.
Columns in the n-gram CSV files:
– first – the first word (in uni-, bi- and trigrams)
– second – the second word (in bi- and trigrams)
– third – the third word (in trigrams)
– lang – the language of the n-gram (only for books, the newspapers have no language classification as yet)
– freq – the total frequency of the n-gram in the collection of books and newspapers
– json – a dictionary with raw frequency for each year
totals.json contains aggregated frequencies per year in the book and newspaper corpora. Using them, relative frequencies can be calculated in order to compare frequencies over time as in NB N-gram.
metadata-digibok.csv and metadata-digavis.csv contain simple metadata for the books and newspapers. More extensive metadata can be obtained through Oria or the APIs at https://api.nb.no/.
See the documentation files for further information.
Extended metadata
resource Common Info:
resource Type: corpus
identification Info:
resource Name: N-grammer fra NBdigital 2022
resource Name: N-grams from NBdigital 2022
description: Dette korpuset inneholder n-grammer – uni-, bi- og trigrammer – fra alle bøker og aviser som var blitt digitalisert ved Nasjonalbiblioteket per 15. juli 2022. N-grammene er laget på basis av et materiale bestående av om lag 610.000 bøker og 4.000.000 avishefter, til sammen ca. 138,5 milliarder "tokens" (ord og tegnsetting). Filformatet er UTF-8-kodert CSV.
Kolonnene i CSV-filene med n-grammer er som følger:
– first – det første ordet i n-grammet (i uni-, bi- og trigram)
– second – det andre ordet i n-grammet (i bi- og trigram)
– third – det tredje ordet i n-grammet (i trigram)
– lang – språkkode for n-grammet (gjelder kun bøker, avisene har ingen språkklassifikasjon per nå)
– freq – den totale frekvensen for n-grammet i samlingen av bøker eller aviser
– json – et dictionary med råfrekvens per år
totals.json inneholder totalfrekvenser innenfor årganger i hhv. bok- og avismaterialet. Med disse kan man lett regne ut relativfrekvenser for sammenligning på tvers av år som i NB N-gram.
metadata-digibok.csv og metadata-digavis.csv inneholder enkle metadata for alle bøkene og avisene som inngår i bok- og aviskorpuset. Hvis du er interessert i mer utførlige metadata, henviser vi til Oria eller NBs APIer under https://api.nb.no/.
Se dokumentasjonsfilene for mer informasjon.
description: This resource contains n-grams – i.e. uni-, bi- and trigrams – from all books and newspapers that had been digitized at the National Library of Norway up to July 15 2022. The n-grams have been extracted from a material consisting of approximately 610,000 books and 4,000,000 newspapers, amounting to a total of 138.5 billion tokens (words and punctuation). The file format is UTF-8-encoded CSV.
Columns in the n-gram CSV files:
– first – the first word (in uni-, bi- and trigrams)
– second – the second word (in bi- and trigrams)
– third – the third word (in trigrams)
– lang – the language of the n-gram (only for books, the newspapers have no language classification as yet)
– freq – the total frequency of the n-gram in the collection of books and newspapers
– json – a dictionary with raw frequency for each year
totals.json contains aggregated frequencies per year in the book and newspaper corpora. Using them, relative frequencies can be calculated in order to compare frequencies over time as in NB N-gram.
metadata-digibok.csv and metadata-digavis.csv contain simple metadata for the books and newspapers. More extensive metadata can be obtained through Oria or the APIs at https://api.nb.no/.
See the documentation files for further information.
multilinguality Type Details: N-grams extracted from text in several languages. Text from digitized books of varying genre and newspapers.
language Info:
language Id: nb
language Name: Norwegian Bokmål
language Info:
language Id: nn
language Name: Norwegian Nynorsk
language Info:
language Id: se
language Name: Northern Sami
language Info:
language Id: sma
language Name: Southern Sami
language Info:
language Id: smj
language Name: Lule Sami
language Info:
language Id: fkv
language Name: Kven
modality Info:
modality Type: writtenLanguage
modality Type Details: Text from digitized books and newspapers.
size Per Modality:
size Info:
size: 138446410995
size Unit: tokens
size Info:
size: 4610000
size Unit: other
size Info:
size: 138446410995
size Unit: tokens
size Info:
size: 4610000
size Unit: other
time Coverage Info:
time Coverage: 1800-2022
dc:type
corpus
dc:title
N-grams from NBdigital 2022
dc:identifier
oai:nb.no:sbr-76
dc:description
This resource contains n-grams – i.e. uni-, bi- and trigrams – from all books and newspapers that had been digitized at the National Library of Norway up to July 15 2022. The n-grams have been extracted from a material consisting of approximately 610,000 books and 4,000,000 newspapers, amounting to a total of 138.5 billion tokens (words and punctuation). The file format is UTF-8-encoded CSV.
Columns in the n-gram CSV files:
– first – the first word (in uni-, bi- and trigrams)
– second – the second word (in bi- and trigrams)
– third – the third word (in trigrams)
– lang – the language of the n-gram (only for books, the newspapers have no language classification as yet)
– freq – the total frequency of the n-gram in the collection of books and newspapers
– json – a dictionary with raw frequency for each year
totals.json contains aggregated frequencies per year in the book and newspaper corpora. Using them, relative frequencies can be calculated in order to compare frequencies over time as in NB N-gram.
metadata-digibok.csv and metadata-digavis.csv contain simple metadata for the books and newspapers. More extensive metadata can be obtained through Oria or the APIs at https://api.nb.no/.
See the documentation files for further information.