Interpretation is still key:
A discussion of topic modeling in the Digital Humanities
Derek Bridge
Insight Centre for Data Analytics
Department of Computer Science, UCC
Selected Biography
Within the Insight Centre, I lead the Recommender Systems Group
Some of my work with text:
PhD in computational linguistics
Machine learning of grammar
Text classification: spam vs. ham, posts to forums
Text extraction: for auto-suggestions
Topic modeling: context in customer reviews
Topic Modeling
automatically discover hidden thematic structure in large collections of texts
to theorise about a corpus; to summarize, visualize and explore it
Martha's Diary
Martha Ballard — a Maine midwife
10,000 diary entries from January 1, 1785 to May 12, 1812
Laurel Thatcher Ulrich (1990). A Midwife's Tale: The Life of Martha Ballard, Based on Her Diary,
1785-1812
Premarital pregnancy (14 entries, 1788 - 1792)
Scarlet fever epidemic (88 entries, June 1787 - October 1787)
…
March 30 - April 8, 1785
Cameron Blevins's Blog
(http://www.cameronblevins.org/posts/topic-modelingmartha-ballards-diary/)
Robert R. McCausland and Cynthia MacAlman McCausland — transcribed the diary
web pages: http://dohistory.org/diary/index.html (http://dohistory.org/diary/index.html)
Blevin used Mallet (http://mallet.cs.umass.edu/index.php) to apply Latent Dirichlet Allocation
Blevins's Topics (30 in all)
MIDWIFERY: birth deld safe morn receivd calld left cleverly pm labour fine reward arivd infant
expected recd shee born patient
CHURCH: meeting attended afternoon reverend worship foren mr famely performd vers attend
public supper st service lecture discoarst administred supt
DEATH: day yesterday informd morn years death ye hear expired expird weak dead las past heard
days drowned departed evinn
GARDENING: gardin sett worked clear beens corn warm planted matters cucumbers gatherd
potatoes plants ou sowd door squash wed seeds
SHOPPING: lb made brot bot tea butter sugar carried oz chees pork candles wheat store pr beef
spirit churnd flower
ILLNESS: unwell mr sick gave dr rainy easier care head neighbor feet relief made throat poorly
takeing medisin ts stomach
HOUSEWORK: house work clear knit wk home wool removd washing kinds pickt helping banking
chips taxes picking cleaning pikt pails
HOUSEWORK: home clear washt baked cloaths helped washing wash girls pies cleand things
room bak kitchen ironed apple seller scolt
EMOTION: feel husband unwel warm feeble felt god great fatagud fatagued thro life time year dear
rose famely bu good
Martha's Diary: Live Example
Downloaded 1430 diary web pages
Extracted 10,000 diary entries
Apply a form of topic modeling
In [4]:
s = random.randint(1000, 2000)
nmf('martha', num_topics=30, num_words=20, seed=s)
04/04/2017 13:54
INFO
Using random seed 1569
04/04/2017 13:54
INFO
Applying NMF (k=30, runs=1, seed=1569,
init_strategy=random) ...
04/04/2017 13:54
INFO
NMF run 1/1 (k=30, max_iters=100)
04/04/2017 13:54
INFO
Applying NMF to matrix of size 9623 X
1031 ...
04/04/2017 13:54
INFO
Generated 1 ensemble members
04/04/2017 13:54
INFO
Loading term rankings from models/nmf_
martha_k30_1569/ranks_1569_001.pkl ...
04/04/2017 13:54
INFO
Model has 30 rankings covering 1031 te
rms
04/04/2017 13:54
INFO
Loading term rankings from models/nmf_
martha_k30_1569/ranks_1569_001.pkl ...
04/04/2017 13:54
INFO
Model has 30 rankings covering 1031 te
rms
C01 : wife, childn, savage, capt, calld, go, james, allso, labour, c
lear, saml, dind, gill, travil, isaac, boltons, evn, wilm, benn, cow
ens
C02 : wk, hous, knit, done, sleep, wm, washing, clear, mended, sleep
s, epm, farewel, le, faett, matters, wel, lambd, jonas, husband, bro
t
C03 : home, clear, ballard, dolly, returnd, pleast, brot, ephm, surv
eying, left, gone, hannah, dind, savage, hook, house, rainy, makein
g, moore, capt
C04 : deld, left, safe, child, cleverly, pm, returnd, shee, morn, fi
ne, labour, arivd, receivd, expected, evn, patient, reward, calld, c
omfortable, tarried
C05 : washt, sally, girls, clear, room, kitchen, cloaths, floors, ch
urch, hannah, bed, ballard, bakt, dolly, buttery, paid, scourd, fare
wel, cleand, north
C06 : jona, junr, sleeps, ephm, sleep, sons, childn, supt, dind, wm,
son, wives, clinton, luke, pierce, allso, wood, wilm, pleast, le
C07 : ye, hook, settlement, part, ballard, fort, river, got, gone, g
irls, field, death, put, informd, inst, north, bed, mill, side, door
C08 : snowd, evng, raind, spent, evn, haild, kniting, cloudy, befor
e, foren, ephm, little, knit, ironed, le, wood, cleard, cloaths, fae
tt, knitt
C09 : cyrus, ballard, coart, mill, hepsy, wood, pittstn, wool, got,
phillip, brot, informd, carried, fort, ebenz, ephm, sheep, tend, fa
ther, settlement
C10 : day, part, rainy, raind, clear, old, unwel, seen, ys, hannah,
spent, apples, says, smith, little, yesterday, cut, fast, shee, fin
e
C11 : lb, brot, bot, butter, sugar, sent, oz, flax, wd, pork, chees,
bakt, candles, spirit, wool, churnd, bread, snuff, paid, ballard
C12 : feel, fatagued, washing, feeble, fatagud, wish, unwel, clear,
comfortable, better, warm, bakt, done, felt, cool, wel, god, littl
e, pain, matters
C13 : cloudy, rain, snow, foren, aftn, ballard, began, evn, thunder,
little, morn, turns, home, wind, misty, aftern, gone, unwel, mendin
g, apples
C14 : went, dolly, hannah, pollards, ballard, hook, girls, sally, fo
ster, clear, westons, bed, barton, warm, hamlins, polly, capt, sons,
find, better
C15 : dagt, pollard, lambd, ballard, childn, lambart, clear, allso,
mrss, lambard, sleep, shee, sons, comfortable, gill, allin, rhoda,
capin, sent, dagts
C16 : work, done, hous, house, doing, clear, helpt, bakt, various, k
inds, ballard, warm, knitt, spun, cut, cleand, paid, watson, gardin,
apples
C17 : see, calld, shee, find, mrss, go, better, sick, clear, gave, l
abour, ill, doct, evn, lady, pain, women, infant, low, comfortable
C18 : meeting, ballard, revd, stone, fm, vers, ephm, discoarst, clea
r, performd, parker, luke, text, john, supper, lambd, parrish, inter
mition, communion, supt
C19 : night, tarried, till, raind, before, ill, patient, slept, wome
n, thro, severe, tarrie, tarries, rest, watcht, sick, pain, storm, c
lear, alone
C20 : cold, clear, windy, wood, ballard, old, implied, washing, brow
n, load, makeing, savages, waid, evn, kniting, snow, got, savage, sp
ent, hepsy
C21 : finisht, pair, hoes, began, stockins, kniting, mended, mitts,
makeing, self, cyruss, stockin, ballards, knitt, ballard, washing,
corn, yarn, footing, mending
C22 : sett, sun, little, plants, till, before, go, able, cabbage, go
t, clinton, houghd, turnips, noon, shone, survey, bed, french, winsl
ow, reacht
C23 : unwell, rainy, felt, pollards, shee, little, polly, day, infor
ms, evn, savage, dolly, jon, betsy, throat, foster, jono, sent, haml
in, ditoes
C24 : aftern, attended, worship, foren, public, famely, self, revd,
performd, funeral, clear, attend, interd, shower, vers, pleast, for
enn, service, remains, john
C25 : ys, morn, day, savage, polly, aftn, foster, aftern, eving, evi
nng, clok, informd, yt, gone, rainy, expired, frost, doct, interd, c
apt
C26 : son, jonas, pollards, lambd, lambds, ephms, ephm, conducted, l
ambard, lambards, towns, famely, jon, clear, allin, babe, sist, fare
wel, wel, sick
C27 : gardin, workt, planted, warm, beens, clear, ballard, cucumber
s, sowd, wed, corn, squash, seeds, peas, ephm, gatherd, sleeps, fore
n, houghd, potatoes
C28 : town, sleeps, polly, famely, coart, pitts, patty, son, ezra, l
eft, gone, informs, lucy, sherebiah, esqr, men, clear, dind, towns,
flax
C29 : came, barton, conducted, sally, doct, sister, evn, left, home,
slept, go, gill, help, betsy, polly, husband, allin, tarries, lambar
t, child
C30 : took, tea, dind, breakfast, pierce, mrss, drank, barton, clea
r, allso, sister, farewel, sally, jonas, wiman, ballard, pleast, ol
d, lady, james
The Diary of Samuel Pepys: Live Example
Downloaded from Project Gutenberg (http://www.gutenberg.org/cache/epub/3331/pg3331.html)
Extracted 2005 diary entries
Apply a form of topic modeling
In [5]:
s = random.randint(1000, 2000)
nmf('pepys', num_topics=30, num_words=20, seed=s)
04/04/2017 13:56
INFO
Using random seed 1730
04/04/2017 13:56
INFO
Applying NMF (k=30, runs=1, seed=1730,
init_strategy=random) ...
04/04/2017 13:56
INFO
NMF run 1/1 (k=30, max_iters=100)
04/04/2017 13:56
INFO
Applying NMF to matrix of size 1997 X
1054 ...
04/04/2017 13:56
INFO
Generated 1 ensemble members
04/04/2017 13:56
INFO
Loading term rankings from models/nmf_
pepys_k30_1730/ranks_1730_001.pkl ...
04/04/2017 13:56
INFO
Model has 30 rankings covering 1054 te
rms
04/04/2017 13:56
INFO
Loading term rankings from models/nmf_
pepys_k30_1730/ranks_1730_001.pkl ...
04/04/2017 13:56
INFO
Model has 30 rankings covering 1054 te
rms
C01 : king, france, told, court, give, given, castlemaine, england,
spain, coming, send, promise, put, before, says, yesterday, flander
s, people, little, going
C02 : wife, picture, mighty, home, pretty, fine, cost, hewer, pepys,
having, put, think, work, mightily, gold, eyes, done, find, fashion,
tom
C03 : night, home, bed, coming, brought, hear, supped, fire, supper,
morrow, hewer, having, till, morning, rest, town, yesterday, before,
tell, boy
C04 : play, acted, playhouse, comedy, excellent, called, knipp, hous
e, tragedy, part, stage, pit, pretty, best, duke, sat, mightily, par
ts, full, done
C05 : queene, court, ladies, mother, hampton, duchesse, pierce, st,
pretty, castlemaine, somerset, monmouth, child, portugall, chapel,
montagu, chamber, brave, elizabeth, dressed
C06 : good, dinner, discourse, company, man, dined, sermon, noon, bi
shop, mighty, merry, college, pleased, home, things, pretty, garden,
fine, old, time
C07 : hall, white, westminster, walked, water, met, chapel, st, hear
d, park, gone, privy, seale, going, gallery, closet, montagu, walkin
g, parke, queen
C08 : money, pay, get, want, cost, paid, condition, shall, business,
war, time, forced, peace, having, seamen, called, spent, comes, trea
surer, present
C09 : went, coach, took, got, go, way, away, going, before, street,
clock, get, back, leave, lay, horse, boy, horses, place, thither
C10 : hath, says, tells, man, himself, thing, world, told, done, bel
ieve, peace, shall, think, tell, england, before, know, believes, th
inks, best
C11 : parliament, voted, monk, news, brought, soldiers, told, came,
afternoon, act, general, free, believe, lambert, met, sit, committe
e, chosen, members, crewe
C12 : see, people, strange, think, pretty, met, little, town, water,
thing, poor, mighty, young, mightily, sight, ill, man, body, room, s
ide
C13 : duke, york, buckingham, duchesse, wren, albemarle, business, j
ames, mightily, coventry, occasion, attended, st, prince, done, matt
er, middleton, thing, arlington, glad
C14 : lord, sandwich, montagu, crewe, sea, hinchingbroke, treasurer,
tangier, brouncker, letter, moore, place, dined, told, visit, done,
mayor, board, peterborough, carry
C15 : house, lords, commons, bill, hear, houses, act, westminster, v
ote, ordered, speech, coffee, voted, time, speaker, full, proceeding
s, brought, thing, desired
C16 : office, morning, afternoon, letter, sat, business, drawing, gl
ad, hewer, till, agreed, time, writing, went, comes, draw, board, lo
ng, making, busy
C17 : great, talk, content, deal, having, world, pleasure, tangier,
honour, man, small, trouble, danger, fear, mind, told, intend, joy,
troubles, coming
C18 : fleet, dutch, prince, news, go, rupert, portsmouth, dover, de,
french, abroad, smith, albemarle, gone, back, downes, fight, certai
n, going, sea
C19 : saw, theatre, before, time, comedy, acted, playhouse, done, we
nt, life, seen, woman, fine, part, little, go, best, things, believ
e, rochester
C20 : day, hear, fast, weather, letters, observed, boy, ordered, ag
o, london, go, princesse, yesterday, resolve, kept, hands, death, re
ceive, preach, die
C21 : god, blessed, knows, world, pray, heart, health, good, bless,
worth, estate, shall, accounts, fit, full, little, continue, makin
g, ends, keep
C22 : sir, coventry, pen, carteret, batten, minnes, business, brounc
ker, told, treasurer, himself, thomas, john, find, know, tell, rober
t, tells, tower, smith
C23 : ob, john, earl, william, charles, son, created, father, thoma
s, died, privy, daughter, sir, state, married, secretary, henry, ii,
brother, general
C24 : plague, week, dead, news, town, people, bill, fear, sick, ill,
sad, sickness, troubled, odd, street, fallen, buried, london, blesse
d, joy
C25 : church, sermon, paul, st, heard, read, sunday, preach, yard, p
reached, fellow, time, hear, poor, people, book, pleases, believe, s
treet, rochester
C26 : ships, men, dutch, ship, captain, war, taken, fire, guns, boar
d, news, chatham, river, fight, lost, killed, coming, hear, enemy, h
aving
C27 : lady, castlemaine, daughter, woman, ladies, wardrobe, court, t
ells, hinchingbroke, creed, married, handsome, child, sandwich, husb
and, dined, carteret, parke, week, coach
C28 : navy, things, charge, account, order, treasurer, council, cart
eret, shall, find, give, debt, officers, discourse, business, old, t
ime, present, content, coventry
C29 : city, monk, mayor, fire, london, street, people, town, told, h
ouses, streets, find, shut, members, soldiers, sad, ford, burned, co
uncil, general
C30 : chancellor, against, business, high, lord, things, council, lo
rds, told, himself, done, buckingham, bristoll, man, carried, concer
ned, till, commissioners, cause, understand
Latent Dirichlet Allocation
Next few slides taken from a talk by David Mimno, Cornell University
Video: https://vimeo.com/53080123 (https://vimeo.com/53080123)
Slides: https://mimno.infosci.cornell.edu/slides/details.pdf
(https://mimno.infosci.cornell.edu/slides/details.pdf)
An example document
Etruscan trade price temple market
Assign topics
3
2
1
3
1
Etruscan trade price temple market
Global statistics
1
2
3
Etruscan 1
0
35
market
50 0
1
price
42 1
0
temple
0
20
trade
10 8
…
… … …
0
1
Algorithm
Initialize topic assignments randomly
For each iteration:
For each document:
For each word:
Resample topic for word, given all other words and their current topic
assignments
Resample topic for “trade”
3
2
1
3
1
Etruscan trade price temple market
1
2
3
Etruscan 1
0
35
market
50 0
1
price
42 1
0
temple
0
20
trade
10 8
…
… … …
0
1
Remove current assignment
3
?
1
3
1
Etruscan trade price temple market
1
2
3
Etruscan 1
0
35
market
50 0
1
price
42 1
0
temple
0
20
trade
10 7
…
… … …
0
1
Which topics occur in this document?
3
?
1
3
1
Etruscan trade price temple market
Topic 1
Topic 2
Topic 3
Which topics ‘like’ the word “trade”?
3
?
1
3
1
Etruscan trade price temple market
Topic 1
Topic 2
Topic 3
Pick a topic for the word "trade"
3
?
1
3
1
Etruscan trade price temple market
Topic 1
Topic 2
Topic 3
The new assignment for “trade”
3
1
1
3
1
Etruscan trade price temple market
1
2
3
Etruscan 1
0
35
market
50 0
1
price
42 1
0
temple
0
20
trade
11 7
…
… … …
0
1
Software Usability
Why are some software systems more usable than others?
Donald A. Norman:
the gulf of execution
the gulf of evaluation
The Gulf of Execution
What is a document?
paragraphs? sections? chapters? whole books?
</li>
Which words are interesting?
stopwords? proper names?
</ul> </li>
What is a word anyway?
stemming? n-grams?
</ul> </li>
What values to use for the algorithm's parameters?
num topics, num iterations, smoothing parameters
</ul> </li>
Is LDA the right theory of text for you in the first place?
models that include syntax, time, topic hierarchies, authors,
authors' gender, geography, …
</ul> </li> </ul> [Some of the above from Mimno again]
The Gulf of Evaluation
The typical output lists the highest-probability words for each topic
birth deld safe morn receivd calld left cleverly …
But that's not the model! Something like this is:
1
2
3
Etruscan 1
0
35
market
50 0
1
price
42 1
0
temple
0
20
trade
11 7
…
… … …
0
1
Visualizing and Exploring the Model
Jason Chuang, Christopher D. Manning, Jeffrey Heer (2012).
Termite: Visualization Techniques for Assessing Textual Topic Models
Gulf of Evaluation
Confirmation bias?
Focusing on certain topics; ignoring others
Focusing on certain words within topics; ignoring others
How to measure topic model quality?
Gulf of Evaluation
It is little-understood that the algorithms are stochastic
Multiple runs on the same documents produce different topic models
low topic stability, esp. for longer documents
Two LDA Models for Martha's Diary
In [6]:
nmf('martha', num_topics=30, num_words=20, seed=seed1)
nmf('martha', num_topics=30, num_words=20, seed=seed2)
04/04/2017 14:17
INFO
Using random seed 1772
04/04/2017 14:17
INFO
Applying NMF (k=30, runs=1, seed=1772,
init_strategy=random) ...
04/04/2017 14:17
INFO
NMF run 1/1 (k=30, max_iters=100)
04/04/2017 14:17
INFO
Applying NMF to matrix of size 9623 X
1031 ...
04/04/2017 14:17
INFO
Generated 1 ensemble members
04/04/2017 14:17
INFO
Loading term rankings from models/nmf_
martha_k30_1772/ranks_1772_001.pkl ...
04/04/2017 14:17
INFO
Model has 30 rankings covering 1031 te
rms
04/04/2017 14:17
INFO
Loading term rankings from models/nmf_
martha_k30_1772/ranks_1772_001.pkl ...
04/04/2017 14:17
INFO
Model has 30 rankings covering 1031 te
rms
04/04/2017 14:17
INFO
Using random seed 1008
04/04/2017 14:17
INFO
Applying NMF (k=30, runs=1, seed=1008,
init_strategy=random) ...
04/04/2017 14:17
INFO
NMF run 1/1 (k=30, max_iters=100)
04/04/2017 14:17
INFO
Applying NMF to matrix of size 9623 X
1031 ...
C01 : son, jonas, pollards, lambds, lambd, ephms, lambard, famely, c
onducted, lambards, towns, clear, jon, babe, allin, sist, wel, farew
el, daugt, sick
C02 : shee, better, ill, pain, deld, paid, gave, seemd, brot, comfor
table, women, illness, wish, yesterday, pitts, rest, sic, little, th
ro, helpt
C03 : cloudy, rain, foren, snow, aftern, evng, aftn, raind, thunder,
evn, began, little, unwel, wind, turns, misty, sleep, home, apples,
aft
C04 : went, see, find, girls, bed, barton, warm, sons, hook, hamlin
s, aftern, sister, pollards, westons, clear, densmores, foster, bot,
savages, meddow
C05 : ye, hook, settlement, fort, river, girls, got, death, field, p
ut, informd, mill, inst, bed, side, ice, north, great, door, south
C06 : took, tea, dind, breakfast, pierce, barton, drank, sister, cle
ar, farewel, allso, jonas, sally, wiman, husband, martha, care, sis
t, james, smith
C07 : washt, sally, girls, room, kitchen, cloaths, clear, floors, ba
kt, feel, bed, house, church, buttery, cleand, scourd, west, helpt,
roome, paid
C08 : ephm, evng, supt, sleeps, sleep, sally, wood, sons, allin, med
dow, hay, patty, brot, dind, allso, son, cowen, jona, mill, wilm
C09 : ballard, surveying, coart, gone, clear, hook, survey, busines
s, returnd, house, makeing, james, meddow, settlement, hepsy, wood,
esqr, varsalboro, got, road
C10 : hous, done, work, wk, knit, clear, washing, bakt, house, doin
g, feel, helpt, various, mended, sleep, kinds, wm, warm, cut, matter
s
C11 : unwell, feel, felt, little, worship, clear, comfortable, polla
rds, fatagud, attended, famely, informs, evn, betsy, fatagued, work,
better, self, throat, rainy
C12 : dolly, hannah, pleast, polly, sally, savage, gone, clear, will
iams, pollards, foster, better, returnd, capt, pollard, hamlin, din
d, lady, cool, spun
C13 : left, deld, safe, child, returnd, cleverly, pm, morn, fine, la
bour, receivd, arivd, expected, patient, reward, evn, comfortable, i
nft, tarried, calld
C14 : night, tarried, raind, till, snowd, before, ill, patient, slep
t, women, thro, tarrie, severe, tarries, evn, rest, watcht, sick, pa
in, alone
C15 : came, evng, barton, conducted, doct, evn, sally, sister, go, l
eft, slept, gill, help, betsy, husband, spent, tarries, till, allin,
lambard
C16 : town, sleeps, famely, coart, polly, pitts, son, patty, ezra, l
eft, lucy, informs, clear, sherebiah, barton, sleep, esqr, men, din
d, learned
C17 : see, calld, find, go, labour, wife, sick, clear, doct, evn, ga
ve, better, ill, women, child, lady, infant, low, james, capt
C18 : finisht, pair, snowd, hoes, began, kniting, stockins, mended,
mitts, self, cyruss, stockin, makeing, knit, ballards, knitt, cyru
s, yarn, footing, soap
C19 : dagt, pollard, lambd, childn, lambart, clear, allso, lambard,
comfortable, sons, allin, sleep, gill, rhoda, aftern, sent, capin,
feeble, dagts, warm
C20 : gardin, workt, warm, planted, beens, clear, cucumbers, sowd, w
ed, corn, foren, squash, seeds, peas, gatherd, aftern, sleeps, feel,
houghd, matters
C21 : lb, brot, bot, butter, sugar, sent, oz, wd, pork, cyrus, flax,
chees, candles, wool, bakt, spirit, churnd, snuff, bread, beef
C22 : cold, clear, windy, knit, wood, washing, evng, implied, wk, w
m, old, unwel, snow, sleeps, load, brown, epm, savages, waid, sleep
C23 : sett, sun, little, plants, till, before, go, able, cabbage, cl
inton, got, houghd, turnips, noon, shone, french, bed, feel, survey,
reacht
C24 : wife, jona, childn, dind, junr, allso, sleep, evng, james, sup
t, wm, wilm, sons, clear, gill, bror, saml, spent, capt, savage
C25 : mrss, old, dingley, livermore, evn, aftern, warm, allso, clea
r, lady, foren, visit, hamlin, dingleys, capin, hepsy, burtun, dingl
y, jon, house
C26 : meeting, cyrus, revd, attended, stone, fm, vers, worship, perf
ormd, discoarst, aftern, foren, self, clear, public, famely, ballar
d, luke, parker, john
C27 : ys, morn, aftern, aftn, interd, clok, frost, evinng, informd,
expired, foren, eving, shower, yt, snowd, raind, got, foster, after
nn, remains
C28 : day, rainy, ys, old, spent, seen, raind, evng, snowd, unwel, f
ast, fine, little, polly, yesterday, savage, birth, foster, eving, p
ain
C29 : home, clear, cyrus, brot, returnd, work, left, house, conducte
d, dind, pleasant, snowd, implied, fatagud, feel, wrode, brought, do
ing, soap, knitt
C30 : part, clear, day, washing, childn, raind, apples, sleep, farew
el, cut, ye, better, unwel, jona, done, matters, pierce, smith, lamb
ard, sorted
04/04/2017 14:17
INFO
Generated 1 ensemble members
04/04/2017 14:17
INFO
Loading term rankings from models/nmf_
martha_k30_1008/ranks_1008_001.pkl ...
04/04/2017 14:17
INFO
Model has 30 rankings covering 1031 te
rms
04/04/2017 14:17
INFO
Loading term rankings from models/nmf_
martha_k30_1008/ranks_1008_001.pkl ...
04/04/2017 14:17
INFO
Model has 30 rankings covering 1031 te
rms
C01 : went, ballard, girls, see, hook, foster, find, bed, clear, wes
tons, warm, barton, hamlins, capt, sons, savages, pollards, sister,
meddow, densmores
C02 : unwell, feel, felt, little, pollards, fatagud, clear, informs,
betsy, comfortable, day, better, fatagued, cool, throat, polly, jon,
savage, jono, sent
C03 : morn, left, deld, safe, returnd, child, cleverly, pm, fine, ar
ivd, receivd, labour, expected, reward, ys, patient, inft, comfortab
le, patients, evn
C04 : town, sleeps, polly, coart, famely, pitts, patty, son, ezra, y
s, informs, lucy, gone, left, sherebiah, esqr, men, dind, barton, to
wns
C05 : washt, girls, kitchen, room, clear, cloaths, floors, bed, sall
y, bakt, ballard, feel, buttery, cleand, hepsy, scourd, roome, churc
h, west, north
C06 : see, calld, shee, find, mrss, go, labour, evn, better, ill, ga
ve, sick, clear, women, child, doct, lady, comfortable, pain, infant
C07 : home, ballard, clear, returnd, pleast, brot, surveying, cyrus,
left, savage, dind, house, hook, conducted, pleasant, mending, porte
r, mill, makeing, soap
C08 : ephm, supt, wood, meddow, hay, sleep, allin, sons, sleeps, din
d, patty, allso, ballard, brot, mill, cowen, son, conducted, lydia,
giting
C09 : dolly, sally, hannah, gone, polly, pollards, pollard, better,
wove, cocks, pleast, yds, sleep, williams, pitts, spun, clear, she
e, returnd, quillt
C10 : lb, brot, bot, butter, sugar, sent, oz, flax, wd, pork, chees,
cyrus, candles, bakt, wool, spirit, churnd, ballard, snuff, paid
C11 : rainy, day, apples, morn, ballard, cut, plants, drie, capt, ma
keing, remains, cleard, wool, kniting, skeins, spun, seller, jones,
sick, cutt
C12 : day, part, ys, raind, clear, old, unwel, seen, polly, hannah,
yesterday, washing, spent, says, fast, smith, little, felt, farewe
l, birth
C13 : cold, clear, windy, wood, ballard, washing, old, implied, make
ing, brown, load, savages, unwel, waid, feel, savage, got, evn, knit
ing, snow
C14 : night, tarried, till, raind, before, ill, sett, patient, slep
t, ys, severe, women, thro, tarrie, tarries, little, sick, rest, wat
cht, storm
C15 : dagt, pollard, lambd, ballard, childn, lambart, clear, allso,
mrss, lambard, comfortable, sleep, sons, gill, shee, allin, capin,
sent, rhoda, warm
C16 : aftern, foren, ys, morn, raind, shower, aftn, fm, fore, thunde
r, interd, forenn, vers, sett, showers, mrss, spent, text, remains,
helpt
C17 : son, jonas, pollards, lambd, lambds, ephms, lambard, conducte
d, lambards, towns, famely, jon, clear, babe, sist, allin, farewel,
wel, sick, daugt
C18 : attended, worship, public, famely, self, revd, performd, pleas
t, funeral, attend, clear, foster, intermition, john, divine, servic
e, interd, warm, williams, prayer
C19 : gardin, workt, sett, planted, warm, beens, clear, ballard, cuc
umbers, sowd, wed, corn, squash, plants, seeds, peas, houghd, gather
d, matters, potatoes
C20 : work, done, hous, house, clear, feel, helpt, doing, bakt, wash
ing, various, warm, kinds, ballard, knitt, feeble, spun, cut, cyrus,
coart
C21 : ye, hook, part, settlement, ballard, fort, river, got, gone, f
ield, death, informd, girls, put, mill, inst, north, bed, side, ice
C22 : took, tea, dind, breakfast, pierce, mrss, drank, clear, barto
n, allso, sister, farewel, jonas, wiman, ballard, old, pleast, husba
nd, lady, care
C23 : wife, savage, childn, calld, capt, go, james, allso, clear, di
nd, labour, saml, gill, isaac, travil, boltons, evn, wilm, benn, fos
ters
C24 : jona, junr, sleeps, childn, sons, sleep, supt, son, dind, clin
ton, wm, wives, luke, pierce, allso, pleast, wilm, wood, le, faett
C25 : came, barton, conducted, doct, sister, evn, go, left, slept, b
etsy, husband, gill, help, polly, till, tarries, allin, comfortable,
lambart, sick
C26 : wk, hous, knit, done, sleep, wm, clear, mended, washing, sleep
s, farewel, epm, le, faett, wel, lambd, husband, jonas, matters, bro
t
C27 : snowd, evng, raind, spent, evn, haild, cloudy, kniting, befor
e, knit, little, le, cleard, ironed, faett, wood, cloaths, knitt, ge
tchel, women
C28 : cloudy, rain, snow, aftn, morn, little, ballard, began, foren,
evn, thunder, turns, wind, misty, home, unwel, before, sett, gone, a
pples
C29 : finisht, pair, hoes, began, stockins, kniting, mended, mitts,
self, cyruss, makeing, stockin, washing, ballards, ballard, knitt,
corn, footing, cyrus, yarn
C30 : meeting, cyrus, ballard, revd, stone, fm, vers, discoarst, cle
ar, performd, luke, parker, supper, text, parrish, john, coart, psal
m, communion, go
In [7]:
compare_terms('models/nmf_martha_k30_' + str(seed1), 'models/nmf_martha_k30_' +
str(seed2), num_words=20)
C11 : attended, betsy, better, clear, comfortable, evn, famely, fa
tagud, fatagued, feel, felt, informs, little, pollards, rainy, self,
throat, unwell, work, worship
C02 : betsy, better, clear, comfortable, cool, day, fatagud, fatag
ued, feel, felt, informs, jon, jono, little, pollards, polly, savag
e, sent, throat, unwell
13
C26 : aftern, attended, ballard, clear, cyrus, discoarst, famely,
fm, foren, john, luke, meeting, parker, performd, public, revd, sel
f, stone, vers, worship
C30 : ballard, clear, coart, communion, cyrus, discoarst, fm, go,
john, luke, meeting, parker, parrish, performd, psalm, revd, stone,
supper, text, vers
13
C01 :
l, jon,
t, son,
C17 :
l, jon,
t, son,
20
allin,
jonas,
towns,
allin,
jonas,
towns,
babe, clear, conducted, daugt, ephms, famely, farewe
lambard, lambards, lambd, lambds, pollards, sick, sis
wel
babe, clear, conducted, daugt, ephms, famely, farewe
lambard, lambards, lambd, lambds, pollards, sick, sis
wel
C30 : apples, better, childn, clear, cut, day, done, farewel, jon
a, lambard, matters, part, pierce, raind, sleep, smith, sorted, unwe
l, washing, ye
C12 : birth, clear, day, farewel, fast, felt, hannah, little, old,
part, polly, raind, says, seen, smith, spent, unwel, washing, yester
day, ys
8
C23 : able, bed, before, cabbage, clinton, feel, french, go, got,
houghd, little, noon, plants, reacht, sett, shone, sun, survey, til
l, turnips
C14 : before, ill, little, night, patient, raind, rest, sett, seve
re, sick, slept, storm, tarrie, tarried, tarries, thro, till, watch
t, women, ys
4
C09 : ballard, business, clear, coart, esqr, gone, got, hepsy, hoo
k, house, james, makeing, meddow, returnd, road, settlement, survey,
surveying, varsalboro, wood
C07 : ballard, brot, clear, conducted, cyrus, dind, home, hook, ho
use, left, makeing, mending, mill, pleasant, pleast, porter, return
d, savage, soap, surveying
7
C24 : allso, bror, capt, childn, clear, dind, evng, gill, james, j
ona, junr, saml, savage, sleep, sons, spent, supt, wife, wilm, wm
C23 : allso, benn, boltons, calld, capt, childn, clear, dind, evn,
fosters, gill, go, isaac, james, labour, saml, savage, travil, wife,
wilm
11
C19 : aftern, allin, allso, capin, childn, clear, comfortable, dag
t, dagts, feeble, gill, lambard, lambart, lambd, pollard, rhoda, sen
t, sleep, sons, warm
C15 : allin, allso, ballard, capin, childn, clear, comfortable, da
gt, gill, lambard, lambart, lambd, mrss, pollard, rhoda, sent, shee,
sleep, sons, warm
17
C15 : allin, barton, betsy, came, conducted, doct, evn, evng, gil
l, go, help, husband, lambard, left, sally, sister, slept, spent, ta
rries, till
C25 : allin, barton, betsy, came, comfortable, conducted, doct, ev
n, gill, go, help, husband, lambart, left, polly, sick, sister, slep
t, tarries, till
16
C28 : birth, day, eving, evng, fast, fine, foster, little, old, pa
in, polly, raind, rainy, savage, seen, snowd, spent, unwel, yesterda
y, ys
C12 : birth, clear, day, farewel, fast, felt, hannah, little, old,
part, polly, raind, says, seen, smith, spent, unwel, washing, yester
day, ys
12
C07 : bakt, bed, buttery, church, cleand, clear, cloaths, feel, fl
oors, girls, helpt, house, kitchen, paid, room, roome, sally, scour
d, washt, west
C05 : bakt, ballard, bed, buttery, church, cleand, clear, cloaths,
feel, floors, girls, hepsy, kitchen, north, room, roome, sally, scou
rd, washt, west
17
C12 : better, capt, clear, cool, dind, dolly, foster, gone, hamli
n, hannah, lady, pleast, pollard, pollards, polly, returnd, sally, s
avage, spun, williams
C09 : better, clear, cocks, dolly, gone, hannah, pitts, pleast, po
llard, pollards, polly, quillt, returnd, sally, shee, sleep, spun, w
illiams, wove, yds
13
C14 : alone, before, evn, ill, night, pain, patient, raind, rest,
severe, sick, slept, snowd, tarrie, tarried, tarries, thro, till, w
atcht, women
C14 : before, ill, little, night, patient, raind, rest, sett, seve
re, sick, slept, storm, tarrie, tarried, tarries, thro, till, watch
t, women, ys
16
C13 : arivd, calld, child, cleverly, comfortable, deld, evn, expec
ted, fine, inft, labour, left, morn, patient, pm, receivd, returnd,
reward, safe, tarried
C03 : arivd, child, cleverly, comfortable, deld, evn, expected, fi
ne, inft, labour, left, morn, patient, patients, pm, receivd, return
d, reward, safe, ys
18
C21 : bakt, beef, bot, bread, brot, butter, candles, chees, churn
d, cyrus, flax, lb, oz, pork, sent, snuff, spirit, sugar, wd, wool
C10 : bakt, ballard, bot, brot, butter, candles, chees, churnd, cy
rus, flax, lb, oz, paid, pork, sent, snuff, spirit, sugar, wd, wool
18
C25 : aftern, allso, burtun, capin, clear, dingley, dingleys, ding
ly, evn, foren, hamlin, hepsy, house, jon, lady, livermore, mrss, ol
d, visit, warm
C15
:
allin, allso, ballard, capin, childn, clear, comfortable, da
C15 : allin, allso, ballard, capin, childn, clear, comfortable, da
gt, gill, lambard, lambart, lambd, mrss, pollard, rhoda, sent, shee,
sleep, sons, warm
5
C16 : barton, clear, coart, dind, esqr, ezra, famely, informs, lea
rned, left, lucy, men, patty, pitts, polly, sherebiah, sleep, sleep
s, son, town
C04 : barton, coart, dind, esqr, ezra, famely, gone, informs, lef
t, lucy, men, patty, pitts, polly, sherebiah, sleeps, son, town, tow
ns, ys
17
C04 : aftern, barton, bed, bot, clear, densmores, find, foster, gi
rls, hamlins, hook, meddow, pollards, savages, see, sister, sons, wa
rm, went, westons
C01 : ballard, barton, bed, capt, clear, densmores, find, foster,
girls, hamlins, hook, meddow, pollards, savages, see, sister, sons,
warm, went, westons
18
C06 : allso, barton, breakfast, care, clear, dind, drank, farewel,
husband, james, jonas, martha, pierce, sally, sist, sister, smith, t
ea, took, wiman
C22 : allso, ballard, barton, breakfast, care, clear, dind, drank,
farewel, husband, jonas, lady, mrss, old, pierce, pleast, sister, te
a, took, wiman
15
C22 : brown, clear, cold, epm, evng, implied, knit, load, old, sav
ages, sleep, sleeps, snow, unwel, waid, washing, windy, wk, wm, wood
C13 : ballard, brown, clear, cold, evn, feel, got, implied, knitin
g, load, makeing, old, savage, savages, snow, unwel, waid, washing,
windy, wood
13
C03 : aft, aftern, aftn, apples, began, cloudy, evn, evng, foren,
home, little, misty, rain, raind, sleep, snow, thunder, turns, unwe
l, wind
C28 : aftn, apples, ballard, before, began, cloudy, evn, foren, go
ne, home, little, misty, morn, rain, sett, snow, thunder, turns, unw
el, wind
15
C02 : better, brot, comfortable, deld, gave, helpt, ill, illness,
little, paid, pain, pitts, rest, seemd, shee, sic, thro, wish, wome
n, yesterday
C06 : better, calld, child, clear, comfortable, doct, evn, find, g
ave, go, ill, infant, labour, lady, mrss, pain, see, shee, sick, wom
en
7
C20 : aftern, beens, clear, corn, cucumbers, feel, foren, gardin,
gatherd, houghd, matters, peas, planted, seeds, sleeps, sowd, squas
h, warm, wed, workt
C19 : ballard, beens, clear, corn, cucumbers, gardin, gatherd, hou
ghd, matters, peas, planted, plants, potatoes, seeds, sett, sowd, sq
uash, warm, wed, workt
16
C17
:
better, calld, capt, child, clear, doct, evn, find, gave, g
C17 : better, calld, capt, child, clear, doct, evn, find, gave, g
o, ill, infant, james, labour, lady, low, see, sick, wife, women
C06 : better, calld, child, clear, comfortable, doct, evn, find, g
ave, go, ill, infant, labour, lady, mrss, pain, see, shee, sick, wom
en
16
C05 : bed, death, door, field, fort, girls, got, great, hook, ice,
informd, inst, mill, north, put, river, settlement, side, south, ye
C21 : ballard, bed, death, field, fort, girls, gone, got, hook, ic
e, informd, inst, mill, north, part, put, river, settlement, side, y
e
17
C08 : allin, allso, brot, cowen, dind, ephm, evng, hay, jona, medd
ow, mill, patty, sally, sleep, sleeps, son, sons, supt, wilm, wood
C08 : allin, allso, ballard, brot, conducted, cowen, dind, ephm, g
iting, hay, lydia, meddow, mill, patty, sleep, sleeps, son, sons, su
pt, wood
16
C10 : bakt, clear, cut, doing, done, feel, helpt, hous, house, kin
ds, knit, matters, mended, sleep, various, warm, washing, wk, wm, wo
rk
C20 : bakt, ballard, clear, coart, cut, cyrus, doing, done, feebl
e, feel, helpt, hous, house, kinds, knitt, spun, various, warm, wash
ing, work
14
C27 : aftern, afternn, aftn, clok, eving, evinng, expired, foren,
foster, frost, got, informd, interd, morn, raind, remains, shower,
snowd, ys, yt
C16 : aftern, aftn, fm, fore, foren, forenn, helpt, interd, morn,
mrss, raind, remains, sett, shower, showers, spent, text, thunder,
vers, ys
9
C29 : brot, brought, clear, conducted, cyrus, dind, doing, fatagu
d, feel, home, house, implied, knitt, left, pleasant, returnd, snow
d, soap, work, wrode
C07 : ballard, brot, clear, conducted, cyrus, dind, home, hook, ho
use, left, makeing, mending, mill, pleasant, pleast, porter, return
d, savage, soap, surveying
11
C18 : ballards, began, cyrus, cyruss, finisht, footing, hoes, kni
t, kniting, knitt, makeing, mended, mitts, pair, self, snowd, soap,
stockin, stockins, yarn
C29 : ballard, ballards, began, corn, cyrus, cyruss, finisht, foot
ing, hoes, kniting, knitt, makeing, mended, mitts, pair, self, stock
in, stockins, washing, yarn
17
13.633333333333333
Two LDA Models for the Diary of Samuel Pepys
In [8]:
nmf('pepys', num_topics=30, num_words=20, seed=seed1)
nmf('pepys', num_topics=30, num_words=20, seed=seed2)
04/04/2017 14:18
INFO
Using random seed 1772
04/04/2017 14:18
INFO
Applying NMF (k=30, runs=1, seed=1772,
init_strategy=random) ...
04/04/2017 14:18
INFO
NMF run 1/1 (k=30, max_iters=100)
04/04/2017 14:18
INFO
Applying NMF to matrix of size 1997 X
1054 ...
04/04/2017 14:18
INFO
Generated 1 ensemble members
04/04/2017 14:18
INFO
Loading term rankings from models/nmf_
pepys_k30_1772/ranks_1772_001.pkl ...
04/04/2017 14:18
INFO
Model has 30 rankings covering 1054 te
rms
04/04/2017 14:18
INFO
Loading term rankings from models/nmf_
pepys_k30_1772/ranks_1772_001.pkl ...
04/04/2017 14:18
INFO
Model has 30 rankings covering 1054 te
rms
04/04/2017 14:18
INFO
Using random seed 1008
04/04/2017 14:18
INFO
Applying NMF (k=30, runs=1, seed=1008,
init_strategy=random) ...
04/04/2017 14:18
INFO
NMF run 1/1 (k=30, max_iters=100)
04/04/2017 14:18
INFO
Applying NMF to matrix of size 1997 X
1054 ...
C01 : king, france, told, court, given, castlemaine, england, comin
g, send, spain, give, promise, yesterday, put, flanders, tells, say
s, before, little, charles
C02 : good, dinner, company, discourse, man, sermon, dined, bishop,
noon, old, pleased, god, college, things, time, chapel, merry, pret
ty, give, home
C03 : ships, men, dutch, fire, war, taken, captain, guns, news, los
t, chatham, river, burned, enemy, killed, fight, coming, sail, havin
g, away
C04 : lord, sandwich, chancellor, montagu, crewe, treasurer, hinchin
gbroke, tangier, brouncker, moore, told, sea, dined, visit, busines
s, place, peterborough, ashly, glad, barkeley
C05 : night, home, fire, bed, coming, supper, supped, brought, morro
w, hewer, having, till, morning, town, rest, boy, got, tell, came, s
et
C06 : sir, carteret, pen, coventry, batten, minnes, treasurer, broun
cker, told, navy, thomas, john, robert, know, tells, tell, give, com
pany, better, tower
C07 : great, talk, content, deal, world, having, tangier, trouble, p
leasure, fear, man, mind, small, danger, told, honour, intend, troub
les, joy, coming
C08 : play, saw, acted, playhouse, comedy, part, excellent, theatre,
stage, knipp, best, called, done, house, tragedy, pit, duke, sat, pr
etty, parts
C09 : duke, albemarle, coventry, business, prince, buckingham, sea,
himself, find, gone, thing, leave, discourse, rupert, fight, says,
holmes, fault, tell, took
C10 : plague, week, dead, news, town, people, bill, fear, god, sick,
blessed, sad, street, london, ill, sickness, odd, city, troubled, fa
llen
C11 : day, fast, weather, boy, observed, letters, ago, kept, go, ord
ered, resolve, pepys, london, burning, preach, wear, government, bur
ied, black, cost
C12 : hath, tells, says, man, himself, thing, world, done, shall, to
ld, before, believe, peace, england, tell, know, believes, think, th
inks, best
C13 : york, duke, wren, duchesse, buckingham, james, attended, might
ily, matter, occasion, st, middleton, council, chancellor, nothing,
arlington, usual, shall, time, closet
C14 : lady, castlemaine, daughter, woman, wardrobe, ladies, court, t
ells, hinchingbroke, creed, handsome, married, sandwich, dined, chil
d, husband, coach, week, carteret, young
C15 : office, morning, navy, afternoon, business, sat, letter, hewe
r, drawing, glad, time, met, long, accounts, agreed, making, writin
g, draw, list, committee
C16 : hall, white, westminster, met, water, chapel, heard, gone, wal
ked, closet, seale, privy, park, going, montagu, gallery, queen, wal
king, kiss, saw
C17 : see, people, strange, think, met, poor, fire, town, thing, you
ng, city, pretty, ill, mightily, little, full, done, man, body, sigh
t
C18 : church, sermon, paul, heard, st, sunday, preach, read, time, p
reached, fellow, yard, saw, book, poor, rochester, people, pleases,
believe, before
C19 : went, coach, took, go, got, before, saw, away, way, going, ge
t, clock, lay, leave, back, thither, staid, horse, till, carried
C20 : money, pay, navy, get, shall, want, account, treasurer, paid,
charge, find, time, business, give, things, condition, cost, carter
et, war, parliament
C21 : hear, st, die, french, death, james, morning, peace, name, yes
terday, pleased, dead, paul, france, sorry, commissioners, troubled,
court, having, lords
C22 : fleet, dutch, news, prince, go, portsmouth, rupert, dover, abr
oad, french, de, certain, back, smith, downes, gone, received, nothi
ng, sail, guns
C23 : walked, fine, mighty, garden, water, street, walk, parke, nobl
e, saw, find, way, pleasant, evelyn, pleasure, park, james, place, b
rave, pretty
C24 : parliament, city, monk, told, soldiers, voted, general, member
s, chosen, london, council, news, came, free, crewe, sit, army, lamb
ert, mayor, common
C25 : house, lords, commons, bill, houses, act, westminster, voted,
brought, vote, time, speech, coffee, ordered, speaker, met, proceed
ings, passed, desired, full
C26 : board, ship, letter, give, admiral, captain, brought, order, s
hore, read, commissioner, vice, came, letters, answer, done, writin
g, sea, middleton, dinner
C27 : queene, court, mother, ladies, hampton, duchesse, pierce, some
rset, castlemaine, monmouth, child, pretty, portugall, montagu, chap
el, elizabeth, chamber, dressed, captn, honour
C28 : against, god, things, high, business, knows, himself, parliame
nt, chancellor, accounts, go, mighty, council, fit, pray, read, worl
d, morrow, commissioners, rest
C29 : ob, john, earl, william, son, charles, father, created, thoma
s, died, daughter, privy, sir, married, state, henry, secretary, ii,
brother, old
C30 : wife, picture, home, mighty, pretty, cost, think, pepys, hewe
r, having, put, coach, mightily, gold, done, eyes, work, company, fa
shion, tom
04/04/2017 14:18
INFO
Generated 1 ensemble members
04/04/2017 14:18
INFO
Loading term rankings from models/nmf_
pepys_k30_1008/ranks_1008_001.pkl ...
04/04/2017 14:18
INFO
Model has 30 rankings covering 1054 te
rms
04/04/2017 14:18
INFO
Loading term rankings from models/nmf_
pepys_k30_1008/ranks_1008_001.pkl ...
04/04/2017 14:18
INFO
Model has 30 rankings covering 1054 te
rms
C01 : king, france, told, court, given, give, castlemaine, spain, en
gland, send, coming, promise, people, put, yesterday, flanders, litt
le, days, says, knows
C02 : see, people, strange, pretty, think, met, little, mighty, thin
g, water, young, mightily, town, poor, man, ill, sight, walked, bod
y, room
C03 : hall, white, westminster, walked, water, met, chapel, st, hear
d, park, saw, gone, seale, privy, going, gallery, closet, walking, m
ontagu, parke
C04 : lady, castlemaine, daughter, woman, ladies, wardrobe, court, t
ells, hinchingbroke, creed, sandwich, married, handsome, child, husb
and, parke, carteret, week, dined, coach
C05 : night, home, bed, coming, hear, fire, supped, supper, morrow,
hewer, having, brought, till, morning, rest, town, boy, came, tell,
got
C06 : office, morning, letter, afternoon, sat, business, drawing, gl
ad, hewer, agreed, writing, till, draw, comes, long, time, board, ma
king, busy, condition
C07 : sir, coventry, pen, carteret, batten, minnes, business, brounc
ker, told, treasurer, thomas, john, himself, find, know, robert, tel
l, company, smith, william
C08 : city, monk, mayor, fire, london, street, people, town, houses,
streets, told, find, shut, sad, members, burned, ford, full, way, so
ldiers
C09 : play, saw, acted, playhouse, comedy, excellent, part, theatre,
stage, done, knipp, called, best, tragedy, sat, pit, duke, pretty, g
ood, parts
C10 : fleet, prince, dutch, rupert, go, abroad, de, smith, albemarl
e, portsmouth, going, fight, sea, back, received, nothing, setting,
success, french, home
C11 : parliament, voted, monk, against, soldiers, told, act, free, b
elieve, committee, general, afternoon, came, met, lambert, sit, memb
ers, shall, think, crewe
C12 : great, talk, content, deal, having, world, pleasure, tangier,
trouble, man, honour, small, fear, against, danger, told, mind, jo
y, troubles, intend
C13 : duke, york, buckingham, duchesse, wren, albemarle, business, j
ames, mightily, coventry, occasion, attended, done, st, matter, midd
leton, council, prince, chancellor, glad
C14 : day, hear, fast, weather, observed, boy, letters, ordered, go,
ago, london, kept, resolve, preach, hands, came, death, give, receiv
e, government
C15 : good, god, world, blessed, health, man, heart, pray, worth, kn
ows, bless, live, little, give, estate, condition, fit, things, maki
ng, old
C16 : news, brought, certain, yesterday, dutch, dover, french, gone,
taken, peace, killed, ill, thither, dead, confirmed, men, letters, b
rother, letter, downes
C17 : ob, john, william, earl, son, charles, father, created, thoma
s, privy, died, daughter, sir, state, married, secretary, henry, ii,
old, aged
C18 : queene, court, ladies, mother, hampton, duchesse, pierce, some
rset, pretty, castlemaine, monmouth, chapel, st, child, portugall, m
ontagu, brave, chamber, fine, elizabeth
C19 : hath, says, tells, man, himself, thing, world, told, done, bel
ieve, before, think, tell, shall, discourse, peace, know, england, b
elieves, chancellor
C20 : money, pay, get, want, cost, paid, shall, time, condition, bus
iness, war, forced, peace, seamen, having, comes, called, spent, tre
asurer, present
C21 : navy, things, charge, council, order, account, treasurer, cart
eret, find, business, shall, debt, give, officers, discourse, agains
t, old, present, coventry, commissioners
C22 : plague, week, dead, town, people, bill, fear, sick, sickness,
blessed, troubled, street, odd, fallen, sad, buried, ill, number, f
ast, joy
C23 : lord, sandwich, chancellor, montagu, sea, crewe, treasurer, ta
ngier, hinchingbroke, told, brouncker, letter, moore, done, busines
s, place, visit, dined, glad, carry
C24 : lords, commons, against, bill, hear, houses, business, high, c
hancellor, proceedings, vote, accounts, passed, till, brought, act,
reasons, desired, clarendon, heat
C25 : church, sermon, paul, st, heard, sunday, preach, read, time, p
reached, saw, yard, fellow, poor, chapel, people, rochester, believ
e, hear, pleases
C26 : house, coffee, full, time, westminster, somerset, fine, act, o
rdered, trinity, garden, speech, extraordinary, speaker, lane, plac
e, members, mighty, master, built
C27 : went, coach, took, go, got, saw, way, before, away, going, bac
k, street, clock, get, leave, horse, lay, thither, horses, carried
C28 : wife, picture, mighty, home, pretty, fine, hewer, cost, put, h
aving, think, pepys, work, coach, gold, find, fashion, mightily, bla
ck, eyes
C29 : ships, men, dutch, ship, captain, war, fire, guns, board, take
n, chatham, river, fight, lost, coming, enemy, order, burned, hear,
shot
C30 : dinner, discourse, dined, good, noon, company, home, mighty, b
ook, sermon, time, read, merry, till, comes, evelyn, pleased, befor
e, college, noble
In [9]:
compare_terms('models/nmf_pepys_k30_' + str(seed1), 'models/nmf_pepys_k30_' + st
r(seed2), num_words=20)
C11 : ago, black, boy, buried, burning, cost, day, fast, go, gover
nment, kept, letters, london, observed, ordered, pepys, preach, reso
lve, wear, weather
C14 : ago, boy, came, day, death, fast, give, go, government, hand
s, hear, kept, letters, london, observed, ordered, preach, receive,
resolve, weather
14
C26 : admiral, answer, board, brought, came, captain, commissione
r, dinner, done, give, letter, letters, middleton, order, read, sea,
ship, shore, vice, writing
C29 : board, burned, captain, chatham, coming, dutch, enemy, figh
t, fire, guns, hear, lost, men, order, river, ship, ships, shot, tak
en, war
4
C01 : before, castlemaine, charles, coming, court, england, flande
rs, france, give, given, king, little, promise, put, says, send, spa
in, tells, told, yesterday
C01 : castlemaine, coming, court, days, england, flanders, france,
give, given, king, knows, little, people, promise, put, says, send,
spain, told, yesterday
17
C30 : coach, company, cost, done, eyes, fashion, gold, having, hew
er, home, mightily, mighty, pepys, picture, pretty, put, think, tom,
wife, work
C28 : black, coach, cost, eyes, fashion, find, fine, gold, having,
hewer, home, mightily, mighty, pepys, picture, pretty, put, think, w
ife, work
17
C23 : brave, evelyn, find, fine, garden, james, mighty, noble, par
k, parke, place, pleasant, pleasure, pretty, saw, street, walk, walk
ed, water, way
C03 : chapel, closet, gallery, going, gone, hall, heard, met, mont
agu, park, parke, privy, saw, seale, st, walked, walking, water, wes
tminster, white
5
C09 : albemarle, buckingham, business, coventry, discourse, duke,
fault, fight, find, gone, himself, holmes, leave, prince, rupert, s
ays, sea, tell, thing, took
C13 : albemarle, attended, buckingham, business, chancellor, counc
il, coventry, done, duchesse, duke, glad, james, matter, middleton,
mightily, occasion, prince, st, wren, york
6
C24 : army, came, chosen, city, common, council, crewe, free, gene
ral, lambert, london, mayor, members, monk, news, parliament, sit, s
oldiers, told, voted
C11 : act, afternoon, against, believe, came, committee, crewe, fr
ee, general, lambert, members, met, monk, parliament, shall, sit, so
ldiers, think, told, voted
12
C19 : away, back, before, carried, clock,
ot, horse, lay, leave, saw, staid, thither,
C27 : away, back, before, carried, clock,
ot, horse, horses, lay, leave, saw, street,
coach, get, go, going, g
till, took, way, went
coach, get, go, going, g
thither, took, way, went
18
C15 : accounts, afternoon, agreed, business, committee, draw, draw
ing, glad, hewer, letter, list, long, making, met, morning, navy, of
fice, sat, time, writing
C06 : afternoon, agreed, board, business, busy, comes, condition,
draw, drawing, glad, hewer, letter, long, making, morning, office,
sat, till, time, writing
15
C28 : accounts, against, business, chancellor, commissioners, coun
cil, fit, go, god, high, himself, knows, mighty, morrow, parliament,
pray, read, rest, things, world
C15 : bless, blessed, condition, estate, fit, give, god, good, hea
lth, heart, knows, little, live, making, man, old, pray, things, wor
ld, worth
6
C07 : coming, content, danger, deal, fear, great, having, honour,
intend, joy, man, mind, pleasure, small, talk, tangier, told, troub
le, troubles, world
C12 : against, content, danger, deal, fear, great, having, honour,
intend, joy, man, mind, pleasure, small, talk, tangier, told, troubl
e, troubles, world
19
C12 : before, believe, believes, best, done, england, hath, himsel
f, know, man, peace, says, shall, tell, tells, thing, think, thinks,
told, world
C19 : before, believe, believes, chancellor, discourse, done, engl
and, hath, himself, know, man, peace, says, shall, tell, tells, thin
g, think, told, world
18
C14 : carteret, castlemaine, child, coach, court, creed, daughter,
dined, handsome, hinchingbroke, husband, ladies, lady, married, sand
wich, tells, wardrobe, week, woman, young
C04 : carteret, castlemaine, child, coach, court, creed, daughter,
dined, handsome, hinchingbroke, husband, ladies, lady, married, park
e, sandwich, tells, wardrobe, week, woman
19
C13 : arlington, attended, buckingham, chancellor, closet, counci
l, duchesse, duke, james, matter, middleton, mightily, nothing, occa
sion, shall, st, time, usual, wren, york
C13 : albemarle, attended, buckingham, business, chancellor, counc
il, coventry, done, duchesse, duke, glad, james, matter, middleton,
mightily, occasion, prince, st, wren, york
14
C21 : commissioners, court, dead, death, die, france, french, havi
ng, hear, james, lords, morning, name, paul, peace, pleased, sorry,
st, troubled, yesterday
C16 : brother, brought, certain, confirmed, dead, dover, downes, d
utch, french, gone, ill, killed, letter, letters, men, news, peace,
taken, thither, yesterday
4
C25 : act, bill, brought, coffee, commons, desired, full, house, h
ouses, lords, met, ordered, passed, proceedings, speaker, speech, ti
me, vote, voted, westminster
me, vote, voted, westminster
C24 : accounts, act, against, bill, brought, business, chancellor,
clarendon, commons, desired, hear, heat, high, houses, lords, passe
d, proceedings, reasons, till, vote
10
C16 : chapel, closet, gallery, going, gone, hall, heard, kiss, me
t, montagu, park, privy, queen, saw, seale, walked, walking, water,
westminster, white
C03 : chapel, closet, gallery, going, gone, hall, heard, met, mont
agu, park, parke, privy, saw, seale, st, walked, walking, water, wes
tminster, white
18
C04 : ashly, barkeley, brouncker, business, chancellor, crewe, din
ed, glad, hinchingbroke, lord, montagu, moore, peterborough, place,
sandwich, sea, tangier, told, treasurer, visit
C23 : brouncker, business, carry, chancellor, crewe, dined, done,
glad, hinchingbroke, letter, lord, montagu, moore, place, sandwich,
sea, tangier, told, treasurer, visit
17
C06 : batten, better, brouncker, carteret, company, coventry, giv
e, john, know, minnes, navy, pen, robert, sir, tell, tells, thomas,
told, tower, treasurer
C07 : batten, brouncker, business, carteret, company, coventry, fi
nd, himself, john, know, minnes, pen, robert, sir, smith, tell, thom
as, told, treasurer, william
15
C22 : abroad, back, certain, de, dover, downes, dutch, fleet, fren
ch, go, gone, guns, news, nothing, portsmouth, prince, received, rup
ert, sail, smith
C10 : abroad, albemarle, back, de, dutch, fight, fleet, french, g
o, going, home, nothing, portsmouth, prince, received, rupert, sea,
setting, smith, success
13
C03 : away, burned, captain, chatham, coming, dutch, enemy, fight,
fire, guns, having, killed, lost, men, news, river, sail, ships, tak
en, war
C29 : board, burned, captain, chatham, coming, dutch, enemy, figh
t, fire, guns, hear, lost, men, order, river, ship, ships, shot, tak
en, war
15
C02 : bishop, chapel, college, company, dined, dinner, discourse,
give, god, good, home, man, merry, noon, old, pleased, pretty, serm
on, things, time
C30 : before, book, college, comes, company, dined, dinner, discou
rse, evelyn, good, home, merry, mighty, noble, noon, pleased, read,
sermon, till, time
12
C20 : account, business, carteret, charge, condition, cost, find,
get, give, money, navy, paid, parliament, pay, shall, things, time,
treasurer, want, war
C20 : business, called, comes, condition, cost, forced, get, havin
g, money, paid, pay, peace, present, seamen, shall, spent, time, tre
asurer, want, war
12
12
C17 : body, city, done, fire, full, ill, little, man, met, mightil
y, people, poor, pretty, see, sight, strange, thing, think, town, yo
ung
C02 : body, ill, little, man, met, mightily, mighty, people, poor,
pretty, room, see, sight, strange, thing, think, town, walked, wate
r, young
16
C05 : bed, boy, brought, came, coming, fire, got, having, hewer, h
ome, morning, morrow, night, rest, set, supped, supper, tell, till,
town
C05 : bed, boy, brought, came, coming, fire, got, having, hear, he
wer, home, morning, morrow, night, rest, supped, supper, tell, till,
town
19
C08 : acted, best, called, comedy, done, duke, excellent, house, k
nipp, part, parts, pit, play, playhouse, pretty, sat, saw, stage, th
eatre, tragedy
C09 : acted, best, called, comedy, done, duke, excellent, good, kn
ipp, part, parts, pit, play, playhouse, pretty, sat, saw, stage, the
atre, tragedy
19
C10 : bill, blessed, city, dead, fallen, fear, god, ill, london, n
ews, odd, people, plague, sad, sick, sickness, street, town, trouble
d, week
C22 : bill, blessed, buried, dead, fallen, fast, fear, ill, joy, n
umber, odd, people, plague, sad, sick, sickness, street, town, troub
led, week
16
C27 : captn, castlemaine, chamber, chapel, child, court, dressed,
duchesse, elizabeth, hampton, honour, ladies, monmouth, montagu, mo
ther, pierce, portugall, pretty, queene, somerset
C18 : brave, castlemaine, chamber, chapel, child, court, duchesse,
elizabeth, fine, hampton, ladies, monmouth, montagu, mother, pierce,
portugall, pretty, queene, somerset, st
17
C29 : brother, charles, created, daughter, died, earl, father, hen
ry, ii, john, married, ob, old, privy, secretary, sir, son, state, t
homas, william
C17 : aged, charles, created, daughter, died, earl, father, henry,
ii, john, married, ob, old, privy, secretary, sir, son, state, thoma
s, william
19
C18 : before, believe, book, church, fellow, heard, paul, people,
pleases, poor, preach, preached, read, rochester, saw, sermon, st,
sunday, time, yard
C25 : believe, chapel, church, fellow, hear, heard, paul, people,
pleases, poor, preach, preached, read, rochester, saw, sermon, st,
sunday, time, yard
18
14.133333333333333
Stable Topic Models
The Wisdom of Crowds
Mark Belford, Brian Mac Namee, Derek Greene (2017).
Stability of Topic Modeling via Matrix Factorization,
https://arxiv.org/abs/1702.07186 (https://arxiv.org/abs/1702.07186)
https://github.com/derekgreene/topic-ensemble (https://github.com/derekgreene/topic-ensemble)
Two Ensembled Topics Models for Martha's Diary
In [53]:
enskf_nmf('martha', num_topics=30, num_bases=20, num_folds=10, num_words=20, see
d=seed1)
enskf_nmf('martha', num_topics=30, num_bases=20, num_folds=10, num_words=20, see
d=seed2)
C01 : went, see, ballard, find, girls, hook, bed, warm, clear, barto
n, pollards, hamlins, westons, sons, foster, savages, sister, meddo
w, densmores, bot
C02 : work, done, hous, house, clear, doing, helpt, bakt, various, k
inds, warm, ballard, washing, knitt, spun, cut, jonas, cleand, coar
t, part
C03 : day, part, ys, rainy, raind, old, unwel, clear, seen, morn, sp
ent, polly, yesterday, hannah, fast, says, savage, smith, little, ap
ples
C04 : wife, childn, jona, calld, go, allso, james, capt, savage, din
d, clear, saml, gill, labour, travil, wilm, isaac, boltons, benn, co
wens
C05 : home, ballard, clear, returnd, brot, left, surveying, pleast,
house, rainy, cyrus, dind, conducted, hook, pleasant, implied, mend
ing, savage, knitt, jon
C06 : cloudy, rain, snow, aftn, foren, morn, little, began, ballard,
thunder, evn, turns, wind, misty, unwel, before, gone, moderate, app
les, storm
C07 : morn, left, deld, safe, returnd, cleverly, child, pm, ys, fin
e, arivd, receivd, labour, expected, reward, patient, inft, comforta
ble, patients, evn
C08 : gardin, workt, planted, warm, beens, sett, clear, ballard, cuc
umbers, sowd, wed, corn, squash, plants, seeds, peas, houghd, gather
d, potatoes, matters
C09 : took, tea, dind, pierce, breakfast, barton, drank, allso, mrs
s, sister, clear, farewel, jonas, wiman, ballard, husband, care, jam
es, smith, old
C10 : cold, clear, windy, wood, ballard, washing, implied, old, brow
n, load, makeing, savages, waid, wm, evn, kniting, snow, knit, got,
savage
C11 : night, tarried, till, raind, before, ill, sett, patient, slep
t, women, sick, thro, severe, tarrie, tarries, ys, rest, little, wat
cht, pain
C12 : meeting, cyrus, ballard, revd, stone, fm, vers, discoarst, per
formd, clear, luke, parker, coart, supper, text, parrish, john, psal
m, communion, intermition
C13 : son, jonas, pollards, lambd, lambds, jona, ephms, lambard, con
ducted, lambards, towns, famely, clear, jon, babe, allin, sist, wel,
childn, farewel
C14 : came, barton, conducted, doct, evn, sister, go, left, slept, b
etsy, husband, gill, help, tarries, allin, sick, lambart, till, bac
k, child
C15 : dolly, sally, hannah, polly, gone, pleast, savage, pollards, p
ollard, sleep, clear, williams, cocks, better, wove, church, yds, sp
un, pitts, martha
C16 : lb, brot, bot, butter, sugar, sent, oz, wd, flax, pork, chees,
candles, wool, spirit, bakt, cyrus, churnd, snuff, bread, beef
C17 : unwell, rainy, felt, pollards, little, day, informs, throat, b
etsy, jon, find, savage, polly, set, feel, norths, hamlin, jono, sen
t, ditoes
C18 : dagt, pollard, lambd, ballard, childn, lambart, clear, allso,
mrss, lambard, comfortable, sons, sleep, allin, gill, rhoda, capin,
sent, dagts, warm
C19 : ye, part, hook, settlement, ballard, fort, river, got, field,
death, put, informd, inst, gone, mill, girls, bed, side, north, cle
ar
C20 : washt, girls, room, kitchen, cloaths, clear, floors, bed, ball
ard, bakt, sally, buttery, house, cleand, hepsy, scourd, west, room
e, rooms, north
C21 : town, sleeps, famely, polly, coart, pitts, patty, son, ezra, l
ucy, informs, left, ys, sherebiah, barton, esqr, gone, men, dind, to
wns
C22 : see, calld, find, mrss, go, labour, evn, sick, child, clear, d
oct, gave, women, better, lady, ill, infant, comfortable, low, pm
C23 : finisht, pair, hoes, began, stockins, kniting, mended, mitts,
self, cyruss, makeing, stockin, ballards, ballard, knitt, washing,
corn, footing, yarn, mending
C24 : aftern, foren, ys, morn, raind, shower, aftn, fm, fore, thunde
r, mrss, interd, vers, forenn, sett, remains, showers, spent, text,
rainy
C25 : snowd, evng, raind, jona, evn, spent, haild, junr, before, kni
t, little, kniting, le, faett, wood, cloudy, cleard, ironed, cloath
s, getchel
C26 : ephm, jona, supt, sleeps, sons, wood, sleep, meddow, hay, din
d, evng, allin, allso, patty, ballard, brot, wilm, cowen, junr, wive
s
C27 : wk, hous, knit, done, sleep, jona, wm, sleeps, clear, washing,
mended, junr, epm, le, farewel, faett, wel, matters, brot, husband
C28 : shee, better, ill, pain, gave, little, seemd, comfortable, bro
t, sett, women, deld, pitts, illness, wish, sic, see, paid, rest, th
ro
C29 : feel, fatagued, feeble, fatagud, washing, wish, sett, unwel, c
lear, comfortable, better, little, warm, bakt, cool, felt, god, wel,
pain, sun
C30 : attended, worship, public, famely, self, revd, performd, funer
al, pleast, attend, clear, foster, intermition, service, john, after
n, divine, interd, polly, prayer
C01 : went, see, ballard, find, hook, bed, girls, warm, barton, poll
ards, clear, hamlins, sons, westons, foster, meddow, sister, densmor
es, savages, bot
C02 : work, done, hous, house, clear, doing, helpt, bakt, various, k
inds, warm, ballard, washing, knitt, spun, cut, jonas, cleand, part,
coart
C03 : wife, childn, jona, allso, go, james, calld, capt, savage, din
d, clear, saml, gill, labour, travil, wilm, isaac, boltons, benn, co
wens
C04 : day, part, ys, rainy, raind, old, unwel, seen, clear, morn, sp
ent, yesterday, fast, says, smith, apples, cut, little, felt, ballar
ds
C05 : home, ballard, clear, returnd, brot, surveying, left, house, p
least, rainy, dind, conducted, cyrus, hook, pleasant, implied, mendi
ng, knitt, jon, brought
C06 : cloudy, rain, snow, aftn, foren, morn, little, began, ballard,
thunder, evn, turns, wind, misty, unwel, sett, before, storm, modera
te, gone
C07 : morn, left, deld, safe, returnd, cleverly, child, pm, ys, fin
e, arivd, receivd, labour, reward, expected, patient, inft, comforta
ble, patients, infant
C08 : gardin, workt, planted, warm, beens, sett, clear, ballard, cuc
umbers, sowd, wed, corn, squash, plants, seeds, peas, houghd, gather
d, potatoes, beets
C09 : took, tea, dind, pierce, breakfast, barton, drank, mrss, alls
o, sister, clear, farewel, jonas, wiman, ballard, husband, care, jam
es, smith, martha
C10 : cold, clear, windy, wood, ballard, washing, implied, old, brow
n, load, makeing, waid, wm, savages, knit, evn, snow, kniting, got,
spent
C11 : night, tarried, till, raind, before, ill, sett, patient, slep
t, women, thro, sick, severe, tarrie, tarries, ys, rest, little, wat
cht, pain
cht, pain
C12 : meeting, cyrus, ballard, revd, stone, fm, vers, discoarst, per
formd, clear, luke, parker, coart, supper, text, parrish, john, psal
m, communion, intermition
C13 : son, jonas, pollards, lambd, lambds, jona, ephms, lambard, con
ducted, lambards, towns, famely, clear, jon, babe, allin, sist, wel,
childn, farewel
C14 : lb, brot, bot, butter, sugar, sent, oz, wd, flax, pork, chees,
candles, spirit, wool, bakt, cyrus, churnd, snuff, bread, beef
C15 : came, barton, conducted, doct, evn, sister, go, left, slept, b
etsy, husband, help, gill, tarries, allin, lambart, sick, back, til
l, child
C16 : unwell, rainy, felt, pollards, little, day, informs, throat, b
etsy, jon, feel, set, find, norths, ditoes, sent, jono, hamlin, moor
es, evn
C17 : washt, girls, room, kitchen, cloaths, clear, floors, bed, ball
ard, bakt, sally, buttery, house, cleand, scourd, hepsy, west, room
e, rooms, north
C18 : dagt, pollard, lambd, ballard, childn, lambart, clear, allso,
mrss, lambard, comfortable, sons, sleep, gill, allin, capin, rhoda,
sent, dagts, warm
C19 : ye, part, hook, settlement, ballard, fort, river, got, field,
death, put, informd, inst, gone, mill, bed, side, girls, north, cor
n
C20 : town, sleeps, famely, coart, pitts, polly, patty, son, ezra, l
ucy, informs, left, sherebiah, barton, esqr, men, sleep, towns, din
d, dexter
C21 : sally, dolly, hannah, sleep, pollards, cocks, pollard, gone, c
hurch, martha, wove, pitts, farewel, yds, spun, paid, better, quill
t, help, dads
C22 : see, calld, find, mrss, go, labour, evn, sick, child, clear, d
oct, gave, women, better, lady, ill, infant, comfortable, low, pm
C23 : finisht, pair, hoes, began, stockins, kniting, mended, mitts,
self, cyruss, makeing, stockin, ballards, ballard, knitt, washing,
corn, footing, yarn, mending
C24 : aftern, attended, worship, foren, public, famely, self, ys, re
vd, performd, morn, funeral, attend, raind, interd, shower, clear, a
ftn, forenn, remains
C25 : evng, snowd, raind, jona, spent, evn, knit, haild, before, jun
r, kniting, little, le, faett, wood, cleard, ironed, foren, till, cl
oudy
C26 : ephm, jona, supt, sleeps, sons, wood, sleep, meddow, dind, ha
y, allin, ballard, allso, patty, brot, wilm, cowen, evng, wives, git
ing
C27 : shee, better, ill, pain, gave, little, seemd, comfortable, bro
t, women, deld, sett, illness, wish, pitts, paid, sic, rest, yesterd
ay, thro
C28 : wk, hous, knit, done, sleep, jona, wm, sleeps, clear, washing,
mended, junr, epm, le, faett, farewel, wel, matters, brot, husband
C29 : feel, fatagued, feeble, fatagud, washing, wish, unwel, sett, c
lear, comfortable, better, little, bakt, warm, cool, felt, god, wel,
pain, able
C30 : polly, pleast, savage, hannah, dolly, ys, gone, foster, capt,
clear, williams, lady, girls, hamlin, old, morn, eving, doct, savag
es, westons
In [54]:
compare_terms('models/enskf_nmf_martha_k30_' + str(seed1), 'models/enskf_nmf_mar
tha_k30_' + str(seed2), num_words=20)
C22
ave,
C22
ave,
20
: better, calld, child,
go, ill, infant, labour,
: better, calld, child,
go, ill, infant, labour,
clear, comfortable, doct,
lady, low, mrss, pm, see,
clear, comfortable, doct,
lady, low, mrss, pm, see,
evn, find, g
sick, women
evn, find, g
sick, women
C03 : apples, clear, day, fast, hannah, little, morn, old, part, p
olly, raind, rainy, savage, says, seen, smith, spent, unwel, yesterd
ay, ys
C04 : apples, ballards, clear, cut, day, fast, felt, little, morn,
old, part, raind, rainy, says, seen, smith, spent, unwel, yesterday,
ys
17
C12 : ballard, clear, coart, communion, cyrus, discoarst, fm,
rmition, john, luke, meeting, parker, parrish, performd, psalm,
d, stone, supper, text, vers
C12 : ballard, clear, coart, communion, cyrus, discoarst, fm,
rmition, john, luke, meeting, parker, parrish, performd, psalm,
d, stone, supper, text, vers
20
inte
rev
inte
rev
C07 : arivd, child, cleverly, comfortable, deld, evn, expected, fi
ne, inft, labour, left, morn, patient, patients, pm, receivd, return
d, reward, safe, ys
C07 : arivd, child, cleverly, comfortable, deld, expected, fine, i
nfant, inft, labour, left, morn, patient, patients, pm, receivd, ret
urnd, reward, safe, ys
19
C19 : ballard, bed, clear, death, field, fort, girls, gone, got, h
ook, informd, inst, mill, north, part, put, river, settlement, side,
ye
C19 : ballard, bed, corn, death, field, fort, girls, gone, got, ho
ok, informd, inst, mill, north, part, put, river, settlement, side,
ye
19
C30 : aftern, attend, attended, clear, divine, famely, foster, fun
eral, interd, intermition, john, performd, pleast, polly, prayer, pu
blic, revd, self, service, worship
C24 : aftern, aftn, attend, attended, clear, famely, foren, foren
n, funeral, interd, morn, performd, public, raind, remains, revd, se
lf, shower, worship, ys
12
C15 : better, church, clear, cocks, dolly, gone, hannah, martha, p
itts, pleast, pollard, pollards, polly, sally, savage, sleep, spun,
williams, wove, yds
C21 : better, church, cocks, dads, dolly, farewel, gone, hannah, h
elp, martha, paid, pitts, pollard, pollards, quillt, sally, sleep, s
pun, wove, yds
15
C28 : better, brot, comfortable, deld, gave, ill, illness, little,
paid, pain, pitts, rest, see, seemd, sett, shee, sic, thro, wish, wo
men
C27 : better, brot, comfortable, deld, gave, ill, illness, little,
paid, pain, pitts, rest, seemd, sett, shee, sic, thro, wish, women,
yesterday
19
C27 : brot, clear, done, epm, faett, farewel,
junr, knit, le, matters, mended, sleep, sleeps,
C28 : brot, clear, done, epm, faett, farewel,
junr, knit, le, matters, mended, sleep, sleeps,
20
C14 : allin, back, barton, betsy, came, child,
n, gill, go, help, husband, lambart, left, sick,
ies, till
C15 : allin, back, barton, betsy, came, child,
n, gill, go, help, husband, lambart, left, sick,
ies, till
20
hous, husband, jona,
washing, wel, wk, wm
hous, husband, jona,
washing, wel, wk, wm
C09 : allso, ballard, barton,
farewel, husband, james, jonas,
a, took, wiman
C09 : allso, ballard, barton,
farewel, husband, james, jonas,
tea, took, wiman
19
conducted, doct, ev
sister, slept, tarr
conducted, doct, ev
sister, slept, tarr
breakfast, care, clear, dind, drank,
mrss, old, pierce, sister, smith, te
breakfast, care, clear, dind, drank,
martha, mrss, pierce, sister, smith,
C23 : ballard, ballards, began, corn, cyruss, finisht, footing, ho
es, kniting, knitt, makeing, mended, mending, mitts, pair, self, sto
ckin, stockins, washing, yarn
C23 : ballard, ballards, began, corn, cyruss, finisht, footing, ho
es, kniting, knitt, makeing, mended, mending, mitts, pair, self, sto
ckin, stockins, washing, yarn
20
C16 : bakt, beef,
d, cyrus, flax, lb,
C14 : bakt, beef,
d, cyrus, flax, lb,
20
bot, bread, brot, butter, candles, chees,
oz, pork, sent, snuff, spirit, sugar, wd,
bot, bread, brot, butter, candles, chees,
oz, pork, sent, snuff, spirit, sugar, wd,
churn
wool
churn
wool
C08 : ballard, beens, clear, corn, cucumbers, gardin, gatherd, hou
ghd, matters, peas, planted, plants, potatoes, seeds, sett, sowd, sq
uash, warm, wed, workt
C08 : ballard, beens, beets, clear, corn, cucumbers, gardin, gathe
rd, houghd, peas, planted, plants, potatoes, seeds, sett, sowd, squa
sh, warm, wed, workt
19
C02 : bakt, ballard,
t, hous, house, jonas,
ing, work
C02 : bakt, ballard,
t, hous, house, jonas,
ing, work
20
cleand, clear, coart, cut, doing, done, help
kinds, knitt, part, spun, various, warm, wash
cleand, clear, coart, cut, doing, done, help
kinds, knitt, part, spun, various, warm, wash
C20 : bakt, ballard, bed, buttery,
girls, hepsy, house, kitchen, north,
rd, washt, west
C17 : bakt, ballard, bed, buttery,
girls, hepsy, house, kitchen, north,
rd, washt, west
20
cleand, clear, cloaths, floors,
room, roome, rooms, sally, scou
cleand, clear, cloaths, floors,
room, roome, rooms, sally, scou
20
C13 :
l, jon,
t, son,
C13 :
l, jon,
t, son,
20
allin, babe,
jona, jonas,
towns, wel
allin, babe,
jona, jonas,
towns, wel
childn, clear, conducted, ephms, famely, farewe
lambard, lambards, lambd, lambds, pollards, sis
childn, clear, conducted, ephms, famely, farewe
lambard, lambards, lambd, lambds, pollards, sis
C11 : before, ill, little, night, pain, patient, raind, rest, set
t, severe, sick, slept, tarrie, tarried, tarries, thro, till, watch
t, women, ys
C11 : before, ill, little, night, pain, patient, raind, rest, set
t, severe, sick, slept, tarrie, tarried, tarries, thro, till, watch
t, women, ys
20
C06 : aftn, apples, ballard, before, began, cloudy, evn, foren, go
ne, little, misty, moderate, morn, rain, snow, storm, thunder, turn
s, unwel, wind
C06 : aftn, ballard, before, began, cloudy, evn, foren, gone, litt
le, misty, moderate, morn, rain, sett, snow, storm, thunder, turns,
unwel, wind
19
C24 : aftern, aftn, fm, fore, foren, forenn, interd, morn, mrss, r
aind, rainy, remains, sett, shower, showers, spent, text, thunder, v
ers, ys
C24 : aftern, aftn, attend, attended, clear, famely, foren, foren
n, funeral, interd, morn, performd, public, raind, remains, revd, se
lf, shower, worship, ys
10
C29 : bakt, better, clear, comfortable, cool, fatagud, fatagued, f
eeble, feel, felt, god, little, pain, sett, sun, unwel, warm, washin
g, wel, wish
C29 : able, bakt, better, clear, comfortable, cool, fatagud, fatag
ued, feeble, feel, felt, god, little, pain, sett, unwel, warm, washi
ng, wel, wish
19
C04 : allso, benn,
nd, gill, go, isaac,
e, wilm
C03 : allso, benn,
nd, gill, go, isaac,
e, wilm
20
boltons, calld, capt, childn, clear, cowens, di
james, jona, labour, saml, savage, travil, wif
boltons, calld, capt, childn, clear, cowens, di
james, jona, labour, saml, savage, travil, wif
C10 : ballard, brown, clear, cold, evn, got, implied, knit, knitin
g, load, makeing, old, savage, savages, snow, waid, washing, windy,
wm, wood
C10 : ballard, brown, clear, cold, evn, got, implied, knit, knitin
g, load, makeing, old, savages, snow, spent, waid, washing, windy, w
m, wood
19
C18 : allin, allso, ballard, capin, childn, clear, comfortable, da
gt, dagts, gill, lambard, lambart, lambd, mrss, pollard, rhoda, sen
t, sleep, sons, warm
t, sleep, sons, warm
C18 : allin, allso, ballard, capin, childn, clear, comfortable, da
gt, dagts, gill, lambard, lambart, lambd, mrss, pollard, rhoda, sen
t, sleep, sons, warm
20
C21 : barton, coart, dind, esqr, ezra, famely, gone, informs, lef
t, lucy, men, patty, pitts, polly, sherebiah, sleeps, son, town, tow
ns, ys
C20 : barton, coart, dexter, dind, esqr, ezra, famely, informs, le
ft, lucy, men, patty, pitts, polly, sherebiah, sleep, sleeps, son, t
own, towns
18
C25 : before,
haild, ironed,
spent, wood
C25 : before,
ed, jona, junr,
l, wood
18
cleard, cloaths, cloudy, evn, evng, faett, getchel,
jona, junr, knit, kniting, le, little, raind, snowd,
cleard, cloudy, evn, evng, faett, foren, haild, iron
knit, kniting, le, little, raind, snowd, spent, til
C17 : betsy, day, ditoes, feel, felt, find, hamlin, informs, jon,
jono, little, norths, pollards, polly, rainy, savage, sent, set, th
roat, unwell
C16 : betsy, day, ditoes, evn, feel, felt, find, hamlin, informs,
jon, jono, little, moores, norths, pollards, rainy, sent, set, thro
at, unwell
18
C05 : ballard, brot, clear, conducted, cyrus, dind, home, hook, ho
use, implied, jon, knitt, left, mending, pleasant, pleast, rainy, re
turnd, savage, surveying
C05 : ballard, brot, brought, clear, conducted, cyrus, dind, home,
hook, house, implied, jon, knitt, left, mending, pleasant, pleast, r
ainy, returnd, surveying
19
C26 : allin, allso, ballard, brot, cowen, dind, ephm, evng, hay, j
ona, junr, meddow, patty, sleep, sleeps, sons, supt, wilm, wives, wo
od
C26 : allin, allso, ballard, brot, cowen, dind, ephm, evng, gitin
g, hay, jona, meddow, patty, sleep, sleeps, sons, supt, wilm, wives,
wood
19
C01 : ballard, barton, bed, bot, clear, densmores,
irls, hamlins, hook, meddow, pollards, savages, see,
arm, went, westons
C01 : ballard, barton, bed, bot, clear, densmores,
irls, hamlins, hook, meddow, pollards, savages, see,
arm, went, westons
20
18.6
find, foster, g
sister, sons, w
find, foster, g
sister, sons, w
Two Ensembled Topic Models for the Diary of Samuel
Pepys
In [62]:
enskf_nmf('pepys', num_topics=30, num_bases=20, num_folds=10, num_words=20,
seed=seed1)
enskf_nmf('pepys', num_topics=30, num_bases=20, num_folds=10, num_words=20,
seed=seed2)
C01 : hath, tells, says, thing, man, believe, world, peace, done, co
urt, shall, before, england, know, chancellor, himself, believes, re
ceived, brought, thinks
C02 : sir, coventry, pen, carteret, batten, minnes, treasurer, broun
cker, thomas, john, find, robert, tower, william, navy, company, kno
w, business, smith, trinity
C03 : play, acted, playhouse, comedy, excellent, called, knipp, par
t, tragedy, stage, pit, best, pretty, sat, mightily, duke, done, par
ts, pleased, full
C04 : day, fast, weather, letters, observed, boy, go, london, ago, o
rdered, kept, resolve, princesse, preach, pepys, government, came, b
urning, buried, find
C05 : lady, castlemaine, daughter, woman, ladies, wardrobe, court, h
inchingbroke, married, creed, child, tells, handsome, sandwich, husb
and, dined, parke, coach, week, carteret
C06 : duke, york, buckingham, duchesse, wren, albemarle, business, m
ightily, coventry, james, occasion, attended, matter, prince, done,
middleton, chancellor, arlington, gone, meet
C07 : fleet, dutch, prince, news, go, rupert, portsmouth, dover, de,
abroad, smith, french, back, albemarle, gone, downes, fight, going,
sea, certain
C08 : house, lords, commons, bill, act, houses, westminster, agains
t, coffee, speech, ordered, vote, full, voted, time, speaker, somers
et, brought, proceedings, desired
C09 : lord, sandwich, chancellor, montagu, crewe, treasurer, sea, hi
nchingbroke, tangier, brouncker, moore, letter, told, place, dined,
earl, done, visit, peterborough, edward
C10 : hall, white, westminster, walked, water, met, chapel, park, he
ard, gone, going, seale, privy, closet, montagu, gallery, walking, q
ueen, parke, kiss
C11 : plague, week, dead, news, town, bill, people, fear, sick, sad,
sickness, ill, troubled, odd, fallen, street, blessed, buried, londo
n, joy
C12 : king, france, told, given, court, england, castlemaine, spain,
coming, give, send, promise, says, put, before, yesterday, flanders,
little, charles, tells
C13 : see, people, strange, town, pretty, met, water, think, poor, l
ittle, young, mighty, walked, sight, thing, garden, ill, mightily, b
ody, full
C14 : money, pay, navy, get, want, shall, paid, treasurer, cost, acc
ount, time, condition, charge, find, war, spent, carteret, business,
present, give
C15 : good, dinner, company, discourse, dined, sermon, bishop, noon,
man, mighty, college, merry, home, pretty, pleased, old, chapel, tim
e, pictures, fine
C16 : great, talk, content, deal, having, world, pleasure, tangier,
small, trouble, danger, fear, honour, mind, intend, joy, troubles,
coming, persons, matter
C17 : parliament, monk, voted, against, news, brought, soldiers, gen
eral, afternoon, act, free, lambert, came, believe, chosen, committe
e, members, told, sit, crewe
C18 : office, morning, navy, afternoon, letter, sat, business, drawi
ng, hewer, time, glad, writing, board, met, went, agreed, till, lon
g, draw, making
C19 : ships, men, dutch, ship, captain, war, taken, fire, guns, boar
d, news, river, lost, chatham, fight, killed, coming, enemy, sail, b
urned
C20 : wife, picture, mighty, home, pretty, fine, cost, think, hewer,
pepys, put, having, work, coach, gold, mightily, fashion, eyes, don
e, find
C21 : church, sermon, paul, heard, sunday, st, preach, read, preache
d, yard, fellow, time, poor, book, pleases, people, rochester, belie
ve, street, chapel
C22 : night, home, bed, coming, brought, supper, supped, fire, morro
w, hewer, till, having, rest, morning, got, boy, before, came, town,
tell
C23 : queene, court, ladies, mother, hampton, duchesse, pierce, cast
lemaine, somerset, monmouth, pretty, child, portugall, chapel, monta
gu, brave, chamber, dressed, elizabeth, portsmouth
C24 : went, coach, took, got, go, way, away, before, going, street,
clock, get, back, leave, horse, lay, horses, boy, home, thither
C25 : man, himself, business, against, told, things, thing, think, d
iscourse, council, tell, says, navy, give, done, world, coventry, ta
ke, service, best
C26 : ob, john, earl, william, charles, son, father, created, thoma
s, privy, died, daughter, sir, state, married, secretary, henry, ii,
brother, aged
C27 : hear, st, die, james, french, lords, against, paul, death, nam
e, peace, sorry, pleased, commissioners, morning, yesterday, having,
dead, troubled, france
C28 : city, monk, mayor, fire, london, street, people, told, town, g
eneral, soldiers, members, houses, streets, council, find, way, shu
t, burned, full
C29 : god, knows, blessed, against, world, good, pray, heart, healt
h, bless, worth, estate, accounts, fit, shall, full, continue, makin
g, ends, keep
C30 : saw, theatre, before, went, time, comedy, acted, done, playhou
se, seen, woman, life, part, fine, go, little, best, believe, begun,
stage
C01 : man, himself, business, told, against, things, think, thing, d
iscourse, says, tell, done, council, world, give, take, coventry, se
rvice, best, go
C02 : sir, coventry, pen, carteret, batten, minnes, brouncker, treas
urer, thomas, john, robert, find, tower, william, company, smith, kn
ow, tells, trinity, george
C03 : play, acted, playhouse, saw, comedy, excellent, part, called,
knipp, stage, tragedy, best, done, pit, theatre, pretty, duke, sat,
mightily, parts
C04 : day, fast, weather, letters, observed, boy, go, ago, london, o
rdered, kept, resolve, princesse, pepys, preach, burning, governmen
t, buried, came, find
C05 : lady, castlemaine, daughter, woman, ladies, wardrobe, court, h
inchingbroke, married, creed, tells, child, handsome, sandwich, husb
and, dined, coach, parke, week, carteret
C06 : duke, york, buckingham, duchesse, wren, albemarle, business, m
ightily, coventry, james, occasion, attended, matter, prince, middle
ton, done, chancellor, arlington, glad, meet
C07 : fleet, dutch, prince, news, go, rupert, portsmouth, dover, de,
abroad, smith, french, back, albemarle, gone, downes, fight, going,
sea, certain
C08 : house, lords, commons, bill, act, houses, against, westminste
r, coffee, speech, ordered, full, voted, vote, time, speaker, somers
et, brought, proceedings, desired
C09 : hall, white, westminster, walked, water, met, chapel, park, he
ard, gone, going, seale, privy, closet, montagu, gallery, walking, q
ueen, st, parke
C10 : lord, sandwich, chancellor, montagu, crewe, treasurer, sea, hi
nchingbroke, tangier, brouncker, moore, letter, place, told, dined,
earl, visit, done, peterborough, edward
C11 : plague, week, dead, news, town, bill, people, fear, sick, sad,
C11 : plague, week, dead, news, town, bill, people, fear, sick, sad,
sickness, ill, troubled, odd, fallen, blessed, street, buried, londo
n, joy
C12 : king, france, told, court, given, castlemaine, england, spain,
coming, send, give, promise, says, put, before, flanders, yesterday,
little, people, tells
C13 : hath, tells, says, thing, believe, peace, world, done, man, co
urt, shall, before, england, know, chancellor, received, brought, be
lieves, thinks, good
C14 : money, pay, get, want, paid, cost, shall, condition, war, tim
e, treasurer, forced, account, seamen, business, spent, having, fin
d, present, called
C15 : good, dinner, company, discourse, dined, sermon, bishop, noon,
man, college, mighty, merry, pretty, pleased, home, chapel, old, pic
tures, time, comes
C16 : parliament, monk, voted, against, news, soldiers, brought, gen
eral, free, afternoon, told, act, lambert, came, members, chosen, be
lieve, crewe, sit, committee
C17 : great, talk, content, deal, having, pleasure, world, tangier,
small, trouble, danger, fear, honour, intend, mind, joy, troubles,
coming, persons, matter
C18 : office, morning, afternoon, letter, sat, business, drawing, gl
ad, hewer, time, went, till, agreed, met, writing, draw, comes, boar
d, long, making
C19 : ships, men, dutch, ship, captain, war, fire, taken, guns, boar
d, news, river, lost, chatham, fight, killed, coming, enemy, sail, b
urned
C20 : church, sermon, paul, heard, st, sunday, read, preach, yard, p
reached, fellow, time, poor, book, pleases, rochester, believe, peop
le, street, books
C21 : night, home, bed, coming, supper, brought, supped, fire, morro
w, hewer, till, got, having, rest, boy, morning, before, came, town,
tell
C22 : wife, picture, mighty, home, pretty, fine, cost, think, hewer,
pepys, put, having, work, coach, gold, mightily, fashion, eyes, don
e, find
C23 : queene, court, ladies, mother, hampton, duchesse, pierce, cast
lemaine, somerset, monmouth, pretty, child, portugall, montagu, chap
el, brave, chamber, elizabeth, dressed, portsmouth
C24 : navy, things, charge, account, order, treasurer, carteret, cou
ncil, find, debt, shall, business, officers, give, against, coventr
y, discourse, spent, present, time
C25 : went, saw, coach, took, go, got, before, way, away, going, str
eet, back, clock, get, fine, horse, leave, lay, bed, little
C26 : ob, john, earl, william, charles, son, father, created, thoma
s, privy, died, daughter, sir, state, married, secretary, henry, ii,
brother, seale
C27 : god, knows, blessed, against, world, pray, heart, health, goo
d, bless, worth, estate, fit, accounts, shall, full, continue, high,
making, keep
C28 : hear, st, die, james, french, lords, death, paul, name, agains
t, peace, yesterday, sorry, pleased, commissioners, morning, having,
france, dead, troubled
C29 : see, people, strange, town, pretty, water, met, think, poor, l
ittle, young, mighty, walked, garden, fire, sight, thing, full, ill,
mightily
C30 : city, monk, mayor, fire, london, told, street, people, town, g
eneral, members, soldiers, houses, streets, council, way, find, shu
t, ford, burned
In [63]:
compare_terms('models/enskf_nmf_pepys_k30_' + str(seed1), 'models/enskf_nmf_pepy
s_k30_' + str(seed2), num_words=20)
C22 : bed, before, boy, brought, came, coming, fire, got,
hewer, home, morning, morrow, night, rest, supped, supper,
ll, town
C21 : bed, before, boy, brought, came, coming, fire, got,
hewer, home, morning, morrow, night, rest, supped, supper,
ll, town
20
having,
tell, ti
having,
tell, ti
C03 : acted, best, called, comedy, done, duke, excellent, full, kn
ipp, mightily, part, parts, pit, play, playhouse, pleased, pretty, s
at, stage, tragedy
C03 : acted, best, called, comedy, done, duke, excellent, knipp, m
ightily, part, parts, pit, play, playhouse, pretty, sat, saw, stage,
theatre, tragedy
18
C12 : before, castlemaine, charles, coming, court, england, flande
rs, france, give, given, king, little, promise, put, says, send, spa
in, tells, told, yesterday
C12 : before, castlemaine, coming, court, england, flanders, franc
e, give, given, king, little, people, promise, put, says, send, spai
n, tells, told, yesterday
19
C07 : abroad, albemarle,
fight, fleet, french, go,
pert, sea, smith
C07 : abroad, albemarle,
fight, fleet, french, go,
pert, sea, smith
20
C19 : board,
t, fire, guns,
ken, war
C19 : board,
t, fire, guns,
ken, war
20
back, certain, de, dover, downes, dutch,
going, gone, news, portsmouth, prince, ru
back, certain, de, dover, downes, dutch,
going, gone, news, portsmouth, prince, ru
burned, captain, chatham, coming, dutch, enemy, figh
killed, lost, men, news, river, sail, ship, ships, ta
burned, captain, chatham, coming, dutch, enemy, figh
killed, lost, men, news, river, sail, ship, ships, ta
C30 : acted, before, begun, believe, best, comedy, done, fine, go,
life, little, part, playhouse, saw, seen, stage, theatre, time, wen
t, woman
C03 : acted, best, called, comedy, done, duke, excellent, knipp, m
ightily, part, parts, pit, play, playhouse, pretty, sat, saw, stage,
theatre, tragedy
9
C15 : bishop, chapel,
fine, good, home, man,
pretty, sermon, time
C15 : bishop, chapel,
ourse, good, home, man,
pretty, sermon, time
19
college, company, dined, dinner, discourse,
merry, mighty, noon, old, pictures, pleased,
college, comes, company, dined, dinner, disc
merry, mighty, noon, old, pictures, pleased,
C28 : burned, city, council, find, fire, full, general, houses, lo
ndon, mayor, members, monk, people, shut, soldiers, street, streets,
told, town, way
C30 : burned, city, council, find, fire, ford, general, houses, lo
ndon, mayor, members, monk, people, shut, soldiers, street, streets,
told, town, way
19
C27 : against, commissioners, dead, death, die, france, french, ha
ving, hear, james, lords, morning, name, paul, peace, pleased, sorr
y, st, troubled, yesterday
C28 : against, commissioners, dead, death, die, france, french, ha
ving, hear, james, lords, morning, name, paul, peace, pleased, sorr
y, st, troubled, yesterday
20
C14 : account, business, carteret, charge, condition, cost, find,
get, give, money, navy, paid, pay, present, shall, spent, time, tre
asurer, want, war
C14 : account, business, called, condition, cost, find, forced, ge
t, having, money, paid, pay, present, seamen, shall, spent, time, tr
easurer, want, war
16
C09 : brouncker, chancellor, crewe, dined, done, earl, edward, hin
chingbroke, letter, lord, montagu, moore, peterborough, place, sandw
ich, sea, tangier, told, treasurer, visit
C10 : brouncker, chancellor, crewe, dined, done, earl, edward, hin
chingbroke, letter, lord, montagu, moore, peterborough, place, sandw
ich, sea, tangier, told, treasurer, visit
20
C23 : brave, castlemaine, chamber, chapel, child, court, dressed,
duchesse, elizabeth, hampton, ladies, monmouth, montagu, mother, pi
erce, portsmouth, portugall, pretty, queene, somerset
C23 : brave, castlemaine, chamber, chapel, child, court, dressed,
duchesse, elizabeth, hampton, ladies, monmouth, montagu, mother, pi
erce, portsmouth, portugall, pretty, queene, somerset
20
C16 : coming, content, danger, deal, fear, great, having,
intend, joy, matter, mind, persons, pleasure, small, talk,
trouble, troubles, world
C17 : coming, content, danger, deal, fear, great, having,
intend, joy, matter, mind, persons, pleasure, small, talk,
trouble, troubles, world
20
C08 : act, against,
house, houses, lords,
h, time, vote, voted,
C08 : act, against,
house, houses, lords,
h, time, vote, voted,
20
bill, brought, coffee, commons,
ordered, proceedings, somerset,
westminster
bill, brought, coffee, commons,
ordered, proceedings, somerset,
westminster
honour,
tangier,
honour,
tangier,
desired, full,
speaker, speec
desired, full,
speaker, speec
C02 : batten, brouncker, business, carteret, company, coventry, fi
nd, john, know, minnes, navy, pen, robert, sir, smith, thomas, towe
r, treasurer, trinity, william
C02 : batten, brouncker, carteret, company, coventry, find, georg
e, john, know, minnes, pen, robert, sir, smith, tells, thomas, towe
r, treasurer, trinity, william
18
C20
:
coach, cost, done, eyes, fashion, find, fine, gold, having,
C20 : coach, cost, done, eyes, fashion, find,
hewer, home, mightily, mighty, pepys, picture,
wife, work
C22 : coach, cost, done, eyes, fashion, find,
hewer, home, mightily, mighty, pepys, picture,
wife, work
20
C13 : body, full, garden, ill, little, met,
le, poor, pretty, see, sight, strange, thing,
ater, young
C29 : fire, full, garden, ill, little, met,
le, poor, pretty, see, sight, strange, thing,
ater, young
19
fine, gold, having,
pretty, put, think,
fine, gold, having,
pretty, put, think,
mightily, mighty, peop
think, town, walked, w
mightily, mighty, peop
think, town, walked, w
C11 : bill, blessed, buried, dead, fallen, fear, ill,
news, odd, people, plague, sad, sick, sickness, street,
ed, week
C11 : bill, blessed, buried, dead, fallen, fear, ill,
news, odd, people, plague, sad, sick, sickness, street,
ed, week
20
joy, london,
town, troubl
joy, london,
town, troubl
C06 : albemarle, arlington, attended, buckingham, business, chance
llor, coventry, done, duchesse, duke, gone, james, matter, meet, mid
dleton, mightily, occasion, prince, wren, york
C06 : albemarle, arlington, attended, buckingham, business, chance
llor, coventry, done, duchesse, duke, glad, james, matter, meet, mid
dleton, mightily, occasion, prince, wren, york
19
C24 : away, back, before, boy, clock, coach, get, go, going, got,
home, horse, horses, lay, leave, street, thither, took, way, went
C25 : away, back, bed, before, clock, coach, fine, get, go, going,
got, horse, lay, leave, little, saw, street, took, way, went
16
C29 : accounts, against, bless, blessed, continue, ends, estate, f
it, full, god, good, health, heart, keep, knows, making, pray, shal
l, world, worth
C27 : accounts, against, bless, blessed, continue, estate, fit, fu
ll, god, good, health, heart, high, keep, knows, making, pray, shal
l, world, worth
19
C04 : ago, boy, buried, burning, came, day, fast, find, go, govern
ment, kept, letters, london, observed, ordered, pepys, preach, princ
esse, resolve, weather
C04 : ago, boy, buried, burning, came, day, fast, find, go, govern
ment, kept, letters, london, observed, ordered, pepys, preach, princ
esse, resolve, weather
20
C10 : chapel, closet, gallery, going, gone, hall, heard, kiss, me
t, montagu, park, parke, privy, queen, seale, walked, walking, wate
r, westminster, white
C09 : chapel, closet, gallery, going, gone, hall, heard, met, mont
agu, park, parke, privy, queen, seale, st, walked, walking, water, w
estminster, white
19
19
C18 : afternoon, agreed, board, business, draw, drawing, glad, hew
er, letter, long, making, met, morning, navy, office, sat, till, tim
e, went, writing
C18 : afternoon, agreed, board, business, comes, draw, drawing, gl
ad, hewer, letter, long, making, met, morning, office, sat, till, ti
me, went, writing
19
C21 : believe, book, chapel, church, fellow, heard, paul, people,
pleases, poor, preach, preached, read, rochester, sermon, st, stree
t, sunday, time, yard
C20 : believe, book, books, church, fellow, heard, paul, people, p
leases, poor, preach, preached, read, rochester, sermon, st, street,
sunday, time, yard
19
C25 : against, best, business, council, coventry, discourse, done,
give, himself, man, navy, says, service, take, tell, thing, things,
think, told, world
C01 : against, best, business, council, coventry, discourse, done,
give, go, himself, man, says, service, take, tell, thing, things, th
ink, told, world
19
C17 : act, afternoon, against, believe, brought, came, chosen, com
mittee, crewe, free, general, lambert, members, monk, news, parliame
nt, sit, soldiers, told, voted
C16 : act, afternoon, against, believe, brought, came, chosen, com
mittee, crewe, free, general, lambert, members, monk, news, parliame
nt, sit, soldiers, told, voted
20
C05 : carteret, castlemaine, child, coach, court, creed, daughter,
dined, handsome, hinchingbroke, husband, ladies, lady, married, park
e, sandwich, tells, wardrobe, week, woman
C05 : carteret, castlemaine, child, coach, court, creed, daughter,
dined, handsome, hinchingbroke, husband, ladies, lady, married, park
e, sandwich, tells, wardrobe, week, woman
20
C26 : aged, brother, charles, created, daughter, died, earl, fathe
r, henry, ii, john, married, ob, privy, secretary, sir, son, state,
thomas, william
C26 : brother, charles, created, daughter, died, earl, father, hen
ry, ii, john, married, ob, privy, seale, secretary, sir, son, state,
thomas, william
19
C01 : before, believe, believes, brought, chancellor, court, done,
england, hath, himself, know, man, peace, received, says, shall, tel
ls, thing, thinks, world
C13 : before, believe, believes, brought, chancellor, court, done,
england, good, hath, know, man, peace, received, says, shall, tells,
thing, thinks, world
19
18.833333333333332
Concluding Discussion
“The goal is not to use the machine to supplant the judgment and expertise of a human expert who has spent
a lifetime reading some corpus, but rather to see if the classifications can ‘provoke’ new insight amongst a
body of familiar texts.”
Matthew G. Kirschenbaum (2007).
The Remaking of Reading: Data Mining and Digital Humanities
The National Science Foundation Symposium on Next Generation of Data Mining and Cyber-Enabled
Discovery for Innovation
http://www.csee.umbc.edu/~hillol/NGDM07/abstracts/talks/MKirschenbaum.pdf
(http://www.csee.umbc.edu/~hillol/NGDM07/abstracts/talks/MKirschenbaum.pdf)