# Stopwords from Mallet

stopwords = frozenset("""a
able
about
above
according
accordingly
across
actually
after
afterwards
again
against
all
allow
allows
almost
alone
along
already
also
although
always
am
among
amongst
an
and
another
any
anybody
anyhow
anyone
anything
anyway
anyways
anywhere
apart
appear
appreciate
appropriate
are
around
as
aside
ask
asking
associated
at
available
away
awfully
b
be
became
because
become
becomes
becoming
been
before
beforehand
behind
being
believe
below
beside
besides
best
better
between
beyond
both
brief
but
by
c
came
can
cannot
cant
cause
causes
certain
certainly
changes
clearly
co
com
come
comes
concerning
consequently
consider
considering
contain
containing
contains
corresponding
could
course
currently
d
definitely
described
despite
did
different
do
does
doing
done
down
downwards
during
e
each
edu
eg
eight
either
else
elsewhere
enough
entirely
especially
et
etc
even
ever
every
everybody
everyone
everything
everywhere
ex
exactly
example
except
f
far
few
fifth
first
five
followed
following
follows
for
former
formerly
forth
four
from
further
furthermore
g
get
gets
getting
given
gives
go
goes
going
gone
got
gotten
greetings
h
had
happens
hardly
has
have
having
he
hello
help
hence
her
here
hereafter
hereby
herein
hereupon
hers
herself
hi
him
himself
his
hither
hopefully
how
howbeit
however
i
ie
if
ignored
immediate
in
inasmuch
inc
indeed
indicate
indicated
indicates
inner
insofar
instead
into
inward
is
it
its
itself
j
just
k
keep
keeps
kept
know
knows
known
l
last
lately
later
latter
latterly
least
less
lest
let
like
liked
likely
little
look
looking
looks
ltd
m
mainly
many
may
maybe
me
mean
meanwhile
merely
might
more
moreover
most
mostly
much
must
my
myself
n
name
namely
nd
near
nearly
necessary
need
needs
neither
never
nevertheless
new
next
nine
no
nobody
non
none
noone
nor
normally
not
nothing
novel
now
nowhere
o
obviously
of
off
often
oh
ok
okay
old
on
once
one
ones
only
onto
or
other
others
otherwise
ought
our
ours
ourselves
out
outside
over
overall
own
p
particular
particularly
per
perhaps
placed
please
plus
possible
presumably
probably
provides
q
que
quite
qv
r
rather
rd
re
really
reasonably
regarding
regardless
regards
relatively
respectively
right
s
said
same
saw
say
saying
says
second
secondly
see
seeing
seem
seemed
seeming
seems
seen
self
selves
sensible
sent
serious
seriously
seven
several
shall
she
should
since
six
so
some
somebody
somehow
someone
something
sometime
sometimes
somewhat
somewhere
soon
sorry
specified
specify
specifying
still
sub
such
sup
sure
t
take
taken
tell
tends
th
than
thank
thanks
thanx
that
thats
the
their
theirs
them
themselves
then
thence
there
thereafter
thereby
therefore
therein
theres
thereupon
these
they
think
third
this
thorough
thoroughly
those
though
three
through
throughout
thru
thus
to
together
too
took
toward
towards
tried
tries
truly
try
trying
twice
two
u
un
under
unfortunately
unless
unlikely
until
unto
up
upon
us
use
used
useful
uses
using
usually
uucp
v
value
various
very
via
viz
vs
w
want
wants
was
way
we
welcome
well
went
were
what
whatever
when
whence
whenever
where
whereafter
whereas
whereby
wherein
whereupon
wherever
whether
which
while
whither
who
whoever
whole
whom
whose
why
will
willing
wish
with
within
without
wonder
would
would
x
y
yes
yet
you
your
yours
yourself
yourselves
z
zero
""".split()
+ ["don't", "dont", "let's", "lets", "that's", "thats", "it's", "it'd", "it'll", "wasn't", "won't", "can't",
   "wouldn't", "couldn't", "didn't", "didnt", "what's", "who's", "gonna", "doesn't", "tho"]
+ ['i', "i'd", "i'll", "i'm", "i've", 'id', 'im', 'ive',
   'me', 'mine', 'my', 'myself',
   "let's", 'lets', 'our', 'ours', 'ourselves', 'us',
   'we', "we'd", "we'll", "we're", "we've", 'weve',
   "y'all", 'yall', 'you', "you'd", "you'll", "you're",
   "you've", 'youd', 'youll', 'your', 'youre', 'yours',
   'youve',
   'he', "he'd", "he's", 'hed', 'her', 'hers', 'herself',
   'hes', 'him', 'himself', 'his', 'she', "she'd",
   "she'll", "she's", 'shes',  # joining she with they
   'their', 'them', 'themselves', 'they', "they'd",
   "they'll", "they've", 'theyd', 'theyll', 'theyve', "they're", "theyre"]
+ ["ha", "haha", "hahaha", "hah", "hahahaha", "heh", "hehe", "hehehe", "lol", "lolol", "lololol", "lolololol", "idk"]
+ [":)", ":d", ":(", ":p", "o_o"]
+ [k * symbol for symbol in ["?", ",", ".", "!", "(", ")", "'", '"', "*"] for k in range(1, 10)]
+ ["hi", "hey", "hello", "yo", "sup", "yes", "yeah", "hmm", "good", "yay", "yea", "cheers"]
+ ["idea", "clue"]
+ """streetcrowd
game
play
click
map
answer
submit
zoom
minimap
chat
solo
player
streetview
google
googlemaps
googlemap
googlemaps
marker
button
""".split()
)