Meeting Notes

Author

Josef Fruehwald

Modified

April 8, 2024

These are the notes for our regular meetings.

 

Setup Notes

python
We’ll need to get our systems setup to work properly with the tools we’ll be using this semester.
Jan 8, 2024
Josef Fruehwald

Regular Languages and Finite State Machines

compling
In another class, we might just jump straight into learning about “Regular Expressions”, which are very useful tools for searching for patterns in text.
Jan 16, 2024
Josef Fruehwald

 

FSA in-class notes

compling
ok(a+y)?
Jan 16, 2024
Josef Fruehwald

 

Pushdown Automata and Context Free Languages

compling
In the notes on Finite State Automata, we looked at this turnstile finite state automaton.
Jan 23, 2024
Josef Fruehwald

 

Regular Expressions, Quickly

python
The real content is in your regex-in-class-<username> repository on github. This is meant to be more of a reference sheet.
Jan 25, 2024
Josef Fruehwald

More Python: Poetry, Lists, Loops

python
This lesson has two goals:
Jan 30, 2024
Josef Fruehwald

Tokenization

compling
If you go take a look at the plain-text version of Moby Dick on Project Gutenberg, you’ll see that it starts out with the following block of text:
Feb 6, 2024
Josef Fruehwald

 

Working with Tokenizers

python
Let’s get a little bit practical with
Feb 8, 2024
Josef Fruehwald

ngrams

-or- What if we could parse natural language with a finite state automaton?
compling
So, in our notes on finite state automata and push-down automata we concluded that since natural language has bracket matching patterns, and maybe even crossing…
Feb 13, 2024
Josef Fruehwald

Sampling from a probability distribution

compling
From an n-gram model, we can generate new sequences by sampling from the probability distribution over tokens.
Feb 15, 2024
Josef Fruehwald

 

Making and Counting ngrams in python

python
Here, we’ll work through some of the practicalities of creating and counting ngrams from text. Let’s grab the book first.
Feb 15, 2024
Josef Fruehwald

Information Theory

compling
Let’s say you live in a studio apartment. It would probably have two big-light switches. One for the main room, and one for the the bathroom. One switch has two states
Feb 20, 2024
Josef Fruehwald

ngram “smoothing”

compling
In the notes on information theory, we talked about how we can evaluate texts with respect to language models, and vice versa, with metrics like perplexity.
Feb 27, 2024
Josef Fruehwald

 

Markov Models

compling
I started the notes on ngrams models saying that we can think of them like finite-state-automata, but with probabilities on each transition between states. Another word for…
Mar 7, 2024
Josef Fruehwald

Bayes Theorem

compling
Before we can get started with “Naive Bayes Classification”, we should maybe begin with “What is Bayes Theorem”.
Mar 19, 2024
Josef Fruehwald

 

Training and evaluating classifiers

python
There are some support functions in the read_data.py module
Mar 21, 2024
Josef Fruehwald

Logistic Regression

compling
A Naive Bayes classifier tries to build a model for each class. Recall Bayes’ Theorem:
Mar 25, 2024
Josef Fruehwald

 

Training and evaluating a logistic regression

python
Let’s do some sentiment classification with logistic regression! We’ll use the scikit-learn package (sklearn) to fit the logistic regression, as well as for train-test…
Mar 27, 2024
Josef Fruehwald

Term Frequency - Inverse Document Frequency

compling
One way to represent the content of a document, like a movie review, is with a binary code of 1, if a word appears in it, or a 0, if a word does not.
Apr 2, 2024
Josef Fruehwald

 

Classes

python
So far, the kinds of objects of our own that we’ve created in python are variables and functions.
Apr 9, 2024
Josef Fruehwald

Side Note

These patterns in log-log plots are not unique to language or linguistic data.

Josef Fruehwald

 

Python basics

python 
print(1)
1

Josef Fruehwald
No matching items
Back to top

Reuse

CC-BY-SA 4.0

Citation

BibTeX citation:
@online{fruehwald,
  author = {Fruehwald, Josef},
  title = {Meeting {Notes}},
  url = {https://lin511-2024.github.io/notes},
  langid = {en}
}
For attribution, please cite this work as:
Fruehwald, Josef. n.d. “Meeting Notes.” https://lin511-2024.github.io/notes.