CS 4650 and 7650

• Course: Natural Language Understanding
• Instructor: Jacob Eisenstein
• Semester: Spring 2017
• Time: Mondays and Wednesdays, 3:05-4:25pm
• TAs: Umashanthi Pavalanathan, Murali Raghu Babu, Robert Guthrie, James Mullenbach
• Schedule
• Synopses of previous classes

This course gives an overview of modern data-driven techniques for computationally analyzing natural language. The course moves from shallow bag-of-words models to richer structural representations of how words interact to create meaning. At each level, we will discuss the salient linguistic phemonena and most successful computational models. Along the way we will cover machine learning techniques which are especially relevant to natural language processing.

• Readings
• Grading
• Help
• Policies

Learning goals

Readings

Readings will be drawn from my notes, from published papers and tutorials, and from the following two texts:

• Linguistic Fundamentals for NLP. You should be able to access this PDF for free from a Georgia Tech computer.
• Foundations of Statistical NLP. A PDF version is accessible through the GT library.

Supplemental textbooks

These are completely optional, but might deepen your understanding of the material.

• Speech and Language Processing is the textbook most often used in NLP courses. It's a great reference for both the linguistics and algorithms we'll encounter in this course.
• Natural Language Processing with Python shows how to do hands-on work with Python's Natural Language Toolkit (NLTK), and also brings a strong linguistic perspective.
• Schaum's Outline of Probability and Statistics can help you review the probability and statistics that we use in this course.

Grading

• Seven short homework assignments, of which you must do five. Most of these involve performing linguistic annotation on some text of your choice. The purpose is to get a basic understanding of key linguistic concepts. Each assignment should take less than an hour. Each homework is worth 2 points (10 total).
• Five assigned problem sets. These involve building and using NLP techniques which are at or near the state-of-the-art. The purpose is to learn how to implement natural language processing software, and to have fun. These assignments must be done individually. Each problem set is worth ten points (50 total). Students enrolled in CS 7650 will have an additional, research-oriented component to the problem sets.
• An in-class midterm exam, worth 20 points, and a final exam, worth 20 points. The purpose of these exams are to assess understanding of the core theoretical concepts, and to encourage you to review and synthesize your understanding of these concepts. Barring a personal emergency or an institute-approved absence, you must take the exam on the days indicated in the schedule. See here and here for more information on GT policy about absences.

Late policy

Problem sets will be accepted up to 72 hours late, at a penalty of 20% per 24 hours. (Maximum score after missing the deadline: 8/10; maximum score 24 hours after the deadline: 6/10, etc.) It is usually best just to turn in what you have at the due date. Late homeworks will not be accepted. This late policy is intended to ensure fair and timely evaluation.

Getting help

Office hours

• James: Mon 10:30-11:30 (CCB commons)
• Jacob: Tues 3:00-4:00 (CCB 316)
• Umashanthi: Wed 1:00 - 2:00 (CCB commons)
• Robert: Thurs 9:30-10:30 (CCB commons)
• Murali: Friday 2:00-3:00 (CCB commons)

Online help

Please use Piazza rather than personal email to ask questions. This helps other students, who may have the same question. Personal emails may not be answered. If you cannot make it to office hours, please use Piazza to make an appointment. It is unlikely that I will be able to chat if you make an unscheduled visit to my office. The same is true for the TAs.

Class policies

Multiple studies have shown that using a laptop in class -- even for taking notes -- reduces students' educational attainment. I suggest you try pen and paper for a few weeks, and see if it helps you concentrate. Whatever technology you decide to use, it is your responsibility to ensure that it does not distract your classmates or me.

Prerequisites

Collaboration policy

One of the goals of the assigned work is to assess your individual progress in meeting the learning objectives of the course. You may discuss the homework and projects with other students, but your work must be your own -- particularly all coding and writing. For example:

Examples of acceptable collaboration

• Alice and Bob discuss alternatives for storing large, sparse vectors of feature counts, as required by a problem set.
• Bob is confused about how to implement the Viterbi algorithm, and asks Alice for a conceptual description of her strategy.
• Alice asks Bob if he encountered a failure condition at a "sanity check" in a coding assignment, and Bob explains at a conceptual level how he overcame that failure condition.
• Alice is having trouble getting adequate performance from her part-of-speech tagger. She finds a blog page or research paper that gives her some new ideas, which she implements.

Examples of unacceptable collaboration

• Alice and Bob work together to write code for storing feature counts.
• Alice and Bob divide the assignment into parts, and each write the code for their part, and then share their solutions with each other to complete the assignment.
• Alice or Bob obtain a solution to a previous year's assignment or to a related assignment in another class, and use it as the starting point for their own solutions.
• Bob is having trouble getting adequate performance from his part-of-speech tagger. He finds source code online, and copies it into his own submission.
• Alice wants to win the Kaggle competition for a problem set. She finds the test set online, and customizes her submission to do well on it.

Some assignments will involve written responses. Using other people’s text or figures without attribution is plagiarism, and is never acceptable.

Suspected cases of academic misconduct will be (and have been!) referred to the Honor Advisory Council. For any questions involving these or any other Academic Honor Code issues, please consult me, my teaching assistants, or http://www.honor.gatech.edu.