Deep Learning for NLP
(CSE 587)
Revised on 1/8/2025
Mon & Wed
2:30PM - 3:45PM
Health and Hum Dev 353
Instructor: Prof. Wenpeng Yin, wenpeng@psu.edu
Office hours: W328, 10-11am Wed
TA: Janice Ahn (jfa5672@psu.edu)
Course Intro
&
Objectives
The course requires strong programming skills, with a preference for Python/Pytorch. It will cover mainstream NLP tasks and explore advanced NLP techniques including deep learning and large language models (LLMs).
The objectives of the course are threefold:
Develop a comprehensive understanding of Deep Learning techniques.
To build expertise in applying Large Language Models (LLMs)
Enhance research skills by leveraging Deep Learning for NLP-focused studies.
There are no required textbooks for this course, but some chapters of the following books are recommended for reading during this course:
Aston Zhang, Zack C. Lipton, Mu Li, Alex J. Smola. "Dive into Deep Learning"
Dan Jurafsky and James H. Martin, “Speech and Language Processing”, 2024
Chris Manning and Hinrich Schütze, “Foundations of Statistical Natural Language Processing”, 1999
Class Materials
Grading Policy
Your final grade for the course will be based on the following:
Attendance: 10%
Homework: 20% (2 homeworks in total)
Midterm project: 30%
Final project: 40%
Grades will be assigned on the following scale:
93+: A
90-92: A-
87-89: B+
83-86: B
80-82: B-
75-79: C+
70-74: C
60-69: D
59 and below: F
Late Submission Policy
On time: maximal score: 100%
Late but before I release other students' scores: maximal 50%
Late and after I release others' scores: score 0
Schedule
This schedule is subject to change throughout the semester. Changes will be communicated in class and through Canvas.
If you need CSE-specific compute resources, please refer to this link: https://www.eecs.psu.edu/cse-student-lab-access/index.aspx
Please send me an email about your absence (w/ proof if you have) before the class. Explanation after the class is unacceptable.
Academic Integrity
Academic integrity is the pursuit of scholarly activity in an open, honest, and responsible manner. Academic integrity is a basic guiding principle for all academic activity at The Pennsylvania State University, and all members of the University community are expected to act in accordance with this principle. Consistent with this expectation, the University’s Code of Conduct states that all students should act with personal integrity, respect other students’ dignity, rights, and property, and help create and maintain an environment in which all can succeed through the fruits of their efforts.
Academic integrity includes a commitment by all members of the University community not to engage in or tolerate acts of falsification, misrepresentation, or deception. Such acts of dishonesty violate the fundamental ethical principles of the University community and compromise the worth of work completed by others.
Penn State welcomes students with disabilities into the University’s educational programs. Every Penn State campus has an office for students with disabilities. Student Disability Resources (SDR) website provides contact information for every Penn State campus (https://equity.psu.edu/offices/student-disability-resources/campus-offices). For further information, please visit Student Disability Resources website (http://equity.psu.edu/sdr/).
In order to receive consideration for reasonable accommodations, you must contact the appropriate disability services office at the campus where you are officially enrolled, participate in an intake interview, and provide documentation: See documentation guidelines (http://equity.psu.edu/sdr/guidelines). If the documentation supports your request for reasonable accommodations, your campus disability services office will provide you with an accommodation letter. Please share this letter with your instructors and discuss the accommodations with them as early as possible. You must follow this process for every semester that you request accommodations.
Accommodations for Students with Disabilities
Counseling and Psychological Services
Many students at Penn State face personal challenges or have psychological needs that may interfere with their academic progress, social development, or emotional wellbeing. The university offers a variety of confidential services to help you through difficult times, including individual and group counseling, crisis intervention, consultations, online chats, and mental health screenings. These services are provided by staff who welcome all students and embrace a philosophy respectful of clients’ cultural and religious backgrounds, and sensitive to differences in race, ability, gender identity and sexual orientation.
Counseling and Psychological Services at University Park (CAPS)
(http://studentaffairs.psu.edu/counseling/): 814-863-0395Counseling and Psychological Services at Commonwealth Campuses
(https://senate.psu.edu/faculty/counseling-services-at-commonwealth-campuses/)Penn State Crisis Line (24 hours/7 days/week): 877-229-6400
Crisis Text Line (24 hours/7 days/week): Text LIONS to 741741
Penn State takes great pride to foster a diverse and inclusive environment for students, faculty, and staff. Acts of intolerance, discrimination, or harassment due to age, ancestry, color, disability, gender, gender identity, national origin, race, religious belief, sexual orientation, or veteran status are not tolerated and can be reported through Educational Equity via the Report Bias webpage (http://equity.psu.edu/reportbias/)
Educational Equity and Reporting Bias
Reporting Sexual Misconduct
Sexual misconduct is never tolerated at Penn State. Prohibited conduct includes sexual and gender-based harassment, stalking, sexual assault, and dating violence. These behaviors are not allowed in the classroom, the campus community, labs, or anywhere students, staff, and faculty are located. Prohibited behaviors can include degrading comments such as belittling female-identified students, LGBTQ+ individuals, and gender-diverse students. It can also include harassment, touching someone without their consent, following someone without consent, repeated calls or messaging, physical acts of violence, and more. In other words, professional and appropriate behavior is always expected, and inappropriate or unprofessional behavior is never tolerated. For more information, please refer to the Student Code of Conduct and Penn State Policies AD85 and AD91. (Title IX Sexual Harassment | Penn State Policies (psu.edu) and Discrimination and Harassment and Related Inappropriate Conduct | Penn State Policies (psu.edu))
If you or anyone you know has experienced or is concerned about inappropriate or unprofessional behavior, you can talk with College, or School leadership, your instructor, academic advisor, or another trusted faculty/staff member, report to police or the Office of Sexual Misconduct Reporting & Response (titleix.psu.edu), or you can seek confidential support and assistance from the Gender Equity Center. The Gender Equity Center supports any student who has had negative relationship experiences including those impacted by sexual violence, relationship violence, stalking, harassment, and other campus climate issues. Services include one on one crisis intervention/support, advocacy, exploring options, accommodations, safety planning, and referrals. They also promote awareness, build support for survivors, and conduct educational programs and events. All services are free and confidential. Gender Equity Center | Penn State Student Affairs (psu.edu)