A fairly long read. I have a lot to say about this course:
NLP was my 6th course in the program and by far the most frustrating. I finished with an A before the curve. My only taste of machine learning thus far was ML4T. I am also not a professional software engineer and work in a completely different industry.
The lack of ML/DL knowledge did make this class more difficult, however it was obviously doable for me. Those of you who have prior experience with the fundamentals of neural networks and probability will have a much smoother time overall.
As many others have mentioned, Dr. Riedl’s lectures were quite good. However, I’m personally reluctant to give the class bonus points for having quality lecture material. With rising tuition costs every semester, an emphasis on rigor, and the supposed degree quality from a well-respected institution, professional lecture material should be the standard for the program - not some special outlier. Furthermore, these lectures only account for ~60% of all course content, as the infamous Meta AI lectures flesh out the rest. These are disjointed and horrible in comparison and should have no place in a high-quality educational environment.
Again, lectures with good audio, a coherently speaking professor, and well put-together slides accompanying his commentary should be a basic fundamental aspect of the program. Some other classes struggle with this, but I also didn’t find these lectures much better than anything from KBAI, ML4T, or RAIT, and I believe they are overhyped because of the adjacent Meta AI lectures.
This semester, logistical changes were made to the course that resulted in closed note, closed book exams and quizzes that account for 50% of the overall grade. There is an honorlock proctored quiz almost every week, requiring a full room scan and the removal of all other monitors from the room entirely. These quizzes are maybe 4 questions long at most and include multiple-choice or multi-select questions. The grading methodology for multi-select questions is punishing in comparison to other courses I’ve taken. There was a decent handful of ambiguous or debatable questions across the quizzes. Some resulted in regraded free points, while others were ignored. I’m not entirely sure what constituted a regrade for quiz questions.
The midterm tested content from a ton of lecture videos with only 19 questions and accounted for 20% of the overall grade, making each point on the midterm worth just over 1% of the overall grade. There were 3 flawed questions on the midterm with one being flat-out wrong, and another containing a typo that affected how some students interpreted the requirements of the question. The first question set the stage for a follow-up question that depended on your answers on it.
The first one affected my score, while the second did not (I was able to infer what was required and do not even notice the typo). They offered a retake quiz to correct these questions and make up points. I finished with a high B on the exam after the retake quiz, and if it weren’t for a couple dumb mistakes on two other questions, I would have had a perfect score.
This required an insane amount of preparation and studying, however. I burned myself out pretty hard and put myself through a ton of stress worrying about these high-stakes exams. A practice exam was released beforehand, but myself and many other students did not find it as accurately reflective of the actual exam as one would hope. Nevertheless, it was decent study material to work with.
The new emphasis on challenging exams is in response to overinflated high performance on the homework programming assignments, which are a collection of Jupyter notebooks that have you read through summaries, code, and fill in blanks. They suspect these are being “vibe-coded” and don’t know what to do about it.
Aside from the 5th and final assignment, these are all abnormally easy and require 1-2 hours at most to complete. They offer way too much implemented for you, and only ask for maybe 20-40 lines of code. The final assignment suddenly pulls the rug out from underneath you and is much more difficult in comparison.
The overwhelming majority of the homework content is relative to the first half of the course, leaving you with only the Meta AI lectures to absorb the second half. They also include a decent amount of confusing instructions or function names that give you pause, cleared up by other students on Ed who acknowledge this and take the extra time experimenting, instead of responses from the instructional team.
The Final exam was similar to the Midterm, but without the broken questions. Again, this is on content from mostly Meta AI lectures without homework assignments to practice or reinforce the ideas. There is a wide breadth of potential material and you are required to memorize everything to be prepared for the exam. I ended up doing better than I thought on the Final, and finished with a mid-B average on Quizzes and 100% on homework, which secured my A in the course before the curve.
A curve of +2.5% was added at the end of the course, as well as a 0.5% grade cutoff reduction (e.g. an A went from 89.5% to 89.0%). This was introduced to align grade averages with previous semesters, which I’m not sure I understand. They were so concerned about overinflated grades from previous semesters, so they increased exam difficulty dramatically, just to curve back to the grades of before. Whatever.
The instructional team is unfortunately the worst I’ve encountered in the program. They should be embarrassed by their blatant lack of professionalism. They are extremely slow to respond - if they even respond at all. By slow to respond, I mean that some questions take weeks to get a response, or get ignored entirely.
The head TA does nothing except respond to a few logistical design questions (exam difficulty increase, quiz question format, etc) with lengthy over-complicated responses to justify them. All they did was change percentage weight values and sloppily rewrite 2 exams and some quizzes. This individual does this and makes a weekly copy-pasted post on Mondays detailing the material and due dates for the week, and just changes the date. I noticed mistakes here too (e.g. forgot to change dates, forgot to post it entirely).
Any mistakes that they made were explained with “this was rolled out too fast”. They clearly don’t check their work with the same rigor and attention to detail that we as students or everyday professionals do in our work environments. Some quiz question flaws (that resulted in regrades) have apparently even persisted across semesters! They are not engaged with the class and I’m not sure what they’re getting paid for. The overwhelming majority of questions - no matter the topic - are slowly figured out by fellow students, oftentimes with some uncertainty still lingering about. Many questions are left unanswered entirely, which I find unacceptable. The amount of “unresolved” I saw on my Ed Discussion was appalling.
The most responsive TA shows much better effort, but also doesn’t know the answers to a lot of questions and ends up tagging the head TA’s, who then never respond to the original question.
The professor is also completely absent from Ed discussions. During the midterm drama, he accidentally made a post saying “I give up. This isn’t fun anymore.” public for the class to see. It was up for maybe an hour before he took it down and never addressed it. While this was obviously an honest mistake on his behalf and probably an over-exaggeration, this does offer a glimpse into his sentiment and frustration over the state of the course. Similar to the head TA, aside from maybe a couple of logistical responses, he never engaged with the class. This was the most isolating course I've taken in the program by a long shot.
Prior reviews for the course are positive-biased because previous iterations did not have to worry about any of this. Without the changes from this semester, this course must have been so ridiculously easy to get an A in, and even easier to pass with a B. It probably felt like a semester off! With much lower-weighted exams and quizzes, open notes, and open book, I can see how suddenly those Meta AI lectures wouldn’t seem so bad and the horrible TA team becomes much more forgivable! None of that mattered because the class was just so easy so all they remember is that sweet, juicy A they got!
This is no longer the reality. You will have to work very hard for your A. If you just want a B, it’s a little easier, but still stressful. Just a few mistakes on those exams, and your grade tanks. Be prepared. I don’t mind a challenging course, but this course felt challenging for all the wrong reasons.
All of this being said, I learned a lot and I found the topics fascinating. The experience is just severely marred by disjointed course management, flawed material, and high-pressure exams. I really wish they would have had more interesting and challenging assignments that drive the “deep synthesis with the material” they want from their students. They also need to get rid of that Meta AI content entirely. Somehow, I doubt any of this will happen and they’ll either double down on the changes from this semester, or roll back to the previous design where sentiment was more favorable.
I’m torn on this course because the material is extremely interesting and fun to learn, but it’s hard to recommend overall. The experience really just tanks, fast. Also, only the first half of it is of acceptable quality, and most of the focus is on this half. I’m paying for a full course, not an appetizer.
If you’re interested, I might still give it a shot, but be prepared to deal with a lot of BS that is beyond your control.