CS 2881 Fall 26: Lecture 6: Grading, Reward Hacking, and Alignment

October 8, 2026 · John Schulman · Scribe notes by Idil Ada, Chenxi Ge, Joaquin, and Harry Hu Notes from CS 2881R: AI Alignment and Safety, Harvard, Fall 2026. Author Introductions Idil Ada: I am a Sophomore studying CS and Statistics. I am conducting AI safety research on how adversarial attack strength affects jailbreak robustness … Continue reading CS 2881 Fall 26: Lecture 6: Grading, Reward Hacking, and Alignment

CS 2881 Fall 26: Lecture 5: Economics of AI

October 1, 2026 · Erik Brynjolfsson and Chad Jones · Scribe notes by Kathryn, Eli, Sam, and Christopher Notes from CS 2881R: AI Alignment and Safety, Harvard, Fall 2026. Lecture video · Chad Jones’s slides · Experiment code Author Introductions Kathryn: Senior studying Computer Science and pursuing a concurrent master’s degree in Computer Science. I’ve … Continue reading CS 2881 Fall 26: Lecture 5: Economics of AI

CS 2881 Fall 26: Lecture 4: Recursive Self-Improvement and AI Trajectories

September 24, 2026 · Dwarkesh Patel and Daniel Kokotajlo · Scribe notes by Adam, Noa, Radha, Rosa, Niranjan, and Wency Notes from CS 2881R: AI Alignment and Safety, Harvard, Fall 2026. Author Intros Adam: I'm an MS/MBA student at Harvard and previously I worked as an ML engineer at Meta, building multimodal AI for Ray-Ban … Continue reading CS 2881 Fall 26: Lecture 4: Recursive Self-Improvement and AI Trajectories

CS 2881 Fall 26: Lecture 3: Modern LLM Training and Inference

September 17, 2026 · Boaz Barak · Scribe notes by Daniel Schwartz, Dev Desai, and Ed Gerrard Lecture Video: https://youtu.be/Lp_e8Ts5-nE   Slides: Presentation slides Authors’ Intro Daniel Schwartz: I’m a second-year MS/MBA student. I worked as a PM at multiple early-stage startups, most recently a startup focused on data privacy for AI use with sensitive … Continue reading CS 2881 Fall 26: Lecture 3: Modern LLM Training and Inference

CS 2881 Fall 26: Lecture 1: Introduction

Lecture Video: https://www.youtube.com/watch?v=j4WSktB5Ni0  Authors’ Intro Hanjing: I’m a Junior studying Applied Mathematics & CS. I’ve worked on research utilizing LLMs and ML in a plethora of fields, including sentiment analysis, code generation, natural language processing, and interpretability. On the other hand, I’m also fascinated by the theoretical foundations of AI alignment – which is why … Continue reading CS 2881 Fall 26: Lecture 1: Introduction

All Watched Over

I’ve recently been rereading Steven Levy’s “Hackers” with my daughter. Levy describes how Brautigan’s 1967 poem “All watched over by machines of loving grace”  was inspiring to the California  “Hardware Hackers” of the 1970s and organizations such as Community Memory.  In 2026, the phrase “all watched over by machines of loving grace” conjures an image … Continue reading All Watched Over