You might find the following question on a first-grade math test: "Fill in the box: 7+2 = [blank] + 6." What you wouldn't expect is for 25 percent of incoming freshmen at a highly ranked university to ...

Though AI models have been trained to emit the correct answer and to recognize that "2 + 2 = 5" might be a reference to the ...