At one of California’s top universities, many freshmen are unable to do middle-school math.