"As with any building, there is a conversation between the principal and the architect," a White House official tells PEOPLE ...