"I do think we had a lot of fun by ourselves in season one before we could have an audience," Ruffin tells E!, adding: "We are doing it big for the audience."