A chantry is a small, private chapel, used exclusively for the chanting of masses for the souls of dead rich people, who could afford to create an endowment to pay the priest and maintain the building. A chantry would be empty most of the time, and therefore a nice private place for Olivia to get from Cesario (who she thinks Sebastian is) the vow of everlasting love that she longs for.