A complete lack of oxygen in a bottle may allow sulfur compounds to form that are not particularly tasty. (sometimes called 'screw cap reduction')

This can be fixed by proper decantering though.