At John Chrysostom to women

I wish you women not only to abstain from other hurtful practices (here he has thusfar talked about not practicing exterior adornment by the wearing of comely, expensive clothes but rather simple modesty) but also from the practice of painting your faces and adding to them, as though the workmanship were defective. By doing so you insult the Workman. For what are you trying to do, woman? By using rouge and eyeshadow you cannot add to your natural beauty nor change your natural ugliness, can you? These add nothing to the beauty of your face, but they will destroy the beauty of your soul. For this meddling with nature testifies to your interior weakness. Especially are you heaping abundant fire for yourself by exciting the looks of young men, and attracting for yourself the eyes of the undisciplined; by making complete adulterers of them you are bringing their downfall onto your own head.
It is fitting and helpful to abstain from this practice entirely. But if those women who are caught in the grip of this evil habit should be unwilling to give up the use of cosmetics, at least let them not use them when they come to the house of prayer.
Why, tell me, when you come to church, do you adorn yourself this way? You have come to worship God and to make confession to Him in atonement for your sins. Does He look for this beauty? No. He seeks the beauty from within, he looks for activity which expresses itself in good deeds: almsgiving, temperance, compunction and strict faith. . You have forsaken these virtues, and you are trying to trip up many of the careless ones, even in church! By what thunderbolts do these actions deserve to be punished? You arrive in port and cause your own shipwreck. If some women in the past were so careless of their own salvation, let them now be persuaded to rid themselves of this outrageous practice. If the Apostle (Paul) forbade the use of expensive clothing, much more would he forbid the use of cosmetics and eyeshadow.
-from his baptismal instructions, given at Antioch 390 AD