The centrality of reconciliation within the church’s theology and the power of symbols of reconciliation within its life have paradoxically limited the church’s ability to seek reconciliation for wrongdoing done in its name. In this article the author explores this apparent paradox by examining a particularly bold symbol of reconciliation developed within the church, namely the public penance performed by the Emperor Theodosius at the urging of St Ambrose.