You use ~ when you are expressing an opinion or feeling to emphasize that you mean what you are saying, especially when the person you are speaking to may not like it.
‘You don’t give a damn about my feelings, do you.’—‘Quite ~, I don’t.’...
Frankly, Thomas, this question of your loan is beginning to worry me...
ADV: ADV with cl, ADV adj/-ed emphasis
see also frank