Automatically gathering quality metrics