A joint study by Oliver Wyman and AEM found declining sentiment in construction and agricultural manufacturing.