This article shares our results on challenges in engineering artificial intelligence (AI)-enabled computer vision systems for manufacturing and highlights critical success factors that have proven their worth. We provide AI engineers and development teams with timely and engaging inputs from the field.