Building computer vision models for healthcare, particularly in medical diagnostics, requires high-quality datasets and annotations due to the direct impact these models have on individual lives. A quality assurance (QA) workflow is crucial for ensuring the accuracy and reliability of medical image annotations. For such workflows, data must be annotated by multiple medical professionals to achieve consensus, minimizing bias and enhancing model generalization. This process involves several steps: selecting and dividing datasets, establishing a comprehensive labeling protocol, and conducting practice annotations to align expectations and ensure consistency. Continuous monitoring and a structured workflow help identify and address common annotation errors, ensuring regulatory compliance and model performance. Encord’s DICOM Annotation Tool exemplifies how tools tailored to the needs of medical professionals can streamline this process by integrating seamlessly with clinical practices, thereby enhancing the efficiency and quality of medical image annotations.