Data Annotator
Location: Remote in Toronto, CA or Remote in Vancouver, CA
Join a trailblazing AI company at the forefront of computer vision innovation. This team is redefining how data shapes intelligent systems, and they are searching for a skilled and detail-oriented Data Annotator to support their rapidly scaling annotation programs. This is a high-impact opportunity to contribute to the development of industry-shaping machine learning models used in real-world applications. As part of a growing AI/ML organization, you’ll play a key role in ensuring the quality and accuracy of data assets that drive model performance and innovation.
Key Responsibilities:
- Support the full lifecycle of annotation projects, from guideline interpretation to dataset finalization, across a variety of visual data (images and video).
- Apply taxonomy and labeling structures to generate high-fidelity annotations that meet project specifications.
- Execute quality control protocols including consensus labeling, audit checks, and reviewer calibration routines.
- Collaborate with annotation leads and engineers to implement and refine labeling workflows for scalability and efficiency.
- Assist in the tracking of key performance indicators (precision, recall, SLA attainment) and participate in continuous quality improvement efforts.
- Help identify edge cases and challenging data patterns, contributing to dataset curation and bias mitigation strategies.
- Utilize annotation tools such as CVAT, Label Studio, or similar platforms to complete structured labeling tasks accurately and efficiently.
- Contribute to documentation updates, feedback sessions, and process audits to maintain high-quality standards and operational clarity.
What You Bring:
- Prior experience in data annotation or quality assurance in the AI/ML space, particularly within computer vision projects.
- Understanding of labeling taxonomies, annotation guidelines, and quality control metrics like inter-annotator agreement (IAA).
- Comfortable working with structured guidelines and able to flag ambiguous cases or propose refinements.
- Strong attention to detail and organizational skills with the ability to meet throughput and accuracy targets.
- Experience working with annotation tools (e.g., Label Studio, CVAT, or equivalent).
- Familiarity with concepts like gold-task seeding, audit sampling, and active learning workflows is a plus.
- Excellent communication and teamwork skills, with the ability to operate independently in a remote-first environment.
Preferred Qualifications:
- Exposure to projects involving segmentation, classification, or object detection.
- Background in a data-driven role involving visual data labeling, QC, or dataset operations.
- Knowledge of Python or SQL for reviewing data, automating tasks, or performing light troubleshooting is a plus.
- Enthusiasm for contributing to responsible AI practices, including bias detection and mitigation.
Why Apply:
- Be part of a mission-driven team making an impact in AI and computer vision.
- Gain exposure to ML model development pipelines and cutting-edge dataset operations.
- Work in a flexible, remote-first environment with a collaborative, supportive culture.
- Opportunities for career advancement as the team grows and evolves.
About Blue Signal:
Blue Signal is an award-winning, executive search firm specializing in various specialties. Our recruiters have a proven track record of placing top-tier talent across industry verticals, with deep expertise in numerous professional services. Learn more at bit.ly/46Gs4yS