Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
Tailor your resume to this 视频数据标注 & 评测专家 / 负责人 role.
Rezi rewrites your resume against Embedding VC's job description. Free.
Tailor your resume to this 视频数据标注 & 评测专家 / 负责人 role.
Rezi rewrites your resume against Embedding VC's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the 视频数据标注 & 评测专家 / 负责人 posting at Embedding VC — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the 视频数据标注 & 评测专家 / 负责人 posting at Embedding VC — free, in seconds.
Responsibilities
- Design and implement various video annotation tasks and specifications, including caption alignment, action, scene, style, camera work, temporal consistency, ranking/preference, and bad case classification.
- Build an annotation quality inspection system with gold sets, spot checks, multi-round reviews, and inter-rater agreement (IAA) to ensure stable and iterative annotation quality.
- Manage annotation vendors and crowdsourcing teams to control delivery quality, consistency, and rework.
- Continuously iterate on annotation guidelines and standards based on model bad cases.
- Establish a video generation evaluation system, including building evaluation sets/benchmarks and designing evaluation dimensions and metrics (image quality, action naturalness, temporal consistency, prompt matching, bad frames/deformations/flickering, etc.), combining manual and automatic evaluation.
- Create a bad case classification and feedback mechanism to translate evaluation results into actionable data supplementation and annotation standard adjustments.
- Support multi-version model comparisons and track data usage effectiveness and model improvements.
- Collaborate with the algorithm team to understand the different data requirements for PT, SFT, RLHF, and Eval stages, driving continuous iteration of data standards.
Requirements
- 3+ years of relevant experience in video, image, or multimodal data annotation or evaluation (excluding pure text NLP).
- Hands-on experience and ability to clearly explain the differences and specific methods of various video annotation tasks.
- Familiarity with annotation quality inspection systems, with practical experience in at least one mechanism such as gold sets, spot checks, IAA, or reviewer calibration.
- Experience collaborating with algorithm teams and driving bad case feedback.
- Strong ability to organize processes and communicate across teams.
Skills
- Video annotation
- Annotation quality inspection
- Vendor management
- Crowdsourcing management
- Video evaluation
- Data analysis
- Process management
- Cross-team communication
Experience Level
- 3+ years