Tech Stack
Responsibilities
- Design and implement video annotation tasks and guidelines including captioning, action, scene, and ranking preference.
- Establish annotation quality control systems including gold set, sampling, multi-round review, and Inter-Annotator Agreement (IAA).
- Build video generation evaluation and benchmarking frameworks combining manual and automated evaluation methods.
- Manage annotation vendors or crowdsourcing teams to control delivery quality, consistency, and rework.
- Collaborate with algorithm teams to align data standards with PT, SFT, RLHF, and Evaluation phases.
Soft Skills
Video AnnotationMulti-Modal DataEvaluation And BenchmarkingRlhfSftCross-Functional CollaborationVendor Management
Requirements
Regions: Us
Get jobs like this in your inbox
Weekly Vlm hiring trends and salary data — free.
Join 8 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About embedding-vc
Industry: saas
Size: small
An AI start-up focusing on training proprietary video generation foundation models.
View company profile →Similar Jobs
视频生成模型 · 训练 Infra 工程师
embedding-vc · San Francisco Bay Area
Member of Technical Staff, Data & ML Infrastructure for Video Models
cantina · Remote (U.S. or Europe)
Remote
$200k – $260k
Member of Technical Staff (Data Scientist, Evals)
perplexity · San Francisco
Model Evaluation QA Lead
Deepgram · USA | Remote
Remote
Member of Technical Staff - Evaluations
Reflection AI · San Francisco