- evaluate ai models and agents according to detailed, pre-defined scenarios and guidelines.
- execute operational tasks to test model accuracy, reasoning, and responsiveness.
- document findings, observations, and anomalies in structured written reports.
- reset usage limits and repeat evaluations as required by project protocols.
- record findings and submit evaluation datasets on ai training platforms.
requirements
- experience with ai products, ai models, or ai agent evaluation and testing.
- demonstrated ability to follow complex instructions with precision and consistency.
- exceptional attention to detail and operational thoroughness.
- comfort working with repetitive or high-volume operational tasks.
- prior participation in digital product, software qa, or ai research projects is a plus.