Job Listing
Search and AI Evaluations
National Institute of Standards and Technology · Posted 135 days ago
About the Role
Join NIST to lead research and development for AI and Generative AI testing, evaluation, and validation across diverse modalities. You will independently design and code web-based measurement applications for data quality, scoring, and analysis. This role involves leading technical publications and providing programming expertise to core research areas. By driving these evaluation processes, you will ensure the integrity of measurement and the rigorous standards of critical agency AI systems.
What You'll Do
- →As a Search and AI Evaluations, you will serve as a technical expert responsible for advancing the safety and efficacy of next-generation AI systems.
- →In this position, you will: Plan and execute comprehensive research activities focused on Test, Evaluation, Validation, and Verification (TEVV) processes for Artificial Intelligence and Generative AI across diverse modalities (e.g., text, image, audio) and use cases.
- →Independently design, program, and maintain web-based applications and support tools used for data quality assurance, automated scoring, complex analysis, and the generation of technical reports.
- →Lead the development of technical briefs, white papers, and peer-reviewed publications; present findings to stakeholders to influence AI policy and technical standards.
Requirements
- ✓This position has an education requirement.
- ✓Transcripts must be submitted to validate that the education requirement has been met.
- ✓Unofficial transcripts will be accepted in the application package.
- ✓However, an official copy will be required before a final offer of employment.
- ✓Use of foreign education for qualifications.
- ✓An accredited organization must evaluate education completed outside of the U.S. to ensure that it is comparable to education received in accredited institutions in the U.S.
- ✓Click here to view a listing of accredited organizations from the Department of Education's website.
- ✓A copy of the foreign education evaluation (containing the results with a course-by-course listing) is required with your application.
Personality Fit
Job ID: 77aea136-150d-49b4-bb67-bae35649804e
Posted via USAJobs