Course Overview

Understanding artificial intelligence is now a core competency for evaluation and research professionals. This course provides participants with foundational knowledge and applied skills to begin integrating AI tools into their practice, regardless of prior experience. By the end of this session, learners will walk away with both a practical toolkit and a clear ethical framework for using AI in responsible, effective ways.

What You Will Learn

In this interactive three-hour course, participants will receive a comprehensive introduction to AI in the context of evaluation and research. The session covers:

• Core AI concepts, including the difference between generative and deterministic models
• Principles of prompt engineering and how to design effective prompts
• Real-world use cases in evaluation, including text analysis and rapid evidence synthesis
• A guided comparison of leading large language models (LLMs), such as ChatGPT, Claude, and Llama
• Key ethical considerations, including bias, transparency, and data privacy

Course Format

This course is delivered as one three-hour live, virtual, instructor-led session (or half a day in person). The session is interactive and includes demonstrations and hands-on exercises using real data. All tools and datasets are provided during the session.

Module Breakdown

The module introduces participants to core AI concepts and provides a practical foundation for understanding how different types of models work, including generative and deterministic approaches. Participants learn prompt engineering principles and practice designing prompts that support evaluation and research tasks. The module then focuses on applied use cases, including AI-assisted research methods, rapid evidence synthesis, and text analysis. Participants also explore introductory-level statistical analysis and practice thematic coding and qualitative analysis using large language models. Throughout the module, the instructor guides participants in comparing tools such as ChatGPT, Claude, and Llama and in applying ethical considerations related to bias, transparency, and data privacy.

Who Should Attend

This course is designed for evaluators, researchers, analysts, and learning professionals who want to understand and apply AI tools in their work. No prior AI or coding experience is required.

Prerequisites

There are no prerequisites. All tools and datasets will be provided during the session.