Illuminate LLC

Tag: evaluation practice

  • Outputs vs. Outcomes: Are You Tracking Activity or Real Change?

    Outputs vs. Outcomes: Are You Tracking Activity or Real Change?

    You’ve delivered 10 workshops, trained 200 people, and distributed 500 resource guides. Congratulations! That’s a lot of work, and there’s plenty to be proud of.

    But here’s a question worth asking: What changed as a result?

    It’s a question that gets to the heart of the distinction between outputs and outcomes. And it’s one that can help us think differently about how we plan, measure, and report on our work.

    The Difference Between Doing and Achieving

    Outputs are the products and services that result directly from our activities. They tell us what we’ve delivered, such as workshops held, reports produced, or people trained.

    Outcomes, on the other hand, are the changes that follow. They might include new knowledge, improved skills, changes in behavior, or better conditions for the people and communities we serve.

    Consider a leadership development program. Delivering six coaching sessions and having 20 managers complete the program are outputs. But what we’re probably hoping for is something more. Perhaps managers communicate more effectively, handle difficult conversations with greater confidence, or create a more supportive environment for their teams.

    Those are outcomes.

    Of course, delivering the coaching sessions doesn’t guarantee those changes will happen. But understanding what we’re hoping to achieve helps us think more carefully about what to measure.

    Outputs and Outcomes Across Different Settings

    Here are a few examples of how the distinction applies in different settings.

    SettingOutputs: What We DeliverOutcomes: What Changes
    Professional Training45 participants complete an AI training programParticipants gain new skills, secure employment, and potentially improve their long-term earning opportunities
    Leadership Development20 leaders complete coaching and develop action plansLeaders apply new skills, improve team communication, and contribute to a more supportive workplace
    Personal Health and Fitness16 exercise sessions completed in a monthImproved strength and endurance, healthier habits, and potentially better long-term health

    Notice that outcomes can take time. Some changes, such as gaining knowledge or improving skills, may happen relatively quickly. Others, such as career advancement or organizational culture change, may take months or years.

    Try the “So What?” Test

    One of my favorite ways to move from outputs to outcomes is to keep asking, “So what?”

    Imagine your organization reports that it held five community workshops attended by 120 people.

    That’s an output. Now let’s think about the changes we hope those workshops might contribute to.

    • So what? Participants gain a better understanding of local housing assistance options.
    • So what? More eligible families use that knowledge to apply for assistance.
    • And so what? More families are able to secure safe, stable, and affordable housing.

    With each question, we’re moving further from what we delivered toward the difference we hope our work will make.

    It’s a simple exercise, but it can be surprisingly useful when developing a program, choosing indicators, or reviewing a report.

    One important caution: these are possible outcomes, not proof that the workshops caused them. We still need evidence to understand what changed and how our work may have contributed.

    Don’t Forget About Outputs!

    It’s tempting to focus entirely on outcomes once we start thinking about meaningful change. But outputs matter too.

    They tell us whether we’re doing what we promised, reaching the people we intended to reach, and using our resources as planned.

    If you expected 100 participants and only 10 showed up, that’s worth understanding. Maybe the timing was wrong, the outreach wasn’t effective, or the program simply wasn’t meeting a need.

    Outputs and outcomes give us different pieces of the picture. We need both.

    Understanding these distinctions is also an important part of monitoring and evaluation, which helps us track progress and make sense of results.

    What Are You Measuring?

    The next time you’re reviewing a work plan, developing indicators, or preparing a report, take a moment to look at what you’re measuring.

    Are you mostly counting what you’ve done? Or are you also looking at what has changed?

    There’s nothing wrong with counting activities and deliverables. In fact, it’s essential. But if we stop there, we may miss some of the most valuable information about our work.

    And remember, not every change will be positive or expected. Sometimes we discover that our work isn’t having the effect we hoped for. Sometimes we learn that something else matters more to participants than what we originally planned to measure.

    Those discoveries can be just as valuable.

    At Illuminate, we help organizations and professionals think through questions like these and find practical ways to strengthen their monitoring, evaluation, and learning practices.

    Interested in learning more? Explore the Illuminate Learning Center for courses in evaluation planning, program monitoring, and evaluation methods.

  • Monitoring vs. Evaluation: What’s the Difference?

    Monitoring vs. Evaluation: What’s the Difference?

    One of the questions people often ask about monitoring and evaluation is surprisingly simple: What’s the difference between the two?

    It’s a fair question! We hear the terms used together so often, usually bundled into the acronym M&E, that it’s easy to think of them as one thing. But while they are closely connected, they serve different purposes.

    If you’ve ever wondered whether your program is on track or whether it’s actually making a difference, you’ve already asked the two questions at the heart of monitoring and evaluation.

    • Monitoring tracks progress. Are things going as planned? Are we moving toward our goals?
    • Evaluation looks at the quality and value of our work. How well is it working? Why? What could we do differently?

    Both can help us make better decisions, especially when we use them together.

    At a Glance: Key Differences

    MonitoringEvaluation
    FocusProgress and performanceQuality, value, and effectiveness
    TimingUsually ongoingCan happen at any stage, including during design
    Core QuestionAre we on track?How well is it working, and why?
    PurposeTrack progress and identify where adjustments may be neededUnderstand what is working, what isn’t, and what we can learn

    What Is Monitoring?

    Monitoring involves regularly collecting and reviewing information to understand how a program is progressing.

    For example, imagine you’re running a job training program for young adults. You might track enrollment, attendance, course completion rates, and how many participants find employment.

    For instance, if attendance drops sharply in the third week, you know something may need attention. You can talk with participants, explore what’s happening, and consider adjustments before more people drop out.

    Monitoring lets you recognize these patterns and respond while there’s still time to make a difference.

    What Is Evaluation?

    Evaluation takes a closer look at how well something is working, what value it provides, and what we can learn from it.

    In our job training example, monitoring might show that 85% of participants completed the program. That’s encouraging. However, does it mean the program was successful?

    Maybe. It depends on what you’re trying to achieve. Was completion the goal? Or did you have other things in mind?

    Perhaps you want to know whether participants gained useful skills or found meaningful employment. You might also want to understand whether the training met their needs. And what about the people who didn’t complete it? What could we learn from their experiences?

    Evaluation helps us explore questions like these by examining evidence and considering different perspectives. It also helps us make informed judgments about what is working well and what could be improved.

    How Do They Work Together?

    Now imagine the numbers looked different. Enrollment is high, but completion rates are low.

    1. Monitoring identifies the issue. Completion rates are lower than expected.
    2. Evaluation explores why. Conversations with participants and a review of program information suggest that transportation challenges may be contributing to the problem.
    3. The team makes adjustments. Training schedules are changed to better accommodate participants.
    4. Monitoring tracks what happens next. The team continues reviewing completion rates and gathering feedback to see whether things improve.

    Ultimately, both are about learning. Monitoring helps us see what’s happening, while evaluation helps us understand what it means and what we might do differently.

    What About MEL and MERL?

    You may have also heard the terms MEL (Monitoring, Evaluation, and Learning) or MERL (Monitoring, Evaluation, Research, and Learning).

    These acronyms reflect a broader approach to understanding and improving our work. Research can help us explore questions and generate new knowledge, while learning encourages us to reflect on what we’re finding and use those insights to make improvements.

    Of course, research and learning aren’t entirely separate from monitoring and evaluation. They often overlap and reinforce one another.

    Whatever acronym your organization uses, the important thing is to ask good questions, gather useful information, and make time to learn from what you discover.

    Do You Need Both Monitoring and Evaluation?

    Ideally, yes. But you don’t need an elaborate or expensive system to get started.

    Begin by identifying a few meaningful indicators to track progress. Then make time to look more closely at what you’re learning, ask questions, and consider different perspectives.

    Whether you’re managing a small community program or a large initiative, the goal isn’t to collect as much data as possible. It’s to collect information that helps you understand your work and make thoughtful decisions.

    At Illuminate, we enjoy helping organizations and professionals strengthen their monitoring, evaluation, and learning skills and find practical ways to apply them in their work.

    Interested in learning more? Explore the Illuminate Learning Center for courses in program monitoring, evaluation planning, and evaluation methods.

  • Self-Assessments for Evaluators: Exploring Your Strengths and Opportunities for Development

    Self-Assessments for Evaluators: Exploring Your Strengths and Opportunities for Development

    We kind of LOVE to take self-assessments at Illuminate. We love the conversations they spark and the self-reflections they inspire. But our curiosity does not stop at personality types, conflict styles, strengths, or saboteurs.

    As evaluators and organizational learning professionals, we spend a great deal of time helping others ask good questions, examine evidence, and identify opportunities to improve. How often do we turn that same reflective lens toward our own practice?

    Evaluation asks a lot of us. On any given day, we may need to design a study, choose the right methods, facilitate a difficult conversation, manage a project, navigate organizational dynamics, interpret evidence, and communicate findings clearly.

    Few of us are equally confident in every part of the work, and we do not need to be. The point of an evaluator self-assessment is not to earn a perfect score. It is to recognize what we already do well, notice where we would like to grow, and think more intentionally about the combination of skills needed on a team.

    Here are three tools that can help.

    1. CDC Evaluator Self-Assessment

    Best for: Identifying the skills that matter most in your current role
    Time: About 20 minutes
    Cost: Free
    Take it here: CDC Evaluator Self-Assessment

    What we especially like about this tool is that it asks you to consider two things: your current level of proficiency and how important each skill is to your work.

    That distinction matters. You may discover an area in which you have limited experience, but if it rarely comes up in your role, it may not need to be your next professional development priority. The most useful insights may be the places where importance is high but your confidence is still developing.

    The tool can also help supervisors and team leaders think about where to focus coaching, training, or opportunities for practice.

    2. Learn Evaluation Assessment Portal

    Best for: Taking a broad look at your evaluation capabilities
    Time: Approximately 20 to 25 minutes
    Cost: Free with registration
    Take it: Learn Evaluation Assessment Portal

    The Learn Evaluation Assessment Portal, or LEAP, draws on the Australian Evaluation Society’s professional learning competency framework. It includes 95 competencies across seven areas of evaluation practice.

    This is the most comprehensive option on our list. It is helpful when you want to step back and consider the full range of skills involved in evaluation, not only your preferred methods or the tasks you perform most often.

    Your results can provide a useful starting point for a professional development plan or a conversation with a supervisor, mentor, coach, or trusted colleague.

    3. AEA Evaluator Competencies Self-Assessment

    Best for: A shorter reflection grounded in AEA’s professional competencies
    Format: Four-page downloadable worksheet
    Cost: Free
    Take it: Evaluator Competencies Self-Assessment

    This tool invites you to rate yourself across the American Evaluation Association’s five competency domains: professional practice, methodology, context, planning and management, and interpersonal skills.

    We appreciate the reminder that evaluation expertise is about much more than methods. How we build relationships, understand context, manage a project, communicate, facilitate conversations, and respond to ethical questions is also central to doing good work.

    This shorter format may be a good place to begin if you are curious but not ready to work through a longer assessment.

    One More Worth Knowing About: ECAT

    Several colleagues also recommended the Evaluator Competencies Assessment Tool (ECAT). Developed around AEA’s evaluator competencies, ECAT asks practitioners to rate themselves across professional practice, methodology, context, planning and management, and interpersonal skills.

    We could not find a standalone link where readers can immediately complete or download the assessment. However, you can learn more through this AEA365 post about ECAT or read the published article describing its development and validation. The AEA365 post also explains how to request a copy of the tool from its developers.

    Want to Explore the Competencies Themselves?

    Self-assessments are only one way to reflect on your practice. Professional evaluation associations have also developed competency frameworks describing the knowledge, skills, and behaviors evaluators may draw on in different roles and settings.

    Some that are worth exploring include:

    These are frameworks rather than scored assessments, but comparing them can be an interesting reflection exercise in itself:

    • Which capabilities appear across all three?
    • What does one framework emphasize that another does not?
    • Which competencies feel most relevant to your current work?
    • Are there important capabilities that are not represented?

    What Should You Do with Your Results?

    A score or rating is only a starting point. The interesting part is what it helps you notice.

    After completing an assessment, consider asking yourself:

    • What strengths am I overlooking because they come naturally to me?
    • Which skills matter most in the work I am doing now?
    • Where would greater confidence make a meaningful difference?
    • What is one area I would genuinely enjoy developing?
    • What expertise should I strengthen myself, and what should I look for in colleagues or collaborators?

    You might also share your results with someone who knows your work well. Ask what resonates with them, what surprises them, and where they have seen your strengths show up. That conversation may be more valuable than the score itself.

    Where Do You Want to Grow Next?

    A self-assessment can help you recognize your strengths and identify skills you would like to develop. Turning those insights into a learning plan can be a little harder.

    If you would like help thinking through your professional learning journey, we would be glad to be a sounding board. We can help you consider which capabilities matter most for your role, where you want to grow, and what combination of courses or learning experiences might best support your goals.

    You can also explore the Illuminate Learning Center and view our 2026 open-enrollment course schedule. Our courses are designed for evaluators, researchers, program professionals, and organizational leaders who want practical skills they can apply in their work.

    Not sure where to begin? Email us at learningcenter@illcglobal.com. We would be happy to talk it through with you.

    And if you know of another useful evaluator self-assessment, please send it our way. We are always interested in discovering new tools that encourage thoughtful reflection and good conversation.