The Power of Retrospective Pretests to Address Common Survey Research Challenges
James Pann interviews Melanie Hwalek, Ph.D., a program evaluation consultant, to discuss the retrospective pretest (RPT) design, focusing on its practical applications and the findings from her recent research detailed in the paper, “Designing a Questionnaire with Retrospective PrePost Items: Format Matters.” RPT is particularly useful for evaluating changes in participants’ perceptions or self-assessments following...
2 Oct 2023
Empowering Change: David Fetterman on Using Evaluation to Build a Better World
David Fetterman is a leading expert in empowerment evaluation, an approach that emphasizes collaboration, participation, and capacity building. He has written extensively on the topic, and his work has been used in a wide range of settings, including government agencies, non-profit organizations, and businesses. David focuses on helping people evaluate their programs and initiatives. Moreover,...
19 Sept 2023
From Lecture Halls to Real-World Calls: Tiffany Berry’s Evaluation Insights
Whether you’re an educator, a student, or simply someone passionate about youth development and educational programs, this podcast episode with Tiffany Berry, Ph.D., promises to give you insights into the complex world of evaluation. She is the Dean and a full research professor in the Division of Behavioral & Organizational Sciences at Claremont Graduate University,...
11 Apr 2023
Mindfulness Meets Evaluation: Insights from Jim McDavid
In this episode, I talk with Jim McDavid, Ph.D., about his experience with mindfulness and meditation practice, how it has influenced him, and how it affects how he views and practices evaluation. Our conversation also covers practical wisdom, Jim’s interest in the environment, and challenges associated with determining cause and effect in evaluation. Jim is...
2 Mar 2023
Maximize Your Survey Response Rates: Expert Insights from Sheila Robinson
In this podcast episode, James Pann, Ph.D., interviews Sheila Robinson, Ed.D., about the topic of surveys and response rates. We focus on the significance of response rates in surveys and the steps that can be taken to maximize them. Sheila is a career educator and professional learning designer with experience in K-12 public education and...
28 Mar 2022
Young Adult Cancer Survivors Increase Mindfulness and Connection During Nature Treks with David Victorson
James Pann, Ph.D., interviews David Victorson, Ph.D., of True North Treks, a nonprofit organization whose mission is to empower young adults and caregivers affected by cancer to “find direction through connection” and mindfulness. As a child, David grew up surrounded by nature and its many restorative benefits. Therefore, when he went on to complete his...
17 Nov 2021
The CIPP Evaluation Framework with Guili Zhang
James Pann interviews Guili Zhang about the Context, Input, Process, and Product (CIPP) evaluation model and other evaluation related areas. Dr. Zhang is Department Chair and Professor of Research and Evaluation at East Carolina University. She received a Ph.D. in Research and Evaluation Methodology from the University of Florida and postdoctoral advanced training in large...
11 Jul 2021
What’s the difference between research and evaluation? with Dana Wanzer
The difference between research and evaluation, the pros and cons of professionalization, the definition of evaluation, and other evaluation related topics with Dana Wanzer, Ph.D., interviewed by James Pann, Ph.D. Dana is an assistant professor of psychology in evaluation in the psychology department at the University of Wisconsin at Stout. Dana teaches evaluation courses to...
17 Dec 2020
The Importance of How We Define Evaluation with Amy Gullickson
In this interview, I speak with Amy Gullickson, acting Co-Director and Senior Lecturer at the Centre for Program Evaluation at Melbourne Graduate School of Education. She is also Chair of the International Society for Evaluation Education. We talk about what is the best definition of evaluation and why it is important to have a clear definition. Amy...
12 Nov 2020
Evaluative Thinking with Thomas Archibald
Thomas Archibald, Ph.D. is an Associate Professor and Extension Specialist in the Department of Agricultural, Leadership, and Community Education at Virginia Tech. His practice and research are focused primarily on program evaluation and evaluation capacity building. He serves as the Chief of Party/Director of the Feed the Future Senegal Youth in Agriculture project, funded by...
24 Sept 2020
Evaluation’s Role in Guiding Public Policy and Government with Rakesh Mohan
Rakesh Mohan has been the director of the Office of Performance Evaluations (OPE) an independent and nonpartisan agency of the Idaho State Legislature, since 2002. We cover important issues related to evaluation and how evaluation can guiding government and public policy. Under Rakesh’s direction, the office has received many awards, including the American Evaluation Association’s 2016 Outstanding Evaluation Award and the 2011 Alva and Gunnar Myrdal Government Evaluation Award. He is also the recipient of the 2016 Donald and Alice Stone Outstanding Practitioner Award from the American Society for Public Administration (ASPA).Recently he wrote a chapter for the book Evaluation Failures, published by Sage (2019), which we discussed previously in the interview with Kylie Hutchinson. His chapter was titled, “I Didn’t Know I Would Be a Tightrope Walker Someday: Balancing Evaluator Responsiveness and Independence.” He has also served on the American Evaluation Association’s board of directors, the editorial advisory board of New Directions for Evaluation, and the US Comptroller General’s Advisory Council on Government Auditing Standards.
Here are some of the topics we cover:
– How Rakesh’s office provides guidance to the Idaho State Legislature
– Keeping the primary stakeholders in mind is essential to conducting relevant evaluations and effective reports. Here’s an example of a one-page evaluation summary from his office: Child welfare system: Reducing the risk of adverse outcomes https://legislature.idaho.gov/ope/rep… (https://www.youtube.com/redirect?q=https%3A%2F%2Flegislature.idaho.gov%2Fope%2Freports%2Fr1803%2F&event=video_description&v=sGH7XNy_-9c&redir_token=QUFFLUhqa0l0MDNQa1NhUEZ4c0EySnRLQkZ3NGgyS0s3Z3xBQ3Jtc0tsSXNjaG5JQWs2ajc3dmp2T3hLVGcyYS1Qb0tReDZndHpzenIySThkLThrVEF2MlR3U3NXYVpaNFJyNm5Va3ZjSDk3UUN0UnUyd19zOWxIQnNyR21DQnpIYklEU2M4VGE4ZlVqbW1sbklBODhiZkFhbw%3D%3D)
– What he suggests to someone who wants to work in government-related evaluation
– The main differences between his evaluation work and what most external evaluators do
– Rakesh discusses an evaluation related mistake he made and what he learning from it
– How he and his team reduce bias and improve clear thinking in their work
Some of his favorite evaluation resources include:
– BetterEvaluation: https://www.betterevaluation.org/ (https://www.youtube.com/redirect?q=https%3A%2F%2Fwww.betterevaluation.org%2F&event=video_description&v=sGH7XNy_-9c&redir_token=QUFFLUhqbnNPVmFPbDFxZnRaZVBjZzgxNjRRSk01Z1V3QXxBQ3Jtc0tuUVBZQjJWR1h5dzRfclFzWjhRLURHSk1sQk1ZXzlOcEtHQU1QMUNhZk5lVXJzd1kwLUUxX0FvbW5XeG0zSjZZWU9yTUxidENONWtueDRhV2FWajJrU1NsenN1dmVsOXVsbjZTSDc2WG1mT1hoc1lxRQ%3D%3D)
– Eleanor Chelimsky interview: https://www.youtube.com/watch?v=pF34R… (https://www.youtube.com/watch?v=pF34RdRPISw)
– Eastern Evaluation Research Society: <a class="yt-simple-endpoint style-scope yt-formatted-string" dir="auto" spellcheck="false" href="https://www.youtube.com/redirect?q=http%3A%2F%2Feers.org%2F&event=video_description&v=sGH7XNy_-9c&redir_token=QUFFLUhqa2IwZGNEbEdMVlRPQUdqOGVhZmN2U3U2SmVDZ3...
Reach and audience
Public platform figures. Ratings count people who left a rating, not total listeners.
Apple Podcasts (US)
5.0 / 5
6 ratings
Spotify
5.0 / 5
1 ratings
Contact EvalNetwork
Guest appearances
Does not typically book guests
Based on episode analysis; this does not confirm that the show is currently accepting guests.
Host of EvalNetwork?
Claim your podcast to manage its listing and keep your show details accurate.
Pod Engine is an independent podcast discovery and analytics service and is not affiliated with or endorsed by this podcast. Artwork and show content belong to their owners. Full legal notice.
Explore this show Podcast research with Pod Engine
