View all modules About the Innovation Skills Accelerator About the Office of Innovation Contact us

OFFICIAL SITE OF THE STATE OF NEW JERSEY

GOVERNOR PHIL MURPHY — LT. GOVERNOR TAHESHA WAY

NJ.GOV | SERVICES | AGENCIES | ABOUT InSA

MODULE 12

PILOTS AND EVALUATION



In the Pilots and Evaluation Module, we will talk about how to roll out your project in a way that will allow us to learn about whether our efforts are working as intended and how we can evaluate our own project. We will discuss how to set up your own pilots, discuss randomized evaluations and other evaluation methods, and share some techniques for using social auditing to engage others in measuring what works.

PREVIOUS MODULE
video_label

LECTURE VIDEO

person_pin

INTERVIEWS

bookmarks

READINGS

ondemand_video

MORE VIDEOS

assessment

SELF ASSESSMENT
video_label

LECTURE VIDEO

person_pin

INTERVIEWS

bookmarks

READINGS

ondemand_video

MORE VIDEOS

assessment

SELF ASSESSMENT

READINGS

Testing, Testing

Atul Gawande

New Yorker

2009

Read the full article here.

SELF-ASSESSMENT

QUESTION 1

Select the best answer:

The UK Behavioural Insights Team recommends a nine-step process, separated into three parts, to test a solution in the field. Which of these is NOT one of those three parts?





Correct!

Incorrect. This describes the third part of the framework on RCTs

QUESTION 2

Select all that apply:

To reasonably infer causality from an intervention rather than coincidence, which conditions must be met in an RCT?





Correct!

Incorrect. Good RCTs require a large enough sample size and the ability to randomly select subjects from the sample.

QUESTION 3

Select the best answer:

A study that measures the difference between two naturally occurring groups is called





Correct!

Incorrect. This type of study is referred to as a difference-in-difference study.

QUESTION 4

Select the correct answer:

In the experiment conducted during California’s energy crisis, what intervention prompted light energy users to maintain their good habits?





Correct!

Incorrect. Instead, researchers simply included a smiley face emoticon with the message that showed their low energy consumption relative to their neighbors.

QUESTION 5

Select the best answer:

According to Atul Gawande, Americans in 1900 were spending about what proportion of their income on food?





Correct!

Incorrect. In 1900, Americans were spending more than 40% of their income on food.

You're right but there's more to this answer. Please try again!

QUESTION 6

Select the best answer:

No matter the task we ask of people in an open innovation exercise, it is important that we are sure people are ________ and know _______ to participate:





That’s right! It sounds simple but there’s nothing worse than setting up an open innovation project and encouraging people to participate only to get a poor turnout because of barriers such as lack of access to technology or jargonistic language that makes it hard for people to understand what is required of them. Requiring people to identify themselves can be important in some processes (e.g. where it is important that someone is a resident) but if we are just seeking good ideas it doesn’t need to be a requirement.

Sorry, that’s not it. Here we’re looking to ensure we remove the most practical barriers to participation.

You're right but there's more to this answer. Please try again!

QUESTION 7

Select the best answer

What is the primary benefit of small-scale testing over full implementation?





Correct!

Incorrect. Smaller-scale pilots, trials and demonstration projects can help to determine what works before scaling up a project across a city, state or nation

You're right but there's more to this answer. Please try again!

QUESTION 8

Select the best answer:

Small-scale testing can help expose unintended consequences, unrealistic resource assumptions, or problems with reaching intended project beneficiaries in your solution



That’s right!

Wrong!

You're right but there's more to this answer. Please try again!

QUESTION 9

True or False

Survey respondents should reflect the target population for a planned intervention



That’s right!

Wrong!

You're right but there's more to this answer. Please try again!

QUESTION 10

Select the best answer:

Define social or civic auditing





Correct!

Incorrect. Civic auditing refers to the engagement of ordinary people in the process of evidence gathering, crowdsourcing their efforts to help with progress monitoring and reporting, to improve existing service delivery and inform future policy formulation

You're right but there's more to this answer. Please try again!