Theories of change

# Theories of change

**Session 3**

]

---

# Plan for today

.box-1.medium.sp-after-half[Reproducibility]

.box-2.medium.sp-after-half[Program theories]

.box-6.medium[Logic models & results chains]

---

name: reproducibility
class: center middle section-title section-title-1 animated fadeIn

# Reproducibility

---

---

# Why am I making you learn R?

&nbsp;

.box-inv-1.medium[More powerful]

.box-inv-1.medium[Free and open source]

.box-inv-1.medium.sp-after[Reproducibility]

---

# Austerity and Excel

]

.pull-right.center[

<figure>
 <img src="img/03/path-to-prosperity.jpg" alt="The Path to Prosperity 2013 house budget" title="The Path to Prosperity 2013 house budget" width="65%">
 <figcaption>Paul Ryan's 2013 House budget resolution</figcaption>
</figure>

]

???

[2013 House Budget Resolution](https://republicans-budget.house.gov/uploadedfiles/pathtoprosperity2013.pdf)

---

# Austerity and Excel

.pull-left.center[

<figure>
 <img src="img/03/thomas-herndon.jpg" alt="Thomas Herndon" title="Thomas Herndon" width="55%">
 <figcaption>Thomas Herndon</figcaption>
</figure>

]

.pull-right.center[

<figure>
 <img src="img/03/krugman-allowed.png" alt="Paul Krugman on Excel and reproducibility" title="Paul Krugman on Excel and reproducibility" width="100%">
 <figcaption>From <a href="https://www.nytimes.com/2013/04/19/opinion/krugman-the-excel-depression.html" target="_blank">Paul Krugman, "The Excel Depression"</a></figcaption>
</figure>

]

???

[Paul Krugman on the reproducibility crisis](https://www.nytimes.com/2013/04/19/opinion/krugman-the-excel-depression.html)

---

# Austerity and Excel

.center[
<figure>
 <img src="img/03/rr-table1.png" alt="Reinhart Rogoff Table 1" title="Reinhart Rogoff Table 1" width="47%">
</figure>
]

---

# Genes and Excel

.center.sp-after[
<figure>
 <img src="img/03/excel-numbers.png" alt="Numbers in Excel" title="Numbers in Excel" width="40%">
</figure>
]

---

# General guidelines

.box-inv-1.medium[Don't touch the raw data]

.box-inv-1.medium[Use self-documenting, reproducible code]

.box-inv-1.medium[Use open formats]

---

# R Markdown in real life

.pull-left.center[

<figure>
 <img src="img/03/airbnb.png" alt="Airbnb's data science tools" title="Airbnb's data science tools" width="100%">
 <figcaption><a href="https://peerj.com/preprints/3182.pdf" target="_blank">Airbnb, ggplot, and rmarkdown</a></figcaption>
</figure>

]

.pull-right.center[

&nbsp;

<figure>
 <img src="img/03/uk-short.png" alt="UK Statistics pipeline, short" title="UK Statistics pipeline, short" width="55%">
 <figcaption><a href="https://dataingovernment.blog.gov.uk/2017/03/27/reproducible-analytical-pipeline/" target="_blank">The UK's reproducible analysis pipeline</a></figcaption>
</figure>

]

???

https://peerj.com/preprints/3182.pdf + https://gdsdata.blog.gov.uk/2017/03/27/reproducible-analytical-pipeline/

---

layout: false
name: program-theories
class: center middle section-title section-title-6 animated fadeIn

# Program theories

---

---

# Elements of a program

.box-6.smaller.sp-after[Things that go into an activity; money, people, time, etc.]

.box-6.smaller.sp-after[Actions that convert inputs to outputs; things that the program does]
]

.box-6.smaller.sp-after[Tangible goods and services produced by activities; you have control over these]

.box-6.smaller.sp-after[What happens when the target population uses the outputs; you don't have control over these]
]

---

# Program theory

.box-inv-6.medium[How and why an intervention causes change]

---

# Impact theory

.box-inv-6.medium.sp-after[Causes (activities) linked to effects (outcomes)]

.center[
<figure>
 <img src="img/01/psd-impact-theory.png" alt="PSD impact theory" title="PSD impact theory" width="100%">
</figure>
]

---

# One Laptop Per Child (OLPC)

???

Nicholas Negroponte from MIT, started the Media Lab there

Draw impact theory: access to computers → 21st century skills, access to global marketplace, reduction of poverty, growth of local businesses

https://www.theverge.com/2018/4/16/17233946/olpcs-100-laptop-education-where-is-it-now

https://en.wikipedia.org/wiki/OLPC_XO#/media/File:XO-Beta1-mikemcgregor-2.jpg

---

# OLPC

&nbsp;

.pull-left-narrow[
<iframe width="560" height="315" src="https://www.youtube.com/embed/H4F_0sshG28?start=704" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
]

.pull-right-wide[
<figure>
 <img src="img/03/olpc-screenshot.png" alt="The Verge on the OLPC project" title="The Verge on the OLPC project" width="100%">
 <figcaption>Adi Robertson, <a href="https://www.theverge.com/2018/4/16/17233946/olpcs-100-laptop-education-where-is-it-now">"OLPC's $100 laptop was going to change the world—then it all went wrong"</a></figcaption>
</figure>
]

???

Everything fell apart though. It wasn’t ready—it had unrealistic expectations and was too utopian. It also didn’t take local conditions into account

https://www.youtube.com/watch?v=H4F_0sshG28

---

# PlayPumps

.pull-left[
<figure>
 <img src="img/03/playpump-diagram.jpg" alt="PlayPump diagram" title="PlayPump diagram" width="100%">
</figure>
]

.pull-right.center[
<figure>
 <img src="img/03/playpump-photo.jpg" alt="PlayPump" title="PlayPump" width="60%">
</figure>
]

???

Improved access to water → better health, better education, reduction in poverty

> The Guardian calculated in 2009 that children would have to "play" for 27 hours every day to meet PlayPumps' stated targets of providing 2,500 people per pump with their daily water needs. (https://en.wikipedia.org/wiki/Roundabout_PlayPump)

Have kids play to get water out. Led to overuse – main problem in many areas isn’t access to water, but scarcity of water – only works in locations with lots of good water that’s not too deep and where infrastructure is lacking

Is children playing is an appropriate source of energy for water? The line between work and play isn’t as clear-cut as one would think. – can lead to exploitation

https://blogs.ei.columbia.edu/2010/07/01/the-playpump-what-went-wrong/

http://docan.jp/idea-source/playpumps/?lang=en

---

# Why theorize?

.box-inv-6.small[What program designers think or assume is going to happen, and why]

.box-inv-6.small[What program designers officially claim and predict, and why]

.box-inv-6.sp-after[Written down]

]

.box-inv-6.medium[Should all social programs be rooted in explicit articulated theory?]

???

What difference does articulation make?

---

.center[
<figure>
 <img src="img/03/lhi-map.jpg" alt="LHI locations" title="LHI locations" width="70%">
</figure>
]

.pull-left.center[
<figure>
 <img src="img/03/lhi-serres.jpg" alt="LHI Serres" title="LHI Serres" width="90%">
</figure>
]

.pull-right.center[
<figure>
 <img src="img/03/lhi-serres-kids.jpg" alt="Kids at LHI Serres" title="Kids at LHI Serres" width="85%">
</figure>
]

---

.center[
<figure>
 <img src="img/03/plot-dist-age-1.png" alt="Serres distribution preferences by age" title="Serres distribution preferences by age" width="80%">
</figure>
]

.center[
<figure>
 <img src="img/03/plot-programs-overall-1.png" alt="Serres program preferences" title="Serres program preferences" width="55%">
</figure>
]

---

# Impact theory

.center[
<figure>
 <img src="img/03/psd-impact-theory-arrow.png" alt="PSD impact theory" title="PSD impact theory" width="100%">
</figure>
]

---

layout: false
name: logic-models
class: center middle section-title section-title-2 animated fadeIn

# Logic models & results chains

---

???

p. 39 in *Impact Evaluation in Practice*, The World Bank

---

.center[
<figure>
 <img src="img/01/psd-logic-model.png" alt="PSD logic model" title="PSD logic model" width="70%">
</figure>
]

---

---

# Impact theory vs. logic model

<figure>
 <img src="img/01/psd-impact-theory.png" alt="PSD impact theory" title="PSD impact theory" width="100%">
</figure>
]

.pull-right[
<figure>
 <img src="img/01/psd-logic-model.png" alt="PSD logic model" title="PSD logic model" width="100%">
</figure>
]

---

# MPA/MPP at GSU

.pull-left[
<figure>
 <img src="img/03/mpp-mission@4x.png" alt="MPP mission" title="MPP mission" width="130%">
</figure>
]

.pull-right[
<figure>
 <img src="img/03/mpa-mission@4x.png" alt="MPA mission" title="MPA mission" width="100%">
</figure>
]

???

Inputs:

- Students
- Curriculum
- Money (grants, tuition)
- AYSPS itself
- Faculty, staff
- Technology (iCollege, PAWS)
- Infrastructure
- Transportation
- State regulations
- National accreditation standards
- Faculty research

Activities:

- Classes
- Group work
- Exams
- Internships
- Job fairs
- Commencement
- Studying
- Tutoring
- Office hours
- Advising
- Attendance

Outputs:

- Assignments and projects
- Grades
- Degree
- Jobs
- Awards
- Network
- Debt

Outcomes:

- Leadership
- AYS national ranking
- Public service motivation
- Critical thinking
- Efficient workforce
- Income
- Better society