How does conversation influence the collective’s impact on sustainability problems? With this in mind, how can we (re)design networks for better conversation?”
This is a summary of ongoing research. We are asking three major questions:
1. What are specific impacts of effective conversation for a social ecological systems (SES)” (Druschke & McGreavy, 2016; Partelow, 2016)? By using sustainable aquaculture, as an example of an SES, can we find generalizable relationships between productive conversation and positive outcomes, such as resource use, options-generation, relationship-building, and accountability?
2. Using natural language processing (AI) on aquaculture-related sustainability conversations can we detect the signatures of effective conversation, and relate them to outcomes? Does a conversation signature -- recognizing dialogue and facilitation elements (Skifstad & Pugh, 2014), sequence (McCardle-Keurentjes & Rouwette, 2018), turn-taking (Buchanan & Pentland, 2007), and gender participation (Woolley et al., 2010) -- explain meaningful differences in performance – even when other explanatory variables are too costly to obtain?
3. What type of capacity-building and network design would spread effective conversation cost-effectively (e.g., self-facilitating through conflict and actions) (Silka, McGreavy, Hart, 2019)? What can we leverage from the research on cognitive bias and social norms to accelerate capacity-building and improved levels of trust (Cinner, 2018; Hoffman et al., 2015; Rand et al., 2014)?
التغيرات المناخية وتاثيرها على القطاع الزراعي المصري
Sikm pugh sustainability conversations for impact snapshot 210420
1. Translating effective sustainability conversation
into network design
SIKM Leaders Discussion: Spapshot of an NLP journey
Katrina Pugh, Columbia University, U Maine
April 20, 2021
3. Rationale and problem statement
Aquaculture industry tensions are high
Source: “With aquaculture booming, it’s time to talk about its future in Maine,” Portland Press Herald, April 13, 2021
https://www.pressherald.com/2021/04/13/with-aquaculture-booming-its-time-to-talk-about-its-future-in-maine/
“There is something wrong when you can’t even
have a conversation in Maine without sending
people into an uproar...
There are a number of [Aquaculture lease] criteria –
navigation, competition and others... “unreasonable
interference”…undefined, ambiguous…
...We are now faced with conflict up and down the
coast.”
4. Rationale and problem statement:
Aquaculture Social Ecological System...what we think
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
Diverse stakeholders
(Farmers, Fishers,
Boaters, Riparian
Landowners,
Regulators,
Legislators, NGOs)
Interaction:
Meetings, Hearings
Local town halls,
Participatory Action
Research
Efficiency
Innovation
Participation
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria
Action Situation:
Lease scoping mtg.
Lease Hearings
Outcome: Approval
(yes/no) for lease
5. Rationale and problem statement:
Aquaculture Social Ecological System...de facto!
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
4. Wealth
disparities
5. National
polarization
Diverse stakeholders
Lobbyists
Lawyers
PR agencies
Facilitators
NGO overlaps
Interaction: Meetings,
hearings
Local town halls (some
with bias, certainty,
conflict)
Participatory Action
Research
- Letters to the editors,
Soc media
Yes or no to
Aquaculture lease
approval
- Cost (of lobbying,
investigation)
- Spillover effects
- Time elapse
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria?
Action situation:
Lease scoping mtg.
Lease Hearings
Publishing, Press
Outcome: Approval
(yes/no) for lease
- Community
discord, cost
6. Rationale and problem statement:
Aquaculture Social Ecological System...reframed
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
4. Wealth disparities
5. National
conversation
Diverse stakeholders
Lobbyists
Lawyers
PR agencies
Facilitators
NGO overlaps
Interaction: Meetings
Local town halls (some with
bias, certainty)
PAR
- Letters to editors, SM
Productive
Conversation
Yes or no to
Aquaculture lease
approval
+ Individual
conversation skills
+ Network/
community
resilience
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria?
Action situation:
Lease scoping mtg.
Lease Hearings
Publishing, Press
Lease Approval (yes/no)
+ Options-Generation,
+ Relationships
+ Bias for Action
7. Rationale and problem statement:
Focus and research question
“How does conversation influence
our collective impact on
sustainability?
With this in mind, how can we
(re)design networks for better
conversation?”
9. Research Design:
Significant authors
SES and
Sustainability
Science
Ostrom
Agarwal
Clark
Partelow
Cash
Johnson
Silka, Hart,
McGreavy
Dialogue, Facilitation
Schein
Weick
Isaacs
Dixon
Edmondson
Wilkinson
Danescu-Nikulesu-Mizil
See et al
Skifstad & Pugh
Complex
spreading
phenomena,
Org. learning,
knowledge NWs
Pugh & Prusak
Pentland& Malone
Watts
Centola and Macy
RARE.org
Soc Ecol. Systems Cooperation Conversation/AI Network strategy
Behavioral Insight,
Diversity, Reciprocity
Trivers
Nowak
Galinsky
Page
Thaler and Sustein
Hoffman, Rand &
Yoeli
Titus and Stasser
10. Source: Pugh, 2020, and Skifstad and Pugh, 2014.
Research Design:
What makes good conversation? (4 Discussion Disciplines)
10
Inclusion
Translation
Integrity
Courtesy
Asking clean
questions, making
statements with
data Respecting
participants,
respecting the
forum
Reaching out and
bringing in; not
“excluding” through
acronyms, terms of art,
in-language
Synthesizing,
sensemaking,
up-levelling into
actions
Derived from Dialogue practices Derived from Facilitation practices
11. Research Design:
Research process
0. Observe
Sustaina-
bility
conversa-
tions
1. Code
transcripts,
start
interviews
2. Develop
AI/ML
(NLP)
Algorithm
3. Generate
Conver-sati
on
Signatures
5. Design
Capacity
building &
Network,
test with
focus
group
4. Validate
AI/ML
Algorithm,
productize
6.
Launch
Spring-Summer 2021 Fall, 2021-Spring 2022
Fall 2020-Spring 2021
See A1: Research process detail
12. 12
Integrity
Courtesy
Inclusion
Translation
We’ve been farming under a limited permit
aquaculture [LPA] lease. This has allowed us to
experiment. Next we moved to the public input part.
That’s today’s lease scoping meeting.
We want to minimize the impact as
much as possible.
I’ll follow up with you. I want your
opinion.
To clarify: aquaculture is a multitude of different
organisms, a multitude of different activities.
Source: Aquaculture Lease scoping meeting for Farmer #4. See appendix A2 for more examples.
Research Design:
Aquaculture Examples of Four Discussion Disciplines
13. M/F Item Comment Discipline Rationale
Farmer 24 This is the point where we listen and talk and
hear what you have to say.
Inclusion Open / include
n/a 25 10 seconds Inclusion Open / include
Harbor-
master
26 I have not been on one of these [scoping
meetings]. I heard [person of authority] signed
off. I was shocked. It’s bigger than I thought.
Anti-Courtesy Word "shocked" is trigger word.
Defensive
Harbor-
master
27 I was seeing the same materials as before. Integrity Statement of fact. Assume he saw
previous lease or earlier version.
Harbor-
master
28 That lobster trap needs to go. There’s no hauling
in the town of [town name].
Integrity Statement of fact.
Farmer 29 [Relative to the experimental lease] some
changes to the species. No change to the gear.
Translation Wrapping up, recapping.
Harbor-
master
30 I’m good with everything you said. Courtesy Positivity
Research Design:
Aquaculture lease Scoping meeting excerpt showing identity issues, aquaculture context
complexity
Injects doubt. Could
have derailed the
meeting here
(common pattern)
Sides with
farmer and
refers to reg
policy or lack of
reg policy
(common fisher
pattern)
Farmer is not
defensive
(previously: “we
want to be a
good neighbor”)
“Pivotal juncture”
opened inquiry
(40 more moves)
14. Research Design:
Six lease scoping meeting transcripts from Oct ‘20-March ‘21 (approximately 550 moves)
Integrity
dominates, with
Courtesy and
Integrity-Q next
Female % of
utterances
approx, 20%*
Contribute fewer
“anti” comments
*Except with female farmer leading scoping meeting. .
15. Research Design:
Percent of moves, by discussion discipline, by aquaculture lease scoping meeting
Relationship-Building, Intent to act
Relationship-Building
Options Generation, Relationship Building
Options Generation, Intent to Act
Intent to act
Relationship-Building, Intent to act
16. Research Design:
Six lease scoping meeting transcripts from Oct ‘20-March ‘21 (approximately 550 moves)
Options
Generation
Relationship-
building Intent to Act
Integrity (+) (+) (+)
Integrity-Q +
Courtesy +
Inclusion +
Translation (Weak)
Anti (courtesy,
integrity, inclusion)
(-)
Outcomes observed
Above-avg.
discussion
discipline
17. Research Design:
AI/ML Natural Language Processing: Using Cornell’s Convokit
Parsing
language
snippets
(pre-processi
ng and
feature
abstraction)
Ingesting
conversa-ti
on
transcripts
Cluster
analysis/m
atching to
four
discussion
disciplines
Testing on
“virgin”
transcripts,
generate
conversation
assessment
utility
18. Research Design:
AI/ML Natural Language Processing: Using Cornell’s Convokit
2. Separate
common
combination of
words that
have direction
(e.g.,
before-after,
parent-child)
3. Collect
those
directed word
combinations
that are
similar
4. Cluster
those motifs
together as
rhetorical
intentions
(questions,
answers,
provocations)
5. Identify
PromptTypes
’ Clusters
that most
correspond
to the four
discussion
disciplines.
6. Validate on
virgin
transcripts and
prepare for
statistical
analysis
1. Ingest
text from
transcripts
(raw
training
data)
Clean text
up
“Corpus”
compiled.
“Stop
words”
removed.
“TextClea
ner”
applied
“TextToArc
produces
ArcTypes,”
which are like
vectors -
directional
relationships
between words
“PhrasingMotifs”
are frequently-
occurring sets of
dependency-
parsed arcs
Use analyses,
1. graphs
2. rankings Propttypes
closest to the middle
(centroid) for that
cluster. Doing
stepwise, e.g., first
assign Integrity.
“PromptTypes” are
vector
representation
based on how they
are responded to --
as well as types of
rhetorical intentions
TF*IDF and SVD
Parsing language snippets (pre-processing and
feature abstraction)
Ingesting text Analysis/Matching to
discussion disciplines
Explanation
ConvoKit
Transformation
19. Research Design:
TF*IDF Vectorizer Matrix: From Phrasing motifs to Prompt Types
Phrasing
Motif 1
Phrasing
Motif 2
Phrasing
Motif 3
... Phrasing
Motif Z
Utteranc
e 1
1 0 1 ... 3
Utteranc
e 2
0 2 1 ... 0
Utteranc
e N
1 5 0 ... 7
Totals for each Phrasing Motif, for each
utterance, is then fed into SVD (Single Value
Decomposition) Matrix
https://scikit-learn.org/stable/modules/gener
ated/sklearn.decomposition.TruncatedSVD.h
tml
Overview: https://www.onely.com/blog/what-is-tf-idf/
SciKit-Learn Approach:
https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text
.TfidfVectorizer.html
For a Phasing Motif t in Utterance d, the weight Wt,d of
term t in document d is given by:
Wt,d = TFt,d log (N/DFt)
Where:
● TFt,d is the number of occurrences of t in Utterance
d.
● DFt is the number of Utterances containing the term
t.
● N is the total number of utterances in the corpus.
For SEO one would want a LOW TF*IDF. (Phrasing Motif
is rare). But for us, we would want a HIGH TF*IDF
(Phrasing Motif is not rare).
This is the frequency that this phrasing
motif occurs in the utterance (row).
The column Total X is the total
number of the phrasing Motif in the
CorpuS, with N utterances.
Total 1 Total 2 Total 3 Total ... Total Z
20. “TextToArc produces
ArcTypes,” which are
like vectors -
directional
relationships between
words in a sentence
Research Design:
Using Convokit
2. Separate common
combination of words
that have direction
(e.g., before-after,
parent-child)
3. Collect those
directed word
combinations that
are similar
3a: Politeness
strategies
4. Cluster those motifs
together as rhetorical
intentions (questions,
answers, provocations)
5. Identify
PromptTypes’
Clusters that most
correspond to the
four discussion
disciplines.
6. Validate on virgin
transcripts and prepare
for statistical analysis
1. Ingest text from
transcripts (raw
training data)
Clean text up.
“Corpus”
compiled. “Stop
words”
removed.
“TextCleaner”
applied
“PhrasingMotifs” are
frequently- occurring
sets of dependency-
parsed arcs
Use analyses,
1. graphs
2. rankings of prompttypes
closest to the middle
(centroid) for that cluster. May
do stepwise, to first assign
Integrity.
“PromptTypes” are vector
representation based on how
they are responded to -- as well
as types of rhetorical intentions
(clusters 0-7)
Parsing language snippets (pre-processing and feature abstraction)
Ingesting text Analysis/Matching to discussion disciplines
Explanation
ConvoKit
Transformation
'There is a guy
who whips
through there
in a Boston
whaler. I’m
pretty sure he
cut up my line
once.'
['a_* boston_* guy_* guy_a guy_whips in_*
in_whaler is_* is_guy is_there there>* there_*
through_* through_there whaler_* whaler_a
whaler_boston whips_* whips_in whips_through
whips_who who_*', "'m_* 'm_i 'm_sure cut_*
cut_he cut_line cut_once cut_up he_* i>* i_* line_*
line_my my_* once_* pretty_* sure_* sure_cut
sure_pretty up_*"]
['',
"'ll_* have_*__have_i__i>*__i_*
i>*__i_*",
'my_* the_*',
"'ll_* in_* the_*",
'a_* have_*__have_i__i>*__i_*
i>*__i_*']
[0.29997174
0.95394809]
(PromptTypes
Coordinates)
Example
21. Prompt Designation Response Designation
1
Motifs as input
field, utterances
may be
represented as
both prompt and
response. Pretty
noisy, some
trends: courtesy
mapping close
to prompt
centroid 4.
22. Research Design:
Influences on conversation outcomes (bold are observable in our data
as explanatory variables)
1. Conversation moves (discussion disciplines and
anti-disciplines)
2. Conversation moves’ sequence (e.g., time and type of
climax)
3. Gender (pertains to social sensitivity, and could be
captured by the “Courtesy” moves. Could also be related
to bias) (Woolley et al, 2010)
4. Region/Geography of lease (relates to wealth,
development, gentrification, environmental quality
5. Type of lease (e.g., duration up to 20 years, species,
equipment, relates to property rights)
6. Type of aquaculture tech (e.g., oyster, mussel rings)
7. Relationship history/costly signals (Grattan et al, 2007 on
“heritage relationships. May be captured by the
Region/Geography variable.)
8. Physical movement (Body language, pitch, cadence) (Pentland,
et al 2007)
9. History of the region (number of recent lease applications or
wins) (Ostrom, Partelow)
10. History of the conflict (nature of previous interactions across
the community, especially public or litigious actions) (ditto)
11. Regulation (governance systems) (ditto)
Likely to be available in the
conversations and publicly
available sources
More difficult to acquire with
current resources, and more
difficult to translate into
resources for sustainability
networks
23. Research Design:
Statistical analysis: What impact do the conversation attributes have
on outcomes, and is it statistically significant?
Explanatory variables Dependent variable: Outcomes
● X1 Signature (categorical variable determined by clustering: e.g.,
○ Sig 1 could be “above average inclusion, above average
integrity-Q,”
○ Sig 2 could be “below average inclusion, below average
integrity Q, above average translation”)
● X2 Sequence (categorical variable: climax type, such as early,
followed by loading) [Could also be part of X1]
● X3 Gender proportion
● X4 Region (proxy for costly signals, envtal qual, gentrification)
● X5 Type of Lease
1. Options generation
(innovation)
2. Intent to act (closure)
3. Relationship building
(Can be either positive or
negative)
24. Research Design:
Intervention: Accelerate the learning curve for productive conversation
1. Capacity-Building
● Training in Four Discussion
Disciplines (NLP research for
targeted impacts)
● Spreading boundary objects, like
pocket cards
● Collaborating with existing teams
(e.g., Maine Sea Grant,
Aquaculture in Shared Waters
training, DMR training)
2. Network Weaving
● Designing networks as “cradle for
conversation.”
● Incorporate behavioral models, social
norming
● Leveraging existing networks (e.g.,
FocusMaine, Maine Aquaculture
Association)
● Propose random controlled trials
25. Research Design:
Knowledge Network Effectiveness Framework (read right to left)
25
What are the impacts?
1. Learning / innovation
(tangible products)
2. Horizontal
Coordination (scale,
buying power)
3. Member Support
(trusted advice)
4. Translation/ Local
Adaptation
(sense-making)
What behaviors do we see?
•People identify with the
network out loud
•People share contacts,
knowledge even before
being asked
•People speak up, even
across hierarchy or political
divides
What dynamics play out?
• “if I contribute routinely, I
will, in turn, get value from
the network”
• “If I make mistakes, I will
learn in a community of
learners.”
• “If members identify with
the network, they
reciprocate.”
• “If leaders role-model
vulnerability, members will
take appropriate risks.”
What levers do we pull?
8 Design Dimensions:
Strategic
1.Leaders’ shared theory of change
2.Objectives/Outcomes/ Purpose
3. Expert-Learner balance
(psychological safety)
4. Inclusion/Participation
Structural
5. Operating model
6. Convening structures & infrastructures
7. Facilitation and social norm
development
Tactical
8. Measurement, feedback and incentives
Increasing leverage
KNEF on a page 210202
“Products,
negotia-tio
ns”
“Relation-
ships,
trust”
Source: Pugh & Prusak (2013) “Designing
Effective Knowledge Networks,” MIT Sloan
Management REview
26. Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
+
-
-
-
+
-
+
B
B
Current: “Conflict is masked,
conversation skills atrophy”
27. investment in
Conversation
Capacity
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
Conflict in
sustainability
interactions
Desirability of
engagement
Credibility of
conversation
model
+
-
-
-
+
-
+
-
-
+
+
R
B
B
Current: “Conflict is masked,
conversation skills atrophy”
Goal: “Networks and practice support
productive conversation”
28. investment in
Conversation
Capacity
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
Conflict in
sustainability
interactions
Desirability of
engagement
Credibility of
conversation
model
Network
convening
Empirical
evidence of
conversation
driving impact
Data science
and network
design
programs
+
-
-
-
+
-
+
-
-
+
+
+
+
+
+
R
B
B
Current: “Conflict is masked,
conversation skills atrophy”
Goal: “Networks and practice support
productive conversation”
29. Out beyond ideas of wrongdoing and rightdoing,
there is a field. I’ll meet you there.
When the soul lies down in that grass,
the world is too full to talk about.
Ideas, language, even the phrase ‘each other’
doesn’t make any sense.
Jalal ad-Din Mohammad Rumi
13th Century Persian scholar, theologian, poet
Words of hope...
30. Recognitions
Thank you to my Doctoral Committee, research team, and mentors!
● Teresa Johnson, PhD., UMaine, Doctoral Advisor
● Nancy Dixon, PhD., Columbia University, committee member
● Mohamad Musavi, PhD., UMaine, committee member
● Linda Silka, PhD. UMaine, committee member
● Erez Yoeli, PhD., MIT, committee member
● Emily Currie ‘22, research team
● Peter van Walsum, PhD., mentor
● David Hart, PhD., mentor
● Keith Evans, PhD., mentor
● Larry Prusak, Columbia University, mentor
● Christine Beitl and the whole ANT 560 Research Methods Class
32. 0. Sustainability
conversation
1.
Manual
coding
2. AI/ML
Algorithm
development
3. Signature
generation
5. Designs for
Capacity building &
Network
Aquaculture
stakeholder in
conversation
Research
team
performing
linguistic
analysis
Research
team
performing
statistical
analysis
Supplemental
data (e.g.,
BERT libraries)
Programmer,
using NLP
libraries
0a. Lease
scoping or
hearing
0b. Record.
0c. Transcribe
Parse into
utterances
1a. Classify for
4DDs, gender,
sequence,
outcome.
1b. Perform basic
statistics, pivot
tables to find
patterns
1c. Generate
infographics.
2a. Parse new conversation and
supplement. Gen. training data (HITL)
2b. Gen. and test algorithms for 4DDs,
gender, impacts
2c. Acquire more
conversation data as 4DD
examples
3a. Do statistical analysis
(e.g., regress composition
of moves, sequence of
moves, gender, etc. on
outcome.) draft
signatures
4. AI/ML Algorithm
Validation,
productization
4d. Revise algorithm to detect
4DDs, gender, sequence, and,
signature on new data
4e. Create new libraries wishlist
4b. Record.
4c. Transcribe
Parse into
utterances
5a. Draft,
improvements
to networks to
include skillful
conversation
5b. Focus
groups
1c. Interviews
to determine
outcomes
6. Launch
6a.
Develop
training,
toolkits
6c S/H
Training
4a. Lease
scoping or
hearing
Research
Process
ECE 598 Research Process and Roles
Spring-Summer 2021 Fall, 2021 -Spring 2022
Fall 2020-Spring 2021
33. Partial Bibliography (1 of 7)
● Anderies, & Janssen. (2016). Sustaining the Commons (2nd ed., Vol. 2). Creative Commons.
● Buchanan, M., & Pentland, A. (2007). The Science of Subtle Signals. Strategy & Business.
● Cash, D. W., Borck, J. C., & Patt, A. G. (2006). Countering the loading-dock approach to linking
science and decision making: Comparative analysis of El Niño/Southern Oscillation (ENSO)
forecasting systems. Science Technology and Human Values, 31(4), 465–494.
https://doi.org/10.1177/0162243906287547
● Caviglia, F., Dalsgaard, C., Delfino, M., & Pedersen, A. Y. (2017). Dialogic literacy: Contexts,
competences and dispositions. L1 Educational Studies in Language and Literature, 17(2017), 1–38.
https://doi.org/10.17239/L1ESLL-2017.17.01.05
● Chang, J. P., Chiam, C., Fu, L., Wang, A. Z., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020).
ConvoKit: A Toolkit for the Analysis of Conversations. ArXiv. http://arxiv.org/abs/2005.04246
● Cinner, J. (2018). How behavioral science can help conservation. In Science (Vol. 362, Issue 6417,
pp. 889–890). American Association for the Advancement of Science.
https://doi.org/10.1126/science.aau6028
● Clark, W. C., & Harley, A. G. (2020). Sustainability Science: Toward a Synthesis. Annual Review of
Environment and Resources, 45(1). https://doi.org/10.1146/annurev-environ-012420-043621
● Clarke, H., & Barton, W. (2019). Putting Dialogue to Work in the Virginia Department of Corrections.
In The World Needs Dialogue! (pp. 1–11).
34. Partial Bibliography (2 of 7)
● Deloitte. (2020). Open Source Compass: A new way to glean insights on the trajectory of open source
development for emerging technologies. Open Source Compass. https://opensourcecompass.io/
● Dietz, T., Dolšak, N., Ostrom, E., & Stern, P. C. (2002). The Drama of the Commons. In National
Academies Press.
● Dixon, N. (2018). Speaking Up 101. Ivey Business Journal, September/October 2018.
https://iveybusinessjournal.com/speaking-up-101/
● Dixon, N. M. (2021). Conversation Matters Blog: Posts on Conversation. Conversaion Matters.
https://www.nancydixonblog.com/conversation/
● Druschke, C. G., & McGreavy, B. (2016). Why rhetoric matters for ecology. Frontiers in Ecology and
the Environment, 14(1), 46–52. https://doi.org/10.1002/16-0113.1
● Edmondson, A. C., & Lei, Z. (2014). Psychological Safety: The History, Renaissance, and Future of
an Interpersonal Construct. Annual Review of Organizational Psychology and Organizational
Behavior, 1, 23–43. https://doi.org/10.1146/annurev-orgpsych-031413-091305
● Galinsky, A. D., Todd, A. R., Homan, A. C., Phillips, K. W., Apfelbaum, E. P., Sasaki, S. J., Richeson,
J. A., Olayon, J. B., & Maddux, W. W. (2015). Maximizing the Gains and Minimizing the Pains of
Diversity: A Policy Perspective. Perspectives on Psychological Science.
https://doi.org/10.1177/1745691615598513
35. Partial Bibliography (3 of 7)
● Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design
Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2).
http://iris.cs.aau.dk/tl_files/volumes/Volume 29/
● Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019.
● Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning
Research With Societal Needs. Issues in Science and Technology, 23(3).
https://issues.org/aligning-research-with-societal-needs/
● Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate
coordination. 1–15.
● Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people
think and not just what they do. Proceedings of the National Academy of Sciences of the United
States of America, 112(6), 1727–1732. https://doi.org/10.1073/pnas.1417904112
● Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press.
https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999
● Isaacs, W. (2016). Trim-Tab Dialogues : Transformative Vision and Action in South Asia. In The World
Needs Dialogue! (Issue February, pp. 1–19).
36. Partial Bibliography (4 of 7)
● Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design
Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2).
http://iris.cs.aau.dk/tl_files/volumes/Volume 29/
● Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019.
● Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning
Research With Societal Needs. Issues in Science and Technology, 23(3).
https://issues.org/aligning-research-with-societal-needs/
● Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate
coordination. 1–15.
● Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what
people think and not just what they do. Proceedings of the National Academy of Sciences of
the United States of America, 112(6), 1727–1732. https://doi.org/10.1073/pnas.1417904112
● Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press.
https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999
● Isaacs, W. (2016). Trim-Tab Dialogues : Transformative Vision and Action in South Asia. In The
World Needs Dialogue! (Issue February, pp. 1–19).
37. Partial Bibliography (5 of 7)
● Johnson, T., Beard, K., Brady, D., Byron, C., Cleaver, C., Duffy, K., Keeney, N., Kimble, M., Miller, M., Moeykens, S.,
Teisl, M., van Walsum, G., & Yuan, J. (2019). A Social-Ecological System Framework for Marine Aquaculture
Research. Sustainability, 11(9), 2522. https://doi.org/10.3390/su11092522
● Johnson, T. R. (2020). Reflecting on Maine ’ s Changing Productive Coastal Region. Maine Policy Review, 29(2),
91–97.
● Johnson, T. R., & Hanes, S. P. (2017). Marine Aquaculture in Restructuring Regions: Understanding the Key Coastal
Sustainability Transition. Quarterly Magazine of the Regional Studies Association, 308(Autumn), 13–15.
● McCardle-Keurentjes, M., & Rouwette, E. A. J. A. (2018). Asking Questions: A Sine Qua Non of Facilitation in Decision
Support? Group Decision and Negotiation, 27(5), 757–788. https://doi.org/10.1007/s10726-018-9573-y
● McGinnis, M. D., & Ostrom, E. (2014). Social-ecological system framework: initial changes and continuing challenges.
Ecology and Society, 19(2), art30. https://doi.org/10.5751/ES-06387-190230
● Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. In Science (Vol. 325,
Issue 5939, pp. 419–422). https://doi.org/10.1126/science.1172133
● Ostrom, E., Bravo, G., Janssen, M., Levin, S., Myint, T., Pahl-Wostl, C., & Walker, J. (2008). Workshop in Political
Theory and Policy Analysis BUILDING TRUST TO SOLVE COMMONS DILEMMAS: TAKING SMALL STEPS TO
TEST AN EVOLVING THEORY OF COLLECTIVE ACTION. www.indiana.edu/~workshopW08-239/22/08
38. Partial Bibliography (6 of 7)
● Page, S. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools and Societies -
New Edition. Princeton Press.
https://www.amazon.com/Difference-Diversity-Creates-Schools-Societies/dp/0691138540
● Page, S. E. (2017). The Diversity Bonus: How Great Teams Pay Off in the Knowledge Economy. Princeton Press.
https://www.amazon.com/Diversity-Bonus-Knowledge-Compelling-Interests-ebook/dp/B07JDTSZVR/?pldnSite=1
● Partelow, S. (2016). Coevolving Ostrom’s social–ecological systems (SES) framework and sustainability science: four
key co-benefits. Sustainability Science, 11(3), 399–410. https://doi.org/10.1007/s11625-015-0351-3
● Plamondon, K. M., Bottorff, J. L., & Cole, D. C. (2015). Analyzing Data Generated Through Deliberative Dialogue.
Qualitative Health Research, 25(11), 1529–1539. https://doi.org/10.1177/1049732315581603
● Pugh, K. (2016). Four Discussion Disciplines to Drive Effective Online Collaboration. Columbia SPS.
https://sps.columbia.edu/news/four-discussion-disciplines-drive-effective-online-collaboration
● Pugh, K. (2019). Conversational AI and AI for Conversation: Our Role as KM’ers?
● Pugh, K., & Prusak, L. (2013). Designing Effective Knowledge Networks. MIT Sloan Management Review.
● Rand, D. G., Yoeli, E., & Hoffman, M. (2014). Harnessing Reciprocity to Promote Cooperation and the Provisioning of
Public Goods. Policy Insights from the Behavioral and Brain Sciences, 1(1), 263–269.
https://doi.org/10.1177/2372732214548426
● Schein, E. H. (1978). The Role of the Consultant: Content Expert or Process Facilitator? The Personnel and Guidance
Journal, 56(6). https://doi.org/10.1002/j.2164-4918.1978.tb04644.x
39. Partial Bibliography (7 of 7)
● Schein, E. H. (1993). On dialogue, culture, and organizational learning. Organizational Dynamics, 22(2), 40–51.
https://doi.org/10.1016/0090-2616(93)90052-3
● See, A., Roller, S., Kiela, D., & Weston, J. (2019). What makes a good conversation? How controllable attributes affect human judgments. Facebook
Research and Stanford University. https://parl.ai/projects/
● Silka, L. (2013). “Silos” in the Democratization of Science. International Journal of Deliberative Mechanisms in Science, 2(1), 1.
https://doi.org/10.4471/demesci.2013.06
● Silka, L., Glover, R., Hutchins, K., Lindenfeld, L., Blackstone, A., Elliott, C., Ladenheim, M., & Sullivan, C. (2013). Moving Beyond the Single
Discipline : Building a Scholarship of Engagement that Permeates Higher Education. Tamara - Journal for Critical Organization Inquiry, 11(4), 41–52.
● Silka, L., McGreavy, B., & Hart, D. (2019). Breaking boundaries Chapter: Health, the Environment, and Sustainability: Emergent Communication
Lessons Across Highly Diverse Public Participation Activities. In State University of New York Press, Albany.
● Skifstad, S., & Pugh, K. (2014). Smarter Innovation: Beyond Netiquette (Chapter 8). In Smarter Innovation. Ark Group.
● Stasser, G., & Titus, W. (2003). Hidden Profiles: A Brief History. Psychological Inquiry, 14(3–4), 304–313.
https://doi.org/10.1080/1047840x.2003.9682897
● Wilkinson, M. (2012). The Secrets of Facilitation: The SMART Guide to Getting Results with Groups. Jossey-Bass/Wiley.
https://www.amazon.com/Secrets-Facilitation-Getting-Results-Groups-ebook/dp/B00DBOZPI4
● Willison, J. B., Rossman, S., Bieler, S., & Innes, C. (2017). Creating and Measuring a Healing Environment in the Virginia Department of
Corrections. In The World Needs Dialogue! https://www.urban.org/sites/default/files/publication/91411/nm_wave_2_brief_createmeasure_hei.pdf
● Woolley, A., Malone, T. W., & Chabris, C. F. (2015). GRAY MATTER. New York Times.
https://www.nytimes.com/2015/01/18/opinion/sunday/why-some-teams-are-smarter-than-others.html
● Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., & Malone, T. (2010). Evidence for a Collective Intelligence Factor in the Performance of
Human Groups. Science, 330(6004), 683–686. https://doi.org/10.1126/science.1190483