SlideShare une entreprise Scribd logo
1  sur  39
Translating effective sustainability conversation
into network design
SIKM Leaders Discussion: Spapshot of an NLP journey
Katrina Pugh, Columbia University, U Maine
April 20, 2021
Agenda
Rationale and problem statement
Research questions
Research design
References
Rationale and problem statement
Aquaculture industry tensions are high
Source: “With aquaculture booming, it’s time to talk about its future in Maine,” Portland Press Herald, April 13, 2021
https://www.pressherald.com/2021/04/13/with-aquaculture-booming-its-time-to-talk-about-its-future-in-maine/
“There is something wrong when you can’t even
have a conversation in Maine without sending
people into an uproar...
There are a number of [Aquaculture lease] criteria –
navigation, competition and others... “unreasonable
interference”…undefined, ambiguous…
...We are now faced with conflict up and down the
coast.”
Rationale and problem statement:
Aquaculture Social Ecological System...what we think
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
Diverse stakeholders
(Farmers, Fishers,
Boaters, Riparian
Landowners,
Regulators,
Legislators, NGOs)
Interaction:
Meetings, Hearings
Local town halls,
Participatory Action
Research
Efficiency
Innovation
Participation
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria
Action Situation:
Lease scoping mtg.
Lease Hearings
Outcome: Approval
(yes/no) for lease
Rationale and problem statement:
Aquaculture Social Ecological System...de facto!
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
4. Wealth
disparities
5. National
polarization
Diverse stakeholders
Lobbyists
Lawyers
PR agencies
Facilitators
NGO overlaps
Interaction: Meetings,
hearings
Local town halls (some
with bias, certainty,
conflict)
Participatory Action
Research
- Letters to the editors,
Soc media
Yes or no to
Aquaculture lease
approval
- Cost (of lobbying,
investigation)
- Spillover effects
- Time elapse
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria?
Action situation:
Lease scoping mtg.
Lease Hearings
Publishing, Press
Outcome: Approval
(yes/no) for lease
- Community
discord, cost
Rationale and problem statement:
Aquaculture Social Ecological System...reframed
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
4. Wealth disparities
5. National
conversation
Diverse stakeholders
Lobbyists
Lawyers
PR agencies
Facilitators
NGO overlaps
Interaction: Meetings
Local town halls (some with
bias, certainty)
PAR
- Letters to editors, SM
Productive
Conversation
Yes or no to
Aquaculture lease
approval
+ Individual
conversation skills
+ Network/
community
resilience
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria?
Action situation:
Lease scoping mtg.
Lease Hearings
Publishing, Press
Lease Approval (yes/no)
+ Options-Generation,
+ Relationships
+ Bias for Action
Rationale and problem statement:
Focus and research question
“How does conversation influence
our collective impact on
sustainability?
With this in mind, how can we
(re)design networks for better
conversation?”
Research Design
Research Design:
Significant authors
SES and
Sustainability
Science
Ostrom
Agarwal
Clark
Partelow
Cash
Johnson
Silka, Hart,
McGreavy
Dialogue, Facilitation
Schein
Weick
Isaacs
Dixon
Edmondson
Wilkinson
Danescu-Nikulesu-Mizil
See et al
Skifstad & Pugh
Complex
spreading
phenomena,
Org. learning,
knowledge NWs
Pugh & Prusak
Pentland& Malone
Watts
Centola and Macy
RARE.org
Soc Ecol. Systems Cooperation Conversation/AI Network strategy
Behavioral Insight,
Diversity, Reciprocity
Trivers
Nowak
Galinsky
Page
Thaler and Sustein
Hoffman, Rand &
Yoeli
Titus and Stasser
Source: Pugh, 2020, and Skifstad and Pugh, 2014.
Research Design:
What makes good conversation? (4 Discussion Disciplines)
10
Inclusion
Translation
Integrity
Courtesy
Asking clean
questions, making
statements with
data Respecting
participants,
respecting the
forum
Reaching out and
bringing in; not
“excluding” through
acronyms, terms of art,
in-language
Synthesizing,
sensemaking,
up-levelling into
actions
Derived from Dialogue practices Derived from Facilitation practices
Research Design:
Research process
0. Observe
Sustaina-
bility
conversa-
tions
1. Code
transcripts,
start
interviews
2. Develop
AI/ML
(NLP)
Algorithm
3. Generate
Conver-sati
on
Signatures
5. Design
Capacity
building &
Network,
test with
focus
group
4. Validate
AI/ML
Algorithm,
productize
6.
Launch
Spring-Summer 2021 Fall, 2021-Spring 2022
Fall 2020-Spring 2021
See A1: Research process detail
12
Integrity
Courtesy
Inclusion
Translation
We’ve been farming under a limited permit
aquaculture [LPA] lease. This has allowed us to
experiment. Next we moved to the public input part.
That’s today’s lease scoping meeting.
We want to minimize the impact as
much as possible.
I’ll follow up with you. I want your
opinion.
To clarify: aquaculture is a multitude of different
organisms, a multitude of different activities.
Source: Aquaculture Lease scoping meeting for Farmer #4. See appendix A2 for more examples.
Research Design:
Aquaculture Examples of Four Discussion Disciplines
M/F Item Comment Discipline Rationale
Farmer 24 This is the point where we listen and talk and
hear what you have to say.
Inclusion Open / include
n/a 25 10 seconds Inclusion Open / include
Harbor-
master
26 I have not been on one of these [scoping
meetings]. I heard [person of authority] signed
off. I was shocked. It’s bigger than I thought.
Anti-Courtesy Word "shocked" is trigger word.
Defensive
Harbor-
master
27 I was seeing the same materials as before. Integrity Statement of fact. Assume he saw
previous lease or earlier version.
Harbor-
master
28 That lobster trap needs to go. There’s no hauling
in the town of [town name].
Integrity Statement of fact.
Farmer 29 [Relative to the experimental lease] some
changes to the species. No change to the gear.
Translation Wrapping up, recapping.
Harbor-
master
30 I’m good with everything you said. Courtesy Positivity
Research Design:
Aquaculture lease Scoping meeting excerpt showing identity issues, aquaculture context
complexity
Injects doubt. Could
have derailed the
meeting here
(common pattern)
Sides with
farmer and
refers to reg
policy or lack of
reg policy
(common fisher
pattern)
Farmer is not
defensive
(previously: “we
want to be a
good neighbor”)
“Pivotal juncture”
opened inquiry
(40 more moves)
Research Design:
Six lease scoping meeting transcripts from Oct ‘20-March ‘21 (approximately 550 moves)
Integrity
dominates, with
Courtesy and
Integrity-Q next
Female % of
utterances
approx, 20%*
Contribute fewer
“anti” comments
*Except with female farmer leading scoping meeting. .
Research Design:
Percent of moves, by discussion discipline, by aquaculture lease scoping meeting
Relationship-Building, Intent to act
Relationship-Building
Options Generation, Relationship Building
Options Generation, Intent to Act
Intent to act
Relationship-Building, Intent to act
Research Design:
Six lease scoping meeting transcripts from Oct ‘20-March ‘21 (approximately 550 moves)
Options
Generation
Relationship-
building Intent to Act
Integrity (+) (+) (+)
Integrity-Q +
Courtesy +
Inclusion +
Translation (Weak)
Anti (courtesy,
integrity, inclusion)
(-)
Outcomes observed
Above-avg.
discussion
discipline
Research Design:
AI/ML Natural Language Processing: Using Cornell’s Convokit
Parsing
language
snippets
(pre-processi
ng and
feature
abstraction)
Ingesting
conversa-ti
on
transcripts
Cluster
analysis/m
atching to
four
discussion
disciplines
Testing on
“virgin”
transcripts,
generate
conversation
assessment
utility
Research Design:
AI/ML Natural Language Processing: Using Cornell’s Convokit
2. Separate
common
combination of
words that
have direction
(e.g.,
before-after,
parent-child)
3. Collect
those
directed word
combinations
that are
similar
4. Cluster
those motifs
together as
rhetorical
intentions
(questions,
answers,
provocations)
5. Identify
PromptTypes
’ Clusters
that most
correspond
to the four
discussion
disciplines.
6. Validate on
virgin
transcripts and
prepare for
statistical
analysis
1. Ingest
text from
transcripts
(raw
training
data)
Clean text
up
“Corpus”
compiled.
“Stop
words”
removed.
“TextClea
ner”
applied
“TextToArc
produces
ArcTypes,”
which are like
vectors -
directional
relationships
between words
“PhrasingMotifs”
are frequently-
occurring sets of
dependency-
parsed arcs
Use analyses,
1. graphs
2. rankings Propttypes
closest to the middle
(centroid) for that
cluster. Doing
stepwise, e.g., first
assign Integrity.
“PromptTypes” are
vector
representation
based on how they
are responded to --
as well as types of
rhetorical intentions
TF*IDF and SVD
Parsing language snippets (pre-processing and
feature abstraction)
Ingesting text Analysis/Matching to
discussion disciplines
Explanation
ConvoKit
Transformation
Research Design:
TF*IDF Vectorizer Matrix: From Phrasing motifs to Prompt Types
Phrasing
Motif 1
Phrasing
Motif 2
Phrasing
Motif 3
... Phrasing
Motif Z
Utteranc
e 1
1 0 1 ... 3
Utteranc
e 2
0 2 1 ... 0
Utteranc
e N
1 5 0 ... 7
Totals for each Phrasing Motif, for each
utterance, is then fed into SVD (Single Value
Decomposition) Matrix
https://scikit-learn.org/stable/modules/gener
ated/sklearn.decomposition.TruncatedSVD.h
tml
Overview: https://www.onely.com/blog/what-is-tf-idf/
SciKit-Learn Approach:
https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text
.TfidfVectorizer.html
For a Phasing Motif t in Utterance d, the weight Wt,d of
term t in document d is given by:
Wt,d = TFt,d log (N/DFt)
Where:
● TFt,d is the number of occurrences of t in Utterance
d.
● DFt is the number of Utterances containing the term
t.
● N is the total number of utterances in the corpus.
For SEO one would want a LOW TF*IDF. (Phrasing Motif
is rare). But for us, we would want a HIGH TF*IDF
(Phrasing Motif is not rare).
This is the frequency that this phrasing
motif occurs in the utterance (row).
The column Total X is the total
number of the phrasing Motif in the
CorpuS, with N utterances.
Total 1 Total 2 Total 3 Total ... Total Z
“TextToArc produces
ArcTypes,” which are
like vectors -
directional
relationships between
words in a sentence
Research Design:
Using Convokit
2. Separate common
combination of words
that have direction
(e.g., before-after,
parent-child)
3. Collect those
directed word
combinations that
are similar
3a: Politeness
strategies
4. Cluster those motifs
together as rhetorical
intentions (questions,
answers, provocations)
5. Identify
PromptTypes’
Clusters that most
correspond to the
four discussion
disciplines.
6. Validate on virgin
transcripts and prepare
for statistical analysis
1. Ingest text from
transcripts (raw
training data)
Clean text up.
“Corpus”
compiled. “Stop
words”
removed.
“TextCleaner”
applied
“PhrasingMotifs” are
frequently- occurring
sets of dependency-
parsed arcs
Use analyses,
1. graphs
2. rankings of prompttypes
closest to the middle
(centroid) for that cluster. May
do stepwise, to first assign
Integrity.
“PromptTypes” are vector
representation based on how
they are responded to -- as well
as types of rhetorical intentions
(clusters 0-7)
Parsing language snippets (pre-processing and feature abstraction)
Ingesting text Analysis/Matching to discussion disciplines
Explanation
ConvoKit
Transformation
'There is a guy
who whips
through there
in a Boston
whaler. I’m
pretty sure he
cut up my line
once.'
['a_* boston_* guy_* guy_a guy_whips in_*
in_whaler is_* is_guy is_there there>* there_*
through_* through_there whaler_* whaler_a
whaler_boston whips_* whips_in whips_through
whips_who who_*', "'m_* 'm_i 'm_sure cut_*
cut_he cut_line cut_once cut_up he_* i>* i_* line_*
line_my my_* once_* pretty_* sure_* sure_cut
sure_pretty up_*"]
['',
"'ll_* have_*__have_i__i>*__i_*
i>*__i_*",
'my_* the_*',
"'ll_* in_* the_*",
'a_* have_*__have_i__i>*__i_*
i>*__i_*']
[0.29997174
0.95394809]
(PromptTypes
Coordinates)
Example
Prompt Designation Response Designation
1
Motifs as input
field, utterances
may be
represented as
both prompt and
response. Pretty
noisy, some
trends: courtesy
mapping close
to prompt
centroid 4.
Research Design:
Influences on conversation outcomes (bold are observable in our data
as explanatory variables)
1. Conversation moves (discussion disciplines and
anti-disciplines)
2. Conversation moves’ sequence (e.g., time and type of
climax)
3. Gender (pertains to social sensitivity, and could be
captured by the “Courtesy” moves. Could also be related
to bias) (Woolley et al, 2010)
4. Region/Geography of lease (relates to wealth,
development, gentrification, environmental quality
5. Type of lease (e.g., duration up to 20 years, species,
equipment, relates to property rights)
6. Type of aquaculture tech (e.g., oyster, mussel rings)
7. Relationship history/costly signals (Grattan et al, 2007 on
“heritage relationships. May be captured by the
Region/Geography variable.)
8. Physical movement (Body language, pitch, cadence) (Pentland,
et al 2007)
9. History of the region (number of recent lease applications or
wins) (Ostrom, Partelow)
10. History of the conflict (nature of previous interactions across
the community, especially public or litigious actions) (ditto)
11. Regulation (governance systems) (ditto)
Likely to be available in the
conversations and publicly
available sources
More difficult to acquire with
current resources, and more
difficult to translate into
resources for sustainability
networks
Research Design:
Statistical analysis: What impact do the conversation attributes have
on outcomes, and is it statistically significant?
Explanatory variables Dependent variable: Outcomes
● X1 Signature (categorical variable determined by clustering: e.g.,
○ Sig 1 could be “above average inclusion, above average
integrity-Q,”
○ Sig 2 could be “below average inclusion, below average
integrity Q, above average translation”)
● X2 Sequence (categorical variable: climax type, such as early,
followed by loading) [Could also be part of X1]
● X3 Gender proportion
● X4 Region (proxy for costly signals, envtal qual, gentrification)
● X5 Type of Lease
1. Options generation
(innovation)
2. Intent to act (closure)
3. Relationship building
(Can be either positive or
negative)
Research Design:
Intervention: Accelerate the learning curve for productive conversation
1. Capacity-Building
● Training in Four Discussion
Disciplines (NLP research for
targeted impacts)
● Spreading boundary objects, like
pocket cards
● Collaborating with existing teams
(e.g., Maine Sea Grant,
Aquaculture in Shared Waters
training, DMR training)
2. Network Weaving
● Designing networks as “cradle for
conversation.”
● Incorporate behavioral models, social
norming
● Leveraging existing networks (e.g.,
FocusMaine, Maine Aquaculture
Association)
● Propose random controlled trials
Research Design:
Knowledge Network Effectiveness Framework (read right to left)
25
What are the impacts?
1. Learning / innovation
(tangible products)
2. Horizontal
Coordination (scale,
buying power)
3. Member Support
(trusted advice)
4. Translation/ Local
Adaptation
(sense-making)
What behaviors do we see?
•People identify with the
network out loud
•People share contacts,
knowledge even before
being asked
•People speak up, even
across hierarchy or political
divides
What dynamics play out?
• “if I contribute routinely, I
will, in turn, get value from
the network”
• “If I make mistakes, I will
learn in a community of
learners.”
• “If members identify with
the network, they
reciprocate.”
• “If leaders role-model
vulnerability, members will
take appropriate risks.”
What levers do we pull?
8 Design Dimensions:
Strategic
1.Leaders’ shared theory of change
2.Objectives/Outcomes/ Purpose
3. Expert-Learner balance
(psychological safety)
4. Inclusion/Participation
Structural
5. Operating model
6. Convening structures & infrastructures
7. Facilitation and social norm
development
Tactical
8. Measurement, feedback and incentives
Increasing leverage
KNEF on a page 210202
“Products,
negotia-tio
ns”
“Relation-
ships,
trust”
Source: Pugh & Prusak (2013) “Designing
Effective Knowledge Networks,” MIT Sloan
Management REview
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
+
-
-
-
+
-
+
B
B
Current: “Conflict is masked,
conversation skills atrophy”
investment in
Conversation
Capacity
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
Conflict in
sustainability
interactions
Desirability of
engagement
Credibility of
conversation
model
+
-
-
-
+
-
+
-
-
+
+
R
B
B
Current: “Conflict is masked,
conversation skills atrophy”
Goal: “Networks and practice support
productive conversation”
investment in
Conversation
Capacity
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
Conflict in
sustainability
interactions
Desirability of
engagement
Credibility of
conversation
model
Network
convening
Empirical
evidence of
conversation
driving impact
Data science
and network
design
programs
+
-
-
-
+
-
+
-
-
+
+
+
+
+
+
R
B
B
Current: “Conflict is masked,
conversation skills atrophy”
Goal: “Networks and practice support
productive conversation”
Out beyond ideas of wrongdoing and rightdoing,
there is a field. I’ll meet you there.
When the soul lies down in that grass,
the world is too full to talk about.
Ideas, language, even the phrase ‘each other’
doesn’t make any sense.
Jalal ad-Din Mohammad Rumi
13th Century Persian scholar, theologian, poet
Words of hope...
Recognitions
Thank you to my Doctoral Committee, research team, and mentors!
● Teresa Johnson, PhD., UMaine, Doctoral Advisor
● Nancy Dixon, PhD., Columbia University, committee member
● Mohamad Musavi, PhD., UMaine, committee member
● Linda Silka, PhD. UMaine, committee member
● Erez Yoeli, PhD., MIT, committee member
● Emily Currie ‘22, research team
● Peter van Walsum, PhD., mentor
● David Hart, PhD., mentor
● Keith Evans, PhD., mentor
● Larry Prusak, Columbia University, mentor
● Christine Beitl and the whole ANT 560 Research Methods Class
Appendix
0. Sustainability
conversation
1.
Manual
coding
2. AI/ML
Algorithm
development
3. Signature
generation
5. Designs for
Capacity building &
Network
Aquaculture
stakeholder in
conversation
Research
team
performing
linguistic
analysis
Research
team
performing
statistical
analysis
Supplemental
data (e.g.,
BERT libraries)
Programmer,
using NLP
libraries
0a. Lease
scoping or
hearing
0b. Record.
0c. Transcribe
Parse into
utterances
1a. Classify for
4DDs, gender,
sequence,
outcome.
1b. Perform basic
statistics, pivot
tables to find
patterns
1c. Generate
infographics.
2a. Parse new conversation and
supplement. Gen. training data (HITL)
2b. Gen. and test algorithms for 4DDs,
gender, impacts
2c. Acquire more
conversation data as 4DD
examples
3a. Do statistical analysis
(e.g., regress composition
of moves, sequence of
moves, gender, etc. on
outcome.) draft
signatures
4. AI/ML Algorithm
Validation,
productization
4d. Revise algorithm to detect
4DDs, gender, sequence, and,
signature on new data
4e. Create new libraries wishlist
4b. Record.
4c. Transcribe
Parse into
utterances
5a. Draft,
improvements
to networks to
include skillful
conversation
5b. Focus
groups
1c. Interviews
to determine
outcomes
6. Launch
6a.
Develop
training,
toolkits
6c S/H
Training
4a. Lease
scoping or
hearing
Research
Process
ECE 598 Research Process and Roles
Spring-Summer 2021 Fall, 2021 -Spring 2022
Fall 2020-Spring 2021
Partial Bibliography (1 of 7)
● Anderies, & Janssen. (2016). Sustaining the Commons (2nd ed., Vol. 2). Creative Commons.
● Buchanan, M., & Pentland, A. (2007). The Science of Subtle Signals. Strategy & Business.
● Cash, D. W., Borck, J. C., & Patt, A. G. (2006). Countering the loading-dock approach to linking
science and decision making: Comparative analysis of El Niño/Southern Oscillation (ENSO)
forecasting systems. Science Technology and Human Values, 31(4), 465–494.
https://doi.org/10.1177/0162243906287547
● Caviglia, F., Dalsgaard, C., Delfino, M., & Pedersen, A. Y. (2017). Dialogic literacy: Contexts,
competences and dispositions. L1 Educational Studies in Language and Literature, 17(2017), 1–38.
https://doi.org/10.17239/L1ESLL-2017.17.01.05
● Chang, J. P., Chiam, C., Fu, L., Wang, A. Z., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020).
ConvoKit: A Toolkit for the Analysis of Conversations. ArXiv. http://arxiv.org/abs/2005.04246
● Cinner, J. (2018). How behavioral science can help conservation. In Science (Vol. 362, Issue 6417,
pp. 889–890). American Association for the Advancement of Science.
https://doi.org/10.1126/science.aau6028
● Clark, W. C., & Harley, A. G. (2020). Sustainability Science: Toward a Synthesis. Annual Review of
Environment and Resources, 45(1). https://doi.org/10.1146/annurev-environ-012420-043621
● Clarke, H., & Barton, W. (2019). Putting Dialogue to Work in the Virginia Department of Corrections.
In The World Needs Dialogue! (pp. 1–11).
Partial Bibliography (2 of 7)
● Deloitte. (2020). Open Source Compass: A new way to glean insights on the trajectory of open source
development for emerging technologies. Open Source Compass. https://opensourcecompass.io/
● Dietz, T., Dolšak, N., Ostrom, E., & Stern, P. C. (2002). The Drama of the Commons. In National
Academies Press.
● Dixon, N. (2018). Speaking Up 101. Ivey Business Journal, September/October 2018.
https://iveybusinessjournal.com/speaking-up-101/
● Dixon, N. M. (2021). Conversation Matters Blog: Posts on Conversation. Conversaion Matters.
https://www.nancydixonblog.com/conversation/
● Druschke, C. G., & McGreavy, B. (2016). Why rhetoric matters for ecology. Frontiers in Ecology and
the Environment, 14(1), 46–52. https://doi.org/10.1002/16-0113.1
● Edmondson, A. C., & Lei, Z. (2014). Psychological Safety: The History, Renaissance, and Future of
an Interpersonal Construct. Annual Review of Organizational Psychology and Organizational
Behavior, 1, 23–43. https://doi.org/10.1146/annurev-orgpsych-031413-091305
● Galinsky, A. D., Todd, A. R., Homan, A. C., Phillips, K. W., Apfelbaum, E. P., Sasaki, S. J., Richeson,
J. A., Olayon, J. B., & Maddux, W. W. (2015). Maximizing the Gains and Minimizing the Pains of
Diversity: A Policy Perspective. Perspectives on Psychological Science.
https://doi.org/10.1177/1745691615598513
Partial Bibliography (3 of 7)
● Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design
Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2).
http://iris.cs.aau.dk/tl_files/volumes/Volume 29/
● Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019.
● Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning
Research With Societal Needs. Issues in Science and Technology, 23(3).
https://issues.org/aligning-research-with-societal-needs/
● Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate
coordination. 1–15.
● Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people
think and not just what they do. Proceedings of the National Academy of Sciences of the United
States of America, 112(6), 1727–1732. https://doi.org/10.1073/pnas.1417904112
● Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press.
https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999
● Isaacs, W. (2016). Trim-Tab Dialogues : Transformative Vision and Action in South Asia. In The World
Needs Dialogue! (Issue February, pp. 1–19).
Partial Bibliography (4 of 7)
● Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design
Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2).
http://iris.cs.aau.dk/tl_files/volumes/Volume 29/
● Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019.
● Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning
Research With Societal Needs. Issues in Science and Technology, 23(3).
https://issues.org/aligning-research-with-societal-needs/
● Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate
coordination. 1–15.
● Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what
people think and not just what they do. Proceedings of the National Academy of Sciences of
the United States of America, 112(6), 1727–1732. https://doi.org/10.1073/pnas.1417904112
● Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press.
https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999
● Isaacs, W. (2016). Trim-Tab Dialogues : Transformative Vision and Action in South Asia. In The
World Needs Dialogue! (Issue February, pp. 1–19).
Partial Bibliography (5 of 7)
● Johnson, T., Beard, K., Brady, D., Byron, C., Cleaver, C., Duffy, K., Keeney, N., Kimble, M., Miller, M., Moeykens, S.,
Teisl, M., van Walsum, G., & Yuan, J. (2019). A Social-Ecological System Framework for Marine Aquaculture
Research. Sustainability, 11(9), 2522. https://doi.org/10.3390/su11092522
● Johnson, T. R. (2020). Reflecting on Maine ’ s Changing Productive Coastal Region. Maine Policy Review, 29(2),
91–97.
● Johnson, T. R., & Hanes, S. P. (2017). Marine Aquaculture in Restructuring Regions: Understanding the Key Coastal
Sustainability Transition. Quarterly Magazine of the Regional Studies Association, 308(Autumn), 13–15.
● McCardle-Keurentjes, M., & Rouwette, E. A. J. A. (2018). Asking Questions: A Sine Qua Non of Facilitation in Decision
Support? Group Decision and Negotiation, 27(5), 757–788. https://doi.org/10.1007/s10726-018-9573-y
● McGinnis, M. D., & Ostrom, E. (2014). Social-ecological system framework: initial changes and continuing challenges.
Ecology and Society, 19(2), art30. https://doi.org/10.5751/ES-06387-190230
● Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. In Science (Vol. 325,
Issue 5939, pp. 419–422). https://doi.org/10.1126/science.1172133
● Ostrom, E., Bravo, G., Janssen, M., Levin, S., Myint, T., Pahl-Wostl, C., & Walker, J. (2008). Workshop in Political
Theory and Policy Analysis BUILDING TRUST TO SOLVE COMMONS DILEMMAS: TAKING SMALL STEPS TO
TEST AN EVOLVING THEORY OF COLLECTIVE ACTION. www.indiana.edu/~workshopW08-239/22/08
Partial Bibliography (6 of 7)
● Page, S. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools and Societies -
New Edition. Princeton Press.
https://www.amazon.com/Difference-Diversity-Creates-Schools-Societies/dp/0691138540
● Page, S. E. (2017). The Diversity Bonus: How Great Teams Pay Off in the Knowledge Economy. Princeton Press.
https://www.amazon.com/Diversity-Bonus-Knowledge-Compelling-Interests-ebook/dp/B07JDTSZVR/?pldnSite=1
● Partelow, S. (2016). Coevolving Ostrom’s social–ecological systems (SES) framework and sustainability science: four
key co-benefits. Sustainability Science, 11(3), 399–410. https://doi.org/10.1007/s11625-015-0351-3
● Plamondon, K. M., Bottorff, J. L., & Cole, D. C. (2015). Analyzing Data Generated Through Deliberative Dialogue.
Qualitative Health Research, 25(11), 1529–1539. https://doi.org/10.1177/1049732315581603
● Pugh, K. (2016). Four Discussion Disciplines to Drive Effective Online Collaboration. Columbia SPS.
https://sps.columbia.edu/news/four-discussion-disciplines-drive-effective-online-collaboration
● Pugh, K. (2019). Conversational AI and AI for Conversation: Our Role as KM’ers?
● Pugh, K., & Prusak, L. (2013). Designing Effective Knowledge Networks. MIT Sloan Management Review.
● Rand, D. G., Yoeli, E., & Hoffman, M. (2014). Harnessing Reciprocity to Promote Cooperation and the Provisioning of
Public Goods. Policy Insights from the Behavioral and Brain Sciences, 1(1), 263–269.
https://doi.org/10.1177/2372732214548426
● Schein, E. H. (1978). The Role of the Consultant: Content Expert or Process Facilitator? The Personnel and Guidance
Journal, 56(6). https://doi.org/10.1002/j.2164-4918.1978.tb04644.x
Partial Bibliography (7 of 7)
● Schein, E. H. (1993). On dialogue, culture, and organizational learning. Organizational Dynamics, 22(2), 40–51.
https://doi.org/10.1016/0090-2616(93)90052-3
● See, A., Roller, S., Kiela, D., & Weston, J. (2019). What makes a good conversation? How controllable attributes affect human judgments. Facebook
Research and Stanford University. https://parl.ai/projects/
● Silka, L. (2013). “Silos” in the Democratization of Science. International Journal of Deliberative Mechanisms in Science, 2(1), 1.
https://doi.org/10.4471/demesci.2013.06
● Silka, L., Glover, R., Hutchins, K., Lindenfeld, L., Blackstone, A., Elliott, C., Ladenheim, M., & Sullivan, C. (2013). Moving Beyond the Single
Discipline : Building a Scholarship of Engagement that Permeates Higher Education. Tamara - Journal for Critical Organization Inquiry, 11(4), 41–52.
● Silka, L., McGreavy, B., & Hart, D. (2019). Breaking boundaries Chapter: Health, the Environment, and Sustainability: Emergent Communication
Lessons Across Highly Diverse Public Participation Activities. In State University of New York Press, Albany.
● Skifstad, S., & Pugh, K. (2014). Smarter Innovation: Beyond Netiquette (Chapter 8). In Smarter Innovation. Ark Group.
● Stasser, G., & Titus, W. (2003). Hidden Profiles: A Brief History. Psychological Inquiry, 14(3–4), 304–313.
https://doi.org/10.1080/1047840x.2003.9682897
● Wilkinson, M. (2012). The Secrets of Facilitation: The SMART Guide to Getting Results with Groups. Jossey-Bass/Wiley.
https://www.amazon.com/Secrets-Facilitation-Getting-Results-Groups-ebook/dp/B00DBOZPI4
● Willison, J. B., Rossman, S., Bieler, S., & Innes, C. (2017). Creating and Measuring a Healing Environment in the Virginia Department of
Corrections. In The World Needs Dialogue! https://www.urban.org/sites/default/files/publication/91411/nm_wave_2_brief_createmeasure_hei.pdf
● Woolley, A., Malone, T. W., & Chabris, C. F. (2015). GRAY MATTER. New York Times.
https://www.nytimes.com/2015/01/18/opinion/sunday/why-some-teams-are-smarter-than-others.html
● Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., & Malone, T. (2010). Evidence for a Collective Intelligence Factor in the Performance of
Human Groups. Science, 330(6004), 683–686. https://doi.org/10.1126/science.1190483

Contenu connexe

Similaire à Sikm pugh sustainability conversations for impact snapshot 210420

Discourse Analysis for Social Research
Discourse Analysis for Social ResearchDiscourse Analysis for Social Research
Discourse Analysis for Social ResearchDominik Lukes
 
Project-Based Learning - USD 340
Project-Based Learning - USD 340Project-Based Learning - USD 340
Project-Based Learning - USD 340Doug Adams
 
Webquest Elk Populations
Webquest  Elk PopulationsWebquest  Elk Populations
Webquest Elk Populationssciencestar
 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of UnderstandingPeter Morville
 
Patterns for collaborative creativity
Patterns for collaborative creativityPatterns for collaborative creativity
Patterns for collaborative creativityJohn Thomas
 
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...St. Petersburg College
 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019collierdr709
 
Lecture Polimi April2021
Lecture Polimi April2021Lecture Polimi April2021
Lecture Polimi April2021Anna De Liddo
 
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...Allison Jai O'Dell
 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of UnderstandingPeter Morville
 
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...Seth Grimes
 
The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...Seth Grimes
 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019collierdr709
 
Text Analytics for Semantic Computing
Text Analytics for Semantic ComputingText Analytics for Semantic Computing
Text Analytics for Semantic ComputingMeena Nagarajan
 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of UnderstandingPeter Morville
 
Writing Essay Papers
Writing Essay PapersWriting Essay Papers
Writing Essay PapersAshley Bonham
 
STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University Darci the STEM Mom
 

Similaire à Sikm pugh sustainability conversations for impact snapshot 210420 (20)

Discourse Analysis for Social Research
Discourse Analysis for Social ResearchDiscourse Analysis for Social Research
Discourse Analysis for Social Research
 
Project-Based Learning - USD 340
Project-Based Learning - USD 340Project-Based Learning - USD 340
Project-Based Learning - USD 340
 
Webquest Elk Populations
Webquest  Elk PopulationsWebquest  Elk Populations
Webquest Elk Populations
 
20100427 Earthster Core Ontology
20100427 Earthster Core Ontology20100427 Earthster Core Ontology
20100427 Earthster Core Ontology
 
Carolyn Rosé - WESST - From Data to Design of Dynamic Support for Collaborati...
Carolyn Rosé - WESST - From Data to Design of Dynamic Support for Collaborati...Carolyn Rosé - WESST - From Data to Design of Dynamic Support for Collaborati...
Carolyn Rosé - WESST - From Data to Design of Dynamic Support for Collaborati...
 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of Understanding
 
Advances In Wsd Acl 2005
Advances In Wsd Acl 2005Advances In Wsd Acl 2005
Advances In Wsd Acl 2005
 
Patterns for collaborative creativity
Patterns for collaborative creativityPatterns for collaborative creativity
Patterns for collaborative creativity
 
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019
 
Lecture Polimi April2021
Lecture Polimi April2021Lecture Polimi April2021
Lecture Polimi April2021
 
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of Understanding
 
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
 
The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:
 Challenges in Comprehensive Corpu...
 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019
 
Text Analytics for Semantic Computing
Text Analytics for Semantic ComputingText Analytics for Semantic Computing
Text Analytics for Semantic Computing
 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of Understanding
 
Writing Essay Papers
Writing Essay PapersWriting Essay Papers
Writing Essay Papers
 
STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University
 

Plus de Katrina (Kate) Pugh

Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)Katrina (Kate) Pugh
 
Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809Katrina (Kate) Pugh
 
Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618Katrina (Kate) Pugh
 
Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017Katrina (Kate) Pugh
 
Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217Katrina (Kate) Pugh
 
Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315Katrina (Kate) Pugh
 
Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2Katrina (Kate) Pugh
 
Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6Katrina (Kate) Pugh
 
Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208Katrina (Kate) Pugh
 
IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406Katrina (Kate) Pugh
 
Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615Katrina (Kate) Pugh
 

Plus de Katrina (Kate) Pugh (11)

Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
 
Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809
 
Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618
 
Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017
 
Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217
 
Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315
 
Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2
 
Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6
 
Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208
 
IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406
 
Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615
 

Dernier

Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...
Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...
Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...Amil baba
 
Group 4The Species of the Atlantic Forest.pdf
Group 4The Species of the Atlantic Forest.pdfGroup 4The Species of the Atlantic Forest.pdf
Group 4The Species of the Atlantic Forest.pdfs2015004
 
Species composition, diversity and community structure of mangroves in Barang...
Species composition, diversity and community structure of mangroves in Barang...Species composition, diversity and community structure of mangroves in Barang...
Species composition, diversity and community structure of mangroves in Barang...Open Access Research Paper
 
原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量sehgh15heh
 
UNIT ONE ppt history of Ethiopia and horn.pptx
UNIT ONE ppt history of Ethiopia and horn.pptxUNIT ONE ppt history of Ethiopia and horn.pptx
UNIT ONE ppt history of Ethiopia and horn.pptxzeyohannesamare
 
Asexual-and-Sexual-Reproduction.huhupptx
Asexual-and-Sexual-Reproduction.huhupptxAsexual-and-Sexual-Reproduction.huhupptx
Asexual-and-Sexual-Reproduction.huhupptxMyBrightestStarParkJ
 
Dwarka Call Girls 9643097474 Phone Number 24x7 Best Services
Dwarka Call Girls 9643097474 Phone Number 24x7 Best ServicesDwarka Call Girls 9643097474 Phone Number 24x7 Best Services
Dwarka Call Girls 9643097474 Phone Number 24x7 Best Servicesnajka9823
 
EMP (Environment Management Plan . .pptx
EMP (Environment Management Plan . .pptxEMP (Environment Management Plan . .pptx
EMP (Environment Management Plan . .pptxSarmad Naeem
 
办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一
办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一
办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一z xss
 
Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170
Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170
Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170simranguptaxx69
 
办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书
办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书
办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书zdzoqco
 
Call In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCR
Call In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCRCall In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCR
Call In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCRjennyeacort
 
Limnology and Wetland Management 2023 NaRM.pptx
Limnology and Wetland Management 2023 NaRM.pptxLimnology and Wetland Management 2023 NaRM.pptx
Limnology and Wetland Management 2023 NaRM.pptxTesfahunTesema
 
原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证
原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证
原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证jdkhjh
 
Making a Difference: Understanding the Upcycling and Recycling Difference
Making a Difference: Understanding the Upcycling and Recycling DifferenceMaking a Difference: Understanding the Upcycling and Recycling Difference
Making a Difference: Understanding the Upcycling and Recycling DifferenceSwag Cycle
 
Biogas Production from Agricultural Feedstock and Energy Crops
Biogas Production from Agricultural Feedstock and Energy CropsBiogas Production from Agricultural Feedstock and Energy Crops
Biogas Production from Agricultural Feedstock and Energy CropsRabiyaSalman2
 
Along the Lakefront, "Menacing Unknown"s
Along the Lakefront, "Menacing Unknown"sAlong the Lakefront, "Menacing Unknown"s
Along the Lakefront, "Menacing Unknown"syalehistoricalreview
 
التغيرات المناخية وتاثيرها على القطاع الزراعي المصري
التغيرات المناخية وتاثيرها على القطاع الزراعي المصريالتغيرات المناخية وتاثيرها على القطاع الزراعي المصري
التغيرات المناخية وتاثيرها على القطاع الزراعي المصريRawhyaShaheen
 

Dernier (20)

Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...
Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...
Uae-NO1 Black Magic Specialist Expert In Bahawalpur, Sargodha, Sialkot, Sheik...
 
Health Facility Electrification: State of Play
Health Facility Electrification: State of PlayHealth Facility Electrification: State of Play
Health Facility Electrification: State of Play
 
Group 4The Species of the Atlantic Forest.pdf
Group 4The Species of the Atlantic Forest.pdfGroup 4The Species of the Atlantic Forest.pdf
Group 4The Species of the Atlantic Forest.pdf
 
Species composition, diversity and community structure of mangroves in Barang...
Species composition, diversity and community structure of mangroves in Barang...Species composition, diversity and community structure of mangroves in Barang...
Species composition, diversity and community structure of mangroves in Barang...
 
原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲詹姆斯库克大学毕业证JCU毕业证成绩单留信学历认证保障质量
 
UNIT ONE ppt history of Ethiopia and horn.pptx
UNIT ONE ppt history of Ethiopia and horn.pptxUNIT ONE ppt history of Ethiopia and horn.pptx
UNIT ONE ppt history of Ethiopia and horn.pptx
 
Asexual-and-Sexual-Reproduction.huhupptx
Asexual-and-Sexual-Reproduction.huhupptxAsexual-and-Sexual-Reproduction.huhupptx
Asexual-and-Sexual-Reproduction.huhupptx
 
Dwarka Call Girls 9643097474 Phone Number 24x7 Best Services
Dwarka Call Girls 9643097474 Phone Number 24x7 Best ServicesDwarka Call Girls 9643097474 Phone Number 24x7 Best Services
Dwarka Call Girls 9643097474 Phone Number 24x7 Best Services
 
EMP (Environment Management Plan . .pptx
EMP (Environment Management Plan . .pptxEMP (Environment Management Plan . .pptx
EMP (Environment Management Plan . .pptx
 
办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一
办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一
办理(Victoria毕业证书)维多利亚大学毕业证成绩单原版一比一
 
Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170
Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170
Call Girls Sarovar Portico Naraina Hotel, New Delhi 9873777170
 
办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书
办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书
办理英属哥伦比亚大学毕业证成绩单|购买加拿大UBC文凭证书
 
Call In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCR
Call In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCRCall In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCR
Call In girls Connaught Place (DELHI)⇛9711147426🔝Delhi NCR
 
Limnology and Wetland Management 2023 NaRM.pptx
Limnology and Wetland Management 2023 NaRM.pptxLimnology and Wetland Management 2023 NaRM.pptx
Limnology and Wetland Management 2023 NaRM.pptx
 
原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证
原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证
原版1:1复刻塔夫斯大学毕业证Tufts毕业证留信学历认证
 
Making a Difference: Understanding the Upcycling and Recycling Difference
Making a Difference: Understanding the Upcycling and Recycling DifferenceMaking a Difference: Understanding the Upcycling and Recycling Difference
Making a Difference: Understanding the Upcycling and Recycling Difference
 
young call girls in Janakpuri🔝 9953056974 🔝 escort Service
young call girls in Janakpuri🔝 9953056974 🔝 escort Serviceyoung call girls in Janakpuri🔝 9953056974 🔝 escort Service
young call girls in Janakpuri🔝 9953056974 🔝 escort Service
 
Biogas Production from Agricultural Feedstock and Energy Crops
Biogas Production from Agricultural Feedstock and Energy CropsBiogas Production from Agricultural Feedstock and Energy Crops
Biogas Production from Agricultural Feedstock and Energy Crops
 
Along the Lakefront, "Menacing Unknown"s
Along the Lakefront, "Menacing Unknown"sAlong the Lakefront, "Menacing Unknown"s
Along the Lakefront, "Menacing Unknown"s
 
التغيرات المناخية وتاثيرها على القطاع الزراعي المصري
التغيرات المناخية وتاثيرها على القطاع الزراعي المصريالتغيرات المناخية وتاثيرها على القطاع الزراعي المصري
التغيرات المناخية وتاثيرها على القطاع الزراعي المصري
 

Sikm pugh sustainability conversations for impact snapshot 210420

  • 1. Translating effective sustainability conversation into network design SIKM Leaders Discussion: Spapshot of an NLP journey Katrina Pugh, Columbia University, U Maine April 20, 2021
  • 2. Agenda Rationale and problem statement Research questions Research design References
  • 3. Rationale and problem statement Aquaculture industry tensions are high Source: “With aquaculture booming, it’s time to talk about its future in Maine,” Portland Press Herald, April 13, 2021 https://www.pressherald.com/2021/04/13/with-aquaculture-booming-its-time-to-talk-about-its-future-in-maine/ “There is something wrong when you can’t even have a conversation in Maine without sending people into an uproar... There are a number of [Aquaculture lease] criteria – navigation, competition and others... “unreasonable interference”…undefined, ambiguous… ...We are now faced with conflict up and down the coast.”
  • 4. Rationale and problem statement: Aquaculture Social Ecological System...what we think 1. Climate change/ warming waters 2. Diminished traditional fishing, near monoculture 3. Depts of Marine Res, Fish & Wildlife processes Diverse stakeholders (Farmers, Fishers, Boaters, Riparian Landowners, Regulators, Legislators, NGOs) Interaction: Meetings, Hearings Local town halls, Participatory Action Research Efficiency Innovation Participation Exogenous variables Action Arena Interaction & Outcome Evaluative Criteria Action Situation: Lease scoping mtg. Lease Hearings Outcome: Approval (yes/no) for lease
  • 5. Rationale and problem statement: Aquaculture Social Ecological System...de facto! 1. Climate change/ warming waters 2. Diminished traditional fishing, near monoculture 3. Depts of Marine Res, Fish & Wildlife processes 4. Wealth disparities 5. National polarization Diverse stakeholders Lobbyists Lawyers PR agencies Facilitators NGO overlaps Interaction: Meetings, hearings Local town halls (some with bias, certainty, conflict) Participatory Action Research - Letters to the editors, Soc media Yes or no to Aquaculture lease approval - Cost (of lobbying, investigation) - Spillover effects - Time elapse Exogenous variables Action Arena Interaction & Outcome Evaluative Criteria? Action situation: Lease scoping mtg. Lease Hearings Publishing, Press Outcome: Approval (yes/no) for lease - Community discord, cost
  • 6. Rationale and problem statement: Aquaculture Social Ecological System...reframed 1. Climate change/ warming waters 2. Diminished traditional fishing, near monoculture 3. Depts of Marine Res, Fish & Wildlife processes 4. Wealth disparities 5. National conversation Diverse stakeholders Lobbyists Lawyers PR agencies Facilitators NGO overlaps Interaction: Meetings Local town halls (some with bias, certainty) PAR - Letters to editors, SM Productive Conversation Yes or no to Aquaculture lease approval + Individual conversation skills + Network/ community resilience Exogenous variables Action Arena Interaction & Outcome Evaluative Criteria? Action situation: Lease scoping mtg. Lease Hearings Publishing, Press Lease Approval (yes/no) + Options-Generation, + Relationships + Bias for Action
  • 7. Rationale and problem statement: Focus and research question “How does conversation influence our collective impact on sustainability? With this in mind, how can we (re)design networks for better conversation?”
  • 9. Research Design: Significant authors SES and Sustainability Science Ostrom Agarwal Clark Partelow Cash Johnson Silka, Hart, McGreavy Dialogue, Facilitation Schein Weick Isaacs Dixon Edmondson Wilkinson Danescu-Nikulesu-Mizil See et al Skifstad & Pugh Complex spreading phenomena, Org. learning, knowledge NWs Pugh & Prusak Pentland& Malone Watts Centola and Macy RARE.org Soc Ecol. Systems Cooperation Conversation/AI Network strategy Behavioral Insight, Diversity, Reciprocity Trivers Nowak Galinsky Page Thaler and Sustein Hoffman, Rand & Yoeli Titus and Stasser
  • 10. Source: Pugh, 2020, and Skifstad and Pugh, 2014. Research Design: What makes good conversation? (4 Discussion Disciplines) 10 Inclusion Translation Integrity Courtesy Asking clean questions, making statements with data Respecting participants, respecting the forum Reaching out and bringing in; not “excluding” through acronyms, terms of art, in-language Synthesizing, sensemaking, up-levelling into actions Derived from Dialogue practices Derived from Facilitation practices
  • 11. Research Design: Research process 0. Observe Sustaina- bility conversa- tions 1. Code transcripts, start interviews 2. Develop AI/ML (NLP) Algorithm 3. Generate Conver-sati on Signatures 5. Design Capacity building & Network, test with focus group 4. Validate AI/ML Algorithm, productize 6. Launch Spring-Summer 2021 Fall, 2021-Spring 2022 Fall 2020-Spring 2021 See A1: Research process detail
  • 12. 12 Integrity Courtesy Inclusion Translation We’ve been farming under a limited permit aquaculture [LPA] lease. This has allowed us to experiment. Next we moved to the public input part. That’s today’s lease scoping meeting. We want to minimize the impact as much as possible. I’ll follow up with you. I want your opinion. To clarify: aquaculture is a multitude of different organisms, a multitude of different activities. Source: Aquaculture Lease scoping meeting for Farmer #4. See appendix A2 for more examples. Research Design: Aquaculture Examples of Four Discussion Disciplines
  • 13. M/F Item Comment Discipline Rationale Farmer 24 This is the point where we listen and talk and hear what you have to say. Inclusion Open / include n/a 25 10 seconds Inclusion Open / include Harbor- master 26 I have not been on one of these [scoping meetings]. I heard [person of authority] signed off. I was shocked. It’s bigger than I thought. Anti-Courtesy Word "shocked" is trigger word. Defensive Harbor- master 27 I was seeing the same materials as before. Integrity Statement of fact. Assume he saw previous lease or earlier version. Harbor- master 28 That lobster trap needs to go. There’s no hauling in the town of [town name]. Integrity Statement of fact. Farmer 29 [Relative to the experimental lease] some changes to the species. No change to the gear. Translation Wrapping up, recapping. Harbor- master 30 I’m good with everything you said. Courtesy Positivity Research Design: Aquaculture lease Scoping meeting excerpt showing identity issues, aquaculture context complexity Injects doubt. Could have derailed the meeting here (common pattern) Sides with farmer and refers to reg policy or lack of reg policy (common fisher pattern) Farmer is not defensive (previously: “we want to be a good neighbor”) “Pivotal juncture” opened inquiry (40 more moves)
  • 14. Research Design: Six lease scoping meeting transcripts from Oct ‘20-March ‘21 (approximately 550 moves) Integrity dominates, with Courtesy and Integrity-Q next Female % of utterances approx, 20%* Contribute fewer “anti” comments *Except with female farmer leading scoping meeting. .
  • 15. Research Design: Percent of moves, by discussion discipline, by aquaculture lease scoping meeting Relationship-Building, Intent to act Relationship-Building Options Generation, Relationship Building Options Generation, Intent to Act Intent to act Relationship-Building, Intent to act
  • 16. Research Design: Six lease scoping meeting transcripts from Oct ‘20-March ‘21 (approximately 550 moves) Options Generation Relationship- building Intent to Act Integrity (+) (+) (+) Integrity-Q + Courtesy + Inclusion + Translation (Weak) Anti (courtesy, integrity, inclusion) (-) Outcomes observed Above-avg. discussion discipline
  • 17. Research Design: AI/ML Natural Language Processing: Using Cornell’s Convokit Parsing language snippets (pre-processi ng and feature abstraction) Ingesting conversa-ti on transcripts Cluster analysis/m atching to four discussion disciplines Testing on “virgin” transcripts, generate conversation assessment utility
  • 18. Research Design: AI/ML Natural Language Processing: Using Cornell’s Convokit 2. Separate common combination of words that have direction (e.g., before-after, parent-child) 3. Collect those directed word combinations that are similar 4. Cluster those motifs together as rhetorical intentions (questions, answers, provocations) 5. Identify PromptTypes ’ Clusters that most correspond to the four discussion disciplines. 6. Validate on virgin transcripts and prepare for statistical analysis 1. Ingest text from transcripts (raw training data) Clean text up “Corpus” compiled. “Stop words” removed. “TextClea ner” applied “TextToArc produces ArcTypes,” which are like vectors - directional relationships between words “PhrasingMotifs” are frequently- occurring sets of dependency- parsed arcs Use analyses, 1. graphs 2. rankings Propttypes closest to the middle (centroid) for that cluster. Doing stepwise, e.g., first assign Integrity. “PromptTypes” are vector representation based on how they are responded to -- as well as types of rhetorical intentions TF*IDF and SVD Parsing language snippets (pre-processing and feature abstraction) Ingesting text Analysis/Matching to discussion disciplines Explanation ConvoKit Transformation
  • 19. Research Design: TF*IDF Vectorizer Matrix: From Phrasing motifs to Prompt Types Phrasing Motif 1 Phrasing Motif 2 Phrasing Motif 3 ... Phrasing Motif Z Utteranc e 1 1 0 1 ... 3 Utteranc e 2 0 2 1 ... 0 Utteranc e N 1 5 0 ... 7 Totals for each Phrasing Motif, for each utterance, is then fed into SVD (Single Value Decomposition) Matrix https://scikit-learn.org/stable/modules/gener ated/sklearn.decomposition.TruncatedSVD.h tml Overview: https://www.onely.com/blog/what-is-tf-idf/ SciKit-Learn Approach: https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text .TfidfVectorizer.html For a Phasing Motif t in Utterance d, the weight Wt,d of term t in document d is given by: Wt,d = TFt,d log (N/DFt) Where: ● TFt,d is the number of occurrences of t in Utterance d. ● DFt is the number of Utterances containing the term t. ● N is the total number of utterances in the corpus. For SEO one would want a LOW TF*IDF. (Phrasing Motif is rare). But for us, we would want a HIGH TF*IDF (Phrasing Motif is not rare). This is the frequency that this phrasing motif occurs in the utterance (row). The column Total X is the total number of the phrasing Motif in the CorpuS, with N utterances. Total 1 Total 2 Total 3 Total ... Total Z
  • 20. “TextToArc produces ArcTypes,” which are like vectors - directional relationships between words in a sentence Research Design: Using Convokit 2. Separate common combination of words that have direction (e.g., before-after, parent-child) 3. Collect those directed word combinations that are similar 3a: Politeness strategies 4. Cluster those motifs together as rhetorical intentions (questions, answers, provocations) 5. Identify PromptTypes’ Clusters that most correspond to the four discussion disciplines. 6. Validate on virgin transcripts and prepare for statistical analysis 1. Ingest text from transcripts (raw training data) Clean text up. “Corpus” compiled. “Stop words” removed. “TextCleaner” applied “PhrasingMotifs” are frequently- occurring sets of dependency- parsed arcs Use analyses, 1. graphs 2. rankings of prompttypes closest to the middle (centroid) for that cluster. May do stepwise, to first assign Integrity. “PromptTypes” are vector representation based on how they are responded to -- as well as types of rhetorical intentions (clusters 0-7) Parsing language snippets (pre-processing and feature abstraction) Ingesting text Analysis/Matching to discussion disciplines Explanation ConvoKit Transformation 'There is a guy who whips through there in a Boston whaler. I’m pretty sure he cut up my line once.' ['a_* boston_* guy_* guy_a guy_whips in_* in_whaler is_* is_guy is_there there>* there_* through_* through_there whaler_* whaler_a whaler_boston whips_* whips_in whips_through whips_who who_*', "'m_* 'm_i 'm_sure cut_* cut_he cut_line cut_once cut_up he_* i>* i_* line_* line_my my_* once_* pretty_* sure_* sure_cut sure_pretty up_*"] ['', "'ll_* have_*__have_i__i>*__i_* i>*__i_*", 'my_* the_*', "'ll_* in_* the_*", 'a_* have_*__have_i__i>*__i_* i>*__i_*'] [0.29997174 0.95394809] (PromptTypes Coordinates) Example
  • 21. Prompt Designation Response Designation 1 Motifs as input field, utterances may be represented as both prompt and response. Pretty noisy, some trends: courtesy mapping close to prompt centroid 4.
  • 22. Research Design: Influences on conversation outcomes (bold are observable in our data as explanatory variables) 1. Conversation moves (discussion disciplines and anti-disciplines) 2. Conversation moves’ sequence (e.g., time and type of climax) 3. Gender (pertains to social sensitivity, and could be captured by the “Courtesy” moves. Could also be related to bias) (Woolley et al, 2010) 4. Region/Geography of lease (relates to wealth, development, gentrification, environmental quality 5. Type of lease (e.g., duration up to 20 years, species, equipment, relates to property rights) 6. Type of aquaculture tech (e.g., oyster, mussel rings) 7. Relationship history/costly signals (Grattan et al, 2007 on “heritage relationships. May be captured by the Region/Geography variable.) 8. Physical movement (Body language, pitch, cadence) (Pentland, et al 2007) 9. History of the region (number of recent lease applications or wins) (Ostrom, Partelow) 10. History of the conflict (nature of previous interactions across the community, especially public or litigious actions) (ditto) 11. Regulation (governance systems) (ditto) Likely to be available in the conversations and publicly available sources More difficult to acquire with current resources, and more difficult to translate into resources for sustainability networks
  • 23. Research Design: Statistical analysis: What impact do the conversation attributes have on outcomes, and is it statistically significant? Explanatory variables Dependent variable: Outcomes ● X1 Signature (categorical variable determined by clustering: e.g., ○ Sig 1 could be “above average inclusion, above average integrity-Q,” ○ Sig 2 could be “below average inclusion, below average integrity Q, above average translation”) ● X2 Sequence (categorical variable: climax type, such as early, followed by loading) [Could also be part of X1] ● X3 Gender proportion ● X4 Region (proxy for costly signals, envtal qual, gentrification) ● X5 Type of Lease 1. Options generation (innovation) 2. Intent to act (closure) 3. Relationship building (Can be either positive or negative)
  • 24. Research Design: Intervention: Accelerate the learning curve for productive conversation 1. Capacity-Building ● Training in Four Discussion Disciplines (NLP research for targeted impacts) ● Spreading boundary objects, like pocket cards ● Collaborating with existing teams (e.g., Maine Sea Grant, Aquaculture in Shared Waters training, DMR training) 2. Network Weaving ● Designing networks as “cradle for conversation.” ● Incorporate behavioral models, social norming ● Leveraging existing networks (e.g., FocusMaine, Maine Aquaculture Association) ● Propose random controlled trials
  • 25. Research Design: Knowledge Network Effectiveness Framework (read right to left) 25 What are the impacts? 1. Learning / innovation (tangible products) 2. Horizontal Coordination (scale, buying power) 3. Member Support (trusted advice) 4. Translation/ Local Adaptation (sense-making) What behaviors do we see? •People identify with the network out loud •People share contacts, knowledge even before being asked •People speak up, even across hierarchy or political divides What dynamics play out? • “if I contribute routinely, I will, in turn, get value from the network” • “If I make mistakes, I will learn in a community of learners.” • “If members identify with the network, they reciprocate.” • “If leaders role-model vulnerability, members will take appropriate risks.” What levers do we pull? 8 Design Dimensions: Strategic 1.Leaders’ shared theory of change 2.Objectives/Outcomes/ Purpose 3. Expert-Learner balance (psychological safety) 4. Inclusion/Participation Structural 5. Operating model 6. Convening structures & infrastructures 7. Facilitation and social norm development Tactical 8. Measurement, feedback and incentives Increasing leverage KNEF on a page 210202 “Products, negotia-tio ns” “Relation- ships, trust” Source: Pugh & Prusak (2013) “Designing Effective Knowledge Networks,” MIT Sloan Management REview
  • 26. Research Design: Bringing it all together: Conceptual Model Conflict in sustainability interactions Outside facilitation Investment in Conversation Capacity building Depen- dency on outside facilitation + - - - + - + B B Current: “Conflict is masked, conversation skills atrophy”
  • 27. investment in Conversation Capacity Research Design: Bringing it all together: Conceptual Model Conflict in sustainability interactions Outside facilitation Investment in Conversation Capacity building Depen- dency on outside facilitation Conflict in sustainability interactions Desirability of engagement Credibility of conversation model + - - - + - + - - + + R B B Current: “Conflict is masked, conversation skills atrophy” Goal: “Networks and practice support productive conversation”
  • 28. investment in Conversation Capacity Research Design: Bringing it all together: Conceptual Model Conflict in sustainability interactions Outside facilitation Investment in Conversation Capacity building Depen- dency on outside facilitation Conflict in sustainability interactions Desirability of engagement Credibility of conversation model Network convening Empirical evidence of conversation driving impact Data science and network design programs + - - - + - + - - + + + + + + R B B Current: “Conflict is masked, conversation skills atrophy” Goal: “Networks and practice support productive conversation”
  • 29. Out beyond ideas of wrongdoing and rightdoing, there is a field. I’ll meet you there. When the soul lies down in that grass, the world is too full to talk about. Ideas, language, even the phrase ‘each other’ doesn’t make any sense. Jalal ad-Din Mohammad Rumi 13th Century Persian scholar, theologian, poet Words of hope...
  • 30. Recognitions Thank you to my Doctoral Committee, research team, and mentors! ● Teresa Johnson, PhD., UMaine, Doctoral Advisor ● Nancy Dixon, PhD., Columbia University, committee member ● Mohamad Musavi, PhD., UMaine, committee member ● Linda Silka, PhD. UMaine, committee member ● Erez Yoeli, PhD., MIT, committee member ● Emily Currie ‘22, research team ● Peter van Walsum, PhD., mentor ● David Hart, PhD., mentor ● Keith Evans, PhD., mentor ● Larry Prusak, Columbia University, mentor ● Christine Beitl and the whole ANT 560 Research Methods Class
  • 32. 0. Sustainability conversation 1. Manual coding 2. AI/ML Algorithm development 3. Signature generation 5. Designs for Capacity building & Network Aquaculture stakeholder in conversation Research team performing linguistic analysis Research team performing statistical analysis Supplemental data (e.g., BERT libraries) Programmer, using NLP libraries 0a. Lease scoping or hearing 0b. Record. 0c. Transcribe Parse into utterances 1a. Classify for 4DDs, gender, sequence, outcome. 1b. Perform basic statistics, pivot tables to find patterns 1c. Generate infographics. 2a. Parse new conversation and supplement. Gen. training data (HITL) 2b. Gen. and test algorithms for 4DDs, gender, impacts 2c. Acquire more conversation data as 4DD examples 3a. Do statistical analysis (e.g., regress composition of moves, sequence of moves, gender, etc. on outcome.) draft signatures 4. AI/ML Algorithm Validation, productization 4d. Revise algorithm to detect 4DDs, gender, sequence, and, signature on new data 4e. Create new libraries wishlist 4b. Record. 4c. Transcribe Parse into utterances 5a. Draft, improvements to networks to include skillful conversation 5b. Focus groups 1c. Interviews to determine outcomes 6. Launch 6a. Develop training, toolkits 6c S/H Training 4a. Lease scoping or hearing Research Process ECE 598 Research Process and Roles Spring-Summer 2021 Fall, 2021 -Spring 2022 Fall 2020-Spring 2021
  • 33. Partial Bibliography (1 of 7) ● Anderies, & Janssen. (2016). Sustaining the Commons (2nd ed., Vol. 2). Creative Commons. ● Buchanan, M., & Pentland, A. (2007). The Science of Subtle Signals. Strategy & Business. ● Cash, D. W., Borck, J. C., & Patt, A. G. (2006). Countering the loading-dock approach to linking science and decision making: Comparative analysis of El Niño/Southern Oscillation (ENSO) forecasting systems. Science Technology and Human Values, 31(4), 465–494. https://doi.org/10.1177/0162243906287547 ● Caviglia, F., Dalsgaard, C., Delfino, M., & Pedersen, A. Y. (2017). Dialogic literacy: Contexts, competences and dispositions. L1 Educational Studies in Language and Literature, 17(2017), 1–38. https://doi.org/10.17239/L1ESLL-2017.17.01.05 ● Chang, J. P., Chiam, C., Fu, L., Wang, A. Z., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020). ConvoKit: A Toolkit for the Analysis of Conversations. ArXiv. http://arxiv.org/abs/2005.04246 ● Cinner, J. (2018). How behavioral science can help conservation. In Science (Vol. 362, Issue 6417, pp. 889–890). American Association for the Advancement of Science. https://doi.org/10.1126/science.aau6028 ● Clark, W. C., & Harley, A. G. (2020). Sustainability Science: Toward a Synthesis. Annual Review of Environment and Resources, 45(1). https://doi.org/10.1146/annurev-environ-012420-043621 ● Clarke, H., & Barton, W. (2019). Putting Dialogue to Work in the Virginia Department of Corrections. In The World Needs Dialogue! (pp. 1–11).
  • 34. Partial Bibliography (2 of 7) ● Deloitte. (2020). Open Source Compass: A new way to glean insights on the trajectory of open source development for emerging technologies. Open Source Compass. https://opensourcecompass.io/ ● Dietz, T., Dolšak, N., Ostrom, E., & Stern, P. C. (2002). The Drama of the Commons. In National Academies Press. ● Dixon, N. (2018). Speaking Up 101. Ivey Business Journal, September/October 2018. https://iveybusinessjournal.com/speaking-up-101/ ● Dixon, N. M. (2021). Conversation Matters Blog: Posts on Conversation. Conversaion Matters. https://www.nancydixonblog.com/conversation/ ● Druschke, C. G., & McGreavy, B. (2016). Why rhetoric matters for ecology. Frontiers in Ecology and the Environment, 14(1), 46–52. https://doi.org/10.1002/16-0113.1 ● Edmondson, A. C., & Lei, Z. (2014). Psychological Safety: The History, Renaissance, and Future of an Interpersonal Construct. Annual Review of Organizational Psychology and Organizational Behavior, 1, 23–43. https://doi.org/10.1146/annurev-orgpsych-031413-091305 ● Galinsky, A. D., Todd, A. R., Homan, A. C., Phillips, K. W., Apfelbaum, E. P., Sasaki, S. J., Richeson, J. A., Olayon, J. B., & Maddux, W. W. (2015). Maximizing the Gains and Minimizing the Pains of Diversity: A Policy Perspective. Perspectives on Psychological Science. https://doi.org/10.1177/1745691615598513
  • 35. Partial Bibliography (3 of 7) ● Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2). http://iris.cs.aau.dk/tl_files/volumes/Volume 29/ ● Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019. ● Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning Research With Societal Needs. Issues in Science and Technology, 23(3). https://issues.org/aligning-research-with-societal-needs/ ● Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate coordination. 1–15. ● Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people think and not just what they do. Proceedings of the National Academy of Sciences of the United States of America, 112(6), 1727–1732. https://doi.org/10.1073/pnas.1417904112 ● Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press. https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999 ● Isaacs, W. (2016). Trim-Tab Dialogues : Transformative Vision and Action in South Asia. In The World Needs Dialogue! (Issue February, pp. 1–19).
  • 36. Partial Bibliography (4 of 7) ● Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2). http://iris.cs.aau.dk/tl_files/volumes/Volume 29/ ● Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019. ● Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning Research With Societal Needs. Issues in Science and Technology, 23(3). https://issues.org/aligning-research-with-societal-needs/ ● Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate coordination. 1–15. ● Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people think and not just what they do. Proceedings of the National Academy of Sciences of the United States of America, 112(6), 1727–1732. https://doi.org/10.1073/pnas.1417904112 ● Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press. https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999 ● Isaacs, W. (2016). Trim-Tab Dialogues : Transformative Vision and Action in South Asia. In The World Needs Dialogue! (Issue February, pp. 1–19).
  • 37. Partial Bibliography (5 of 7) ● Johnson, T., Beard, K., Brady, D., Byron, C., Cleaver, C., Duffy, K., Keeney, N., Kimble, M., Miller, M., Moeykens, S., Teisl, M., van Walsum, G., & Yuan, J. (2019). A Social-Ecological System Framework for Marine Aquaculture Research. Sustainability, 11(9), 2522. https://doi.org/10.3390/su11092522 ● Johnson, T. R. (2020). Reflecting on Maine ’ s Changing Productive Coastal Region. Maine Policy Review, 29(2), 91–97. ● Johnson, T. R., & Hanes, S. P. (2017). Marine Aquaculture in Restructuring Regions: Understanding the Key Coastal Sustainability Transition. Quarterly Magazine of the Regional Studies Association, 308(Autumn), 13–15. ● McCardle-Keurentjes, M., & Rouwette, E. A. J. A. (2018). Asking Questions: A Sine Qua Non of Facilitation in Decision Support? Group Decision and Negotiation, 27(5), 757–788. https://doi.org/10.1007/s10726-018-9573-y ● McGinnis, M. D., & Ostrom, E. (2014). Social-ecological system framework: initial changes and continuing challenges. Ecology and Society, 19(2), art30. https://doi.org/10.5751/ES-06387-190230 ● Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. In Science (Vol. 325, Issue 5939, pp. 419–422). https://doi.org/10.1126/science.1172133 ● Ostrom, E., Bravo, G., Janssen, M., Levin, S., Myint, T., Pahl-Wostl, C., & Walker, J. (2008). Workshop in Political Theory and Policy Analysis BUILDING TRUST TO SOLVE COMMONS DILEMMAS: TAKING SMALL STEPS TO TEST AN EVOLVING THEORY OF COLLECTIVE ACTION. www.indiana.edu/~workshopW08-239/22/08
  • 38. Partial Bibliography (6 of 7) ● Page, S. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools and Societies - New Edition. Princeton Press. https://www.amazon.com/Difference-Diversity-Creates-Schools-Societies/dp/0691138540 ● Page, S. E. (2017). The Diversity Bonus: How Great Teams Pay Off in the Knowledge Economy. Princeton Press. https://www.amazon.com/Diversity-Bonus-Knowledge-Compelling-Interests-ebook/dp/B07JDTSZVR/?pldnSite=1 ● Partelow, S. (2016). Coevolving Ostrom’s social–ecological systems (SES) framework and sustainability science: four key co-benefits. Sustainability Science, 11(3), 399–410. https://doi.org/10.1007/s11625-015-0351-3 ● Plamondon, K. M., Bottorff, J. L., & Cole, D. C. (2015). Analyzing Data Generated Through Deliberative Dialogue. Qualitative Health Research, 25(11), 1529–1539. https://doi.org/10.1177/1049732315581603 ● Pugh, K. (2016). Four Discussion Disciplines to Drive Effective Online Collaboration. Columbia SPS. https://sps.columbia.edu/news/four-discussion-disciplines-drive-effective-online-collaboration ● Pugh, K. (2019). Conversational AI and AI for Conversation: Our Role as KM’ers? ● Pugh, K., & Prusak, L. (2013). Designing Effective Knowledge Networks. MIT Sloan Management Review. ● Rand, D. G., Yoeli, E., & Hoffman, M. (2014). Harnessing Reciprocity to Promote Cooperation and the Provisioning of Public Goods. Policy Insights from the Behavioral and Brain Sciences, 1(1), 263–269. https://doi.org/10.1177/2372732214548426 ● Schein, E. H. (1978). The Role of the Consultant: Content Expert or Process Facilitator? The Personnel and Guidance Journal, 56(6). https://doi.org/10.1002/j.2164-4918.1978.tb04644.x
  • 39. Partial Bibliography (7 of 7) ● Schein, E. H. (1993). On dialogue, culture, and organizational learning. Organizational Dynamics, 22(2), 40–51. https://doi.org/10.1016/0090-2616(93)90052-3 ● See, A., Roller, S., Kiela, D., & Weston, J. (2019). What makes a good conversation? How controllable attributes affect human judgments. Facebook Research and Stanford University. https://parl.ai/projects/ ● Silka, L. (2013). “Silos” in the Democratization of Science. International Journal of Deliberative Mechanisms in Science, 2(1), 1. https://doi.org/10.4471/demesci.2013.06 ● Silka, L., Glover, R., Hutchins, K., Lindenfeld, L., Blackstone, A., Elliott, C., Ladenheim, M., & Sullivan, C. (2013). Moving Beyond the Single Discipline : Building a Scholarship of Engagement that Permeates Higher Education. Tamara - Journal for Critical Organization Inquiry, 11(4), 41–52. ● Silka, L., McGreavy, B., & Hart, D. (2019). Breaking boundaries Chapter: Health, the Environment, and Sustainability: Emergent Communication Lessons Across Highly Diverse Public Participation Activities. In State University of New York Press, Albany. ● Skifstad, S., & Pugh, K. (2014). Smarter Innovation: Beyond Netiquette (Chapter 8). In Smarter Innovation. Ark Group. ● Stasser, G., & Titus, W. (2003). Hidden Profiles: A Brief History. Psychological Inquiry, 14(3–4), 304–313. https://doi.org/10.1080/1047840x.2003.9682897 ● Wilkinson, M. (2012). The Secrets of Facilitation: The SMART Guide to Getting Results with Groups. Jossey-Bass/Wiley. https://www.amazon.com/Secrets-Facilitation-Getting-Results-Groups-ebook/dp/B00DBOZPI4 ● Willison, J. B., Rossman, S., Bieler, S., & Innes, C. (2017). Creating and Measuring a Healing Environment in the Virginia Department of Corrections. In The World Needs Dialogue! https://www.urban.org/sites/default/files/publication/91411/nm_wave_2_brief_createmeasure_hei.pdf ● Woolley, A., Malone, T. W., & Chabris, C. F. (2015). GRAY MATTER. New York Times. https://www.nytimes.com/2015/01/18/opinion/sunday/why-some-teams-are-smarter-than-others.html ● Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., & Malone, T. (2010). Evidence for a Collective Intelligence Factor in the Performance of Human Groups. Science, 330(6004), 683–686. https://doi.org/10.1126/science.1190483