Argumentation 101 for Learning Analytics PhDs!
•
1 j'aime•1,248 vues
An introduction to argumentation for UTS:CIC PhD students (with some Learning Analytics examples, but potentially of wider interest to students/researchers)
Recommandé
Recommandé
Contenu connexe
Similaire à Argumentation 101 for Learning Analytics PhDs!
Similaire à Argumentation 101 for Learning Analytics PhDs! (20)
Plus de Simon Buckingham Shum
Plus de Simon Buckingham Shum (20)
Dernier
Dernier (20)
Argumentation 101 for Learning Analytics PhDs!
- 1. Argumentation 101 for Learning Analytics PhDs! CIC PhD training session (13 Oct. 2020) Simon Buckingham Shum University of Technology Sydney
- 2. https://youtu.be/ohDB5gbtaEQ Welcome to the Argument Clinic!
- 3. Learning Analytics (LA) sits at the confluence of many contributing disciplines, which brings the risk of hidden assumptions inherited from those fields. Here, we consider a hidden assumption derived from computer science, namely, that improving computational accuracy in classification is always a worthy goal. We demonstrate that this assumption is unlikely to hold in some important educational contexts, and argue that embracing computational “imperfection” can improve outcomes for those scenarios. Specifically, we show that learner-facing approaches aimed at “learning how to learn” require more holistic validation strategies. We consider what information must be provided in order to reasonably evaluate algorithmic tools in LA, to facilitate transparency and realistic performance comparisons. https://dl.acm.org/doi/10.1145/3170358.3170413 Quick warm up: Spot the claimed knowledge gap Spot the claimed contribution
- 4. Quick warm up: Spot the claimed knowledge gap Spot the claimed contribution
- 5. Quick warm up: Spot the claimed knowledge gap Spot the claimed contribution
- 6. UTS:CIC Doctoral Training 6 From the discourse modelling underpinning AcaWriter, you now recognise the common ‘moves’ we make to signal our stance in academic writing (including but extending beyond argumentation) But this doesn’t explain the underlying building blocks for arguments — only how they can be expressed There are different models for understanding argument structure which we’ll glimpse today…
- 8. UTS:CIC Doctoral Training 8 Arguments based on domain-specific facts and methods These are the typical criticisms that we get from reviewers… A Pearson ranked correlation coefficient would be a better test… The inter-rater reliability was too low… Smith et al 1990 has been mis-quoted… The selection of students is not representative… The task was so artificial that any practical implications are tenuous… Bloggs et al specifically state that their survey should not be used with children… The lit review has omitted a significant body of work on… Just because F values matter in IR, doesn’t make this valid for LA…
- 10. UTS:CIC Doctoral Training 10 Issue-Based Information System (IBIS) Download from the Compendium Institute & follow the QuickStart Guide (Windows version recommended; Java on Mac tricky to configure)
- 11. UTS:CIC Doctoral Training 11 Mapping IBIS on the web bCisive is a polished product (free to trial mini-maps) https://www.bcisiveonline.com
- 12. UTS:CIC Doctoral Training 12 Kirsty Kitto, Simon Buckingham Shum, and Andrew Gibson. (2018). Embracing Imperfection in Learning Analytics. In Proceedings LAK18: International Conference on Learning Analytics and Knowledge, March 5–9, 2018, Sydney, NSW, Australia, pp.451-460. (ACM, New York, NY, USA). https://doi.org/10.1145/3170358.3170413 Issue Mapping part of the Embracing Imperfection paper
- 13. UTS:CIC Doctoral Training 13
- 14. UTS:CIC Doctoral Training 14 Since these are typically hierarchies, you can map using an outliner, no need to use network maps
- 15. UTS:CIC Doctoral Training 15 Since these are typically hierarchies, you can map using an outliner, no need to use network maps Using the CASE Word macro (Contention, Argument, Source, Evidence) http://www.vangeldermonk.com/case.html to outline map an argument in http://simon.buckinghamshum.net/2020/0 7/should-predictive-models-of-student- outcome-be-colour-blind
- 16. UTS:CIC Doctoral Training 16 Issue-Based Information System (IBIS) IBIS can be helpful for forcing yourself to clearly articulate good questions, identify potential answers, and their pros and cons Issue Mapping an article you’re reading or writing can clarify the ideas, and helpful ways to structure the argument There’s a skill and discipline to good IBIS mapping which you can get into if you get interested If you get fluent, you can do it in meetings: Dialogue Mapping https://cic.uts.edu.au/tools/knowledge-cartography https://cic.uts.edu.au/events/paul-culmsee-mapping-workshops
- 17. UTS:CIC Doctoral Training 17 A different flavour of argument map From the British National Front (far right party) “on every measure of intellectual ability and educational attainment Blacks perform significantly worse, on average, than Whites. In the case of average IQ, for example, the average Negro figure is only 85% of the White average.” “Readers can consult Race by Dr. John R. Baker, former Reader in Cytology at Oxford University, published by the Oxford University Press, or The Testing of Negro Intelligence, an exhaustive review of hundreds of studies demonstrating racial differences in intellectual ability by Dr. Audrey M. Shuey, and of course there is The Bell Curve by Herrnstein and Murray.”
- 18. Buckingham Shum, S. (2007). Undermining Mimetic Contagion on the Net: Argumentation Tools as Critical Voices. COV&R’07: Colloquium on Violence & Religion, 4-8 July 2007, Soesterberg, NL www.girard.nl. https://www.slideshare.net/sbs/undermining-mimetic- contagion-on-the-net-argumentation-tools-as-critical-voices
- 19. UTS:CIC Doctoral Training 19 Going deeper: the hidden structure in an IBIS argument There are in fact many hidden premises in everyday arguments, which can be questioned…
- 20. UTS:CIC Doctoral Training 20 Domain-independent Argumentation Schemes These arise in everyday debates, and in many academic fields, including LA When you learn to recognise their patterns, you can construct them – and critique them – more rigorously, e.g. Argument from expert opinion: • “X is true (Source)” (typical form in academic writing) Argument by analogy • “X is true in this other similar context, so is plausibly true here”
- 21. UTS:CIC Doctoral Training 21 Domain-independent Argumentation Schemes Philosophers of argument have documented many Argumentation Schemes encountered in everyday reasoning Douglas Walton is an authority: get this book! See the Rationale argument mapping tool: https://www.rationaleonline.com Compendium supplies Walton’s schemes (and more) as visual templates
- 22. 22 Download from the Compendium Institute & follow the QuickStart Guide (Windows version recommended; Java on Mac tricky to configure)
- 24. UTS:CIC Doctoral Training 24 Argument from Analogy — in slow motion “I reckon I’ll like this movie. Ben thought it was hilarious.”
- 25. UTS:CIC Doctoral Training 25 Argument from Analogy — in slow motion “I reckon I’ll like this movie. Ben thought it was hilarious.”
- 26. UTS:CIC Doctoral Training 26 Argument from Analogy — Argumentation Scheme https://www.rationaleonline.com/map/tdt8vp/argument-from-analogy
- 27. UTS:CIC Doctoral Training 27 Argument from Analogy — false analogy “Hitler was a genius. He had a moustache. And Einstein had a moustache. I rest my case!”
- 28. UTS:CIC Doctoral Training 28 Argument from Analogy — in slow motion “Hitler was a genius. He had a moustache. And Einstein had a moustache. I rest my case!”
- 29. UTS:CIC Doctoral Training 29 Argument from Analogy — in slow motion “Hitler was a genius. He had a moustache. And Einstein had a moustache. I rest my case!”
- 30. UTS:CIC Doctoral Training 30 Argument from Analogy — in slow motion
- 31. Making an Argument by Analogy in Learning Analytics
- 32. UTS:CIC Doctoral Training 32 Argument by Analogy — LAK18 paper Kirsty Kitto, Simon Buckingham Shum, and Andrew Gibson. (2018). Embracing Imperfection in Learning Analytics. In Proceedings LAK18: International Conference on Learning Analytics and Knowledge, March 5–9, 2018, Sydney, NSW, Australia, pp.451-460. (ACM, New York, NY, USA). https://doi.org/10.1145/3170358.3170413
- 33. UTS:CIC Doctoral Training 33 Argument by Analogy — Arg. Scheme template using IBIS to map Critical Questions Buckingham Shum, Simon and Okada, Alexandra (2008). Knowledge Cartography for Controversies: The Iraq Debate. In: Okada, Alexandra; Buckingham Shum, Simon J. and Sherborne, Tony eds. Knowledge Cartography: Software Tools and Mapping Techniques. Advanced Information and Knowledge Processing, Springer, pp. 249–265. http://oro.open.ac.uk/11768/1/chapter12.pdf
- 34. UTS:CIC Doctoral Training 34 Interrogating the claimed IR/LA Argument by Analogy
- 35. Argument by Expert Opinion
- 36. UTS:CIC Doctoral Training 36 Argument from Expert Opinion — in slow motion “As Sarah Brown (1991) has argued persuasively, attacking the Soviet Union is what really lost the war for Germany.”
- 37. UTS:CIC Doctoral Training 37 Argument from Expert Opinion — in slow motion “As Sarah Brown (1991) has argued persuasively, attacking the Soviet Union is what really lost the war for Germany.”
- 38. UTS:CIC Doctoral Training 38 Argument from Expert Opinion — in slow motion “As Sarah Brown (1991) has argued persuasively, attacking the Soviet Union is what really lost the war for Germany.”
- 39. UTS:CIC Doctoral Training 39 Argument from Expert Opinion — in slow motion “As Sarah Brown (1991) has argued persuasively, attacking the Soviet Union is what really lost the war for Germany.”
- 40. UTS:CIC Doctoral Training 40 Argument from Expert Opinion — in slow motion “As Sarah Brown (1991) has argued persuasively, attacking the Soviet Union is what really lost the war for Germany.”
- 41. UTS:CIC Doctoral Training 41 Argument from Expert Opinion — Arg. Scheme https://www.rationaleonline.com/map/r4g4bh/argument-from-expert-opinion
- 42. UTS:CIC Doctoral Training 42 Argument from Expert Opinion — ways to attack it Did they actually state that? But other experts disagree… No, in fact their expertise does not cover the current topic There are doubts about their integrity…
- 43. UTS:CIC Doctoral Training 43 Argument from Expert Opinion — Critical Questions template using IBIS Buckingham Shum, Simon and Okada, Alexandra (2008). Knowledge Cartography for Controversies: The Iraq Debate. In: Okada, Alexandra; Buckingham Shum, Simon J. and Sherborne, Tony eds. Knowledge Cartography: software tools and mapping techniques. Advanced Information and Knolwedge Processing, 1. Springer, pp. 249–265. http://oro.open.ac.uk/11768/1/chapter12.pdf
- 44. SUMMARY Mapping your arguments visually can help clarify your thinking You can learn to recognise different kinds of arguments, and how they can be critiqued If you want to do more of this, then we can have a hands-on session Discussion!