Preparing humane ML experts for a better future. Experiments with design and engineering students

Martina Sciannamè

doi:10.29073/jer.v2i1.21

Authors

Martina Sciannamè Politecnico di Milano https://orcid.org/0000-0001-5332-2589

DOI:

https://doi.org/10.29073/jer.v2i1.21

Keywords:

Humanity-Centered Design, ML Design Education, ML-Savvy, RAI Design Skills, Value Sensitivity

Abstract

Recognizing the rising demand for well-trained professionals in the responsible AI (RAI) landscape, the study explores which skills might characterize humane ML experts. A literature review outlines human centricity, ML-savvy, and value sensitivity as pivotal qualities for responsible practices, materializing an overarching multidisciplinary approach to the design of meaningful ML-infused solutions. For a preliminary and qualitative investigation, four experimental workshops were conducted in different European universities, targeting design and computer engineering students across different educational levels. They were intended to (i) translate the presented skills into educational experiences; (Q2) assess the effectiveness of the experimentations to foster these competences; and (Q3) evaluate their suitability and meaningfulness. Adapting the theoretical assumptions to the target audiences’ backgrounds, positive results emerged. Both design and engineering students exhibited receptiveness and appreciation for the contents, methods, and tools presented in the workshops, emphasizing the transversal and essential nature of the proposed skills in diverse educational contexts. Despite the limits of the experimentations, the research argues that the depicted skills might orient designerly and technical ML experts toward meaningful outcomes, especially if they build effective collaborations leveraging their complementary strengths. Hopefully the contribution offers insights to advance the discourse about future professional figures in RAI.

Downloads

Download data is not yet available.

References

Algorithmic Watch. (2020, April). AI Ethics Guidelines Global Inventory. https://inventory.algorithmwatch.org/

Antonelli, P. (2018, August 2). AI Is Design’s Latest Material. Google Design Library. https://design.google/library/ai-designs-latest-material/

Archer, B. (1995). The Nature of Research. Co-Design: Interdisciplinary Journal of Design, 6–13.

Auernhammer, J., & Ford, C. (2022). What is design? The semantic core and periphery of design definition. In G. Goldschmidt & E. Tarazi (Eds.), Expanding the frontiers of design: A blessing or a curse? (pp. 24–37). DesignTech, Faculty of Architecture & Town Planning TechnionIsrael Institute of Technology.

Bresler, L. (2021). Ethnography, Phenotllenology And Action Research In Music Education. Visions of Research in Music Education, 16(17). https://opencommons.uconn.edu/cgi/viewcontent.cgi?article=1808&context=vrme

Cutler, A., Pribić, M., & Humphrey, L. (n.d.). Everyday Ethics for Artificial Intelligence. IBM. ibm.biz/everydayethics

Davis, M. (n.d.). Introduction to Design Futures. AIGA | the Professional Association for Design. https://www.aiga.org/aiga-design-futures/introduction-to-design-futures/

De Bono, E. (2016). Six thinking hats (Revised and updated). Penguin Life, an imprint of Penguin books.

Dove, G., & Fayard, A.-L. (2020). Monsters, Metaphors, and Machine Learning. https://www.semanticscholar.org/paper/Monsters%2C-Metaphors%2C-and-Machine-Learning-Dove/4b1ea05c83d44b984db8b7d5764ef306d602dc35

Dove, G., Halskov, K., Forlizzi, J., & Zimmerman, J. (2017). UX Design Innovation: Challenges for Working with Machine Learning as a Design Material. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 278–288. https://doi.org/10.1145/3025453.3025739

European Commission. (2018). Artificial Intelligence for Europe.

Frascara, J. (2020). Design Education, Training, and the Broad Picture: Eight Experts Respond to a Few Questions. She Ji: The Journal of Design, Economics, and Innovation, 6(1), 106–117. https://doi.org/10.1016/j.sheji.2019.12.003

Friedman, B., & Hendry, D. (2019). Value sensitive design: Shaping technology with moral imagination. The MIT Press.

Friedman, K., Lou, Y., Norman, D., Stappers, P. J., Voûte, E., & Whitney, P. (2014, December 6). Why DesignX? Designers and Complex Systems. Core77. https://www.core77.com/posts/27986/Why-DesignX-Designers-and-Complex-Systems

Friedman, K., Lou, Y., Norman, D., Stappers, P. J., Voûte, E., & Whitney, P. (2019, August 1). DesignX: A Future Path for Design. Jnd.Org. https://jnd.org/designx_a_future_path_for_design/

Fruchter, N., & Liccardi, I. (2018). Consumer Attitudes Towards Privacy and Security in Home Assistants. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3170427.3188448

Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). Harcourt Brace Jovanovich College Publ.

High-Level Expert Group on Artificial Intelligence. (2019a). A definition of AI: Main capabilities and scientific disciplines. European Commission. https://ec.europa.eu/digital-single-market/en/news/definition-artificial-intelligence-main-capabilities-and-scientific-disciplines

High-Level Expert Group on Artificial Intelligence. (2019b). Ethics Guidelines for Trustworthy AI. European Commission. https://ec.europa.eu/futurium/en/ai-alliance-consultation/guidelines

Johnson, D. G., & Verdicchio, M. (2017). Reframing AI Discourse. Minds and Machines. https://doi.org/10.1007/s11023-017-9417-6

Kirschener, P., & Norman, D. A. (2021). The Teaching and Learning of Design. Future of Design Education. https://assets.website-files.com/6010c2ec764764887cfefee7/60515ff38234e90fac4c64cb_Kirschner%20and%20Norman.%20Teaching%20and%20Learning%20of%20Design%2021.01.21.pdf

Koskinen, I., Zimmerman, J., Binder, T., Redström, J., & Wensveen, S. (2011). Design Research Through Practice: From the Lab, Field, and Showroom. Morgan Kaufmann.

Kulesz, O. (2018). Culture, platforms and machines: The impact of Artificial Intelligence on the diversity of cultural expressions (DCE/18/12.IGC/INF.4) [Information Document]. UNESCO. https://en.unesco.org/creativity/sites/creativity/files/12igc_inf4_en.pdf

Latour, B. (1996). On actor-network theory: A few clarifications. Soziale Welt, 47(4), 369–381.

Law, J. (2015). STS as Method. http://heterogeneities.net/publications/Law2015STSAsMethod.pdf

Levinson, P. (1977). Toy, Mirror, and Art: The Metamorphosis of Technological Culture. Learning Cyberspace, 34(2), 151–167.

Meyer, M. (2010). The Rise of the Knowledge Broker. Science Communication, 32(1), 118–127. https://doi.org/10.1177/1075547009359797

Meyer, M. W., & Norman, D. (2020). Changing Design Education for the 21st Century. She Ji: The Journal of Design, Economics, and Innovation, 6(1), 13–49. https://doi.org/10.1016/j.sheji.2019.12.002

Norman, D. (2023). Humanity-Centered versus Human-Centered Design. In Design for a Better World: How to create a meaningful, sustainable, and humanity-centered future. MIT Press. https://jnd.org/humanity-centered-versus-human-centered-design/

Rakova, B., Yang, J., Cramer, H., & Chowdhury, R. (2021). Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for Shifting Organizational Practices. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW1), 7:1-7:23. https://doi.org/10.1145/3449081

Rismani, S., & Moon, Aj. (2023). What does it mean to be a responsible AI practitioner: An ontology of roles and skills. Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, 584–595. https://doi.org/10.1145/3600211.3604702

Robson, C., & McCartan, K. (2015). Real World Research. A Resource for Users of Social Research Methods in Applied Settings (4th ed.). Wiley Blackwell. https://www.wiley.com/en-ie/Real+World+Research%2C+4th+Edition-p-9781118745236

Russell, S., & Norvig, P. (2020). Artificial Intelligence: A Modern Approach (4th ed.). Pearson.

Sancassani, S., Brambilla, F., Casiraghi, D., & Marenghi, P. (2019). Progettare l’innovazione didattica. Pearson.

Schön, D. A. (1983). The reflective practitioner: How professionals think in action (Reprinted). Ashgate.

Sciannamè, M. (2023). Machine Learning (for) Design. Towards designerly ways to translate ML for design education [Ph.D. Thesis, Politecnico di Milano, Department of Design]. http://hdl.handle.net/10589/204613

Umbrello, S., & van de Poel, I. (2021). Mapping value sensitive design onto AI for social good principles. AI and Ethics, 1(3), 283–296. https://doi.org/10.1007/s43681-021-00038-3

van de Poel, I. (2020). Embedding Values in Artificial Intelligence (AI) Systems. Minds and Machines, 30(3), 385–409. https://doi.org/10.1007/s11023-020-09537-4

van den Hoven, J. (2013). Value Sensitive Design and Responsible Innovation. In R. Owen, J. Bessant, & M. Heintz (Eds.), Responsible Innovation (pp. 75–83). John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118551424.ch4

Varanasi, R. A., & Goyal, N. (2023). “It is currently hodgepodge”: Examining AI/ML Practitioners’ Challenges during Co-production of Responsible AI Values. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–17. https://doi.org/10.1145/3544548.3580903

von Schomberg, R. (2013). A Vision of Responsible Research and Innovation. In R. Owen, J. Bessant, & M. Heintz (Eds.), Responsible Innovation (pp. 51–74). John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118551424.ch3

Voûte, E., Stappers, P. J., Giaccardi, E., Mooij, S., & van Boeijen, A. (2020). Innovating a Large Design Education Program at a University of Technology. She Ji: The Journal of Design, Economics, and Innovation, 6(1), 50–66. https://doi.org/10.1016/j.sheji.2019.12.001

Wang, Q., Madaio, M., Kane, S., Kapania, S., Terry, M., & Wilcox, L. (2023). Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI Challenges. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–16. https://doi.org/10.1145/3544548.3581278

World Economic Forum Global Future Council on Human & Rights 2016–18. (2018). How to Prevent Discriminatory Outcomes in Machine Learning. https://www3.weforum.org/docs/WEF_40065_White_Paper_How_to_Prevent_Discriminatory_Outcomes_in_Machine_Learning.pdf

Yang, Q. (2020). Profiling Artificial Intelligence as a Material for User Experience Design [Carnegie Mellon University]. http://reports-archive.adm.cs.cmu.edu/anon/hcii/abstracts/20-100.html

Yang, Q., Banovic, N., & Zimmerman, J. (2018). Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems — CHI ‘18, 1–11. https://doi.org/10.1145/3173574.3173704

Yang, Q., Scuito, A., Zimmerman, J., Forlizzi, J., & Steinfeld, A. (2018). Investigating How Experienced UX Designers Effectively Work with Machine Learning. Proceedings of the 2018 Designing Interactive Systems Conference, 585–596. https://doi.org/10.1145/3196709.3196730

Zdanowska, S., & Taylor, A. S. (2022). A study of UX practitioners roles in designing real-world, enterprise ML systems. CHI Conference on Human Factors in Computing Systems, 1–15. https://doi.org/10.1145/3491102.3517607