Insights From “The Machine Stops” to Better Understand Rational Assumptions in Algorithmic Decision Making and Its Implications for Organizations

Academy of Management ReviewVol. 45, No. 1 What Inspires the Academy: Book Reviews and BeyondInsights From “The Machine Stops” to Better Understand Rational Assumptions in Algorithmic Decision Making and Its Implications for OrganizationsDirk Lindebaum, Mikko Vesa and Frank den HondDirk LindebaumGrenoble Ecole de Management/Université Grenoble Alpes ComUE, Mikko VesaHanken School of Economics and Frank den HondHanken School of Economics and VU AmsterdamPublished Online:9 Jan 2020https://doi.org/10.5465/amr.2018.0181AboutSectionsView articleView Full TextPDF/EPUB ToolsDownload CitationsAdd to favoritesTrack Citations ShareShare onFacebookTwitterLinkedInRedditEmail View articleREFERENCESAhrne, G., & Brunsson, N. 2011. Organization outside organizations: The significance of partial organization. Organization, 18: 83–104. Google ScholarAl-Amoudi, I. 2017. Reflexivity in a just morphogenic society: A sociological contribution to political philosophy. In M. S. Archer (Ed.), Morphogenesis and human flourishing: 63–91. Cham: Springer International. Google ScholarAl-Amoudi, I., & Latsis, J. 2019. Anormative black boxes: Artificial intelligence and health policy. In I. Al-AmoudiE. Lazega (Eds.), Post-human institutions and organizations: Confronting the matrix. London: Routledge. Available at https://books.google.co.uk/books?hl=en&lr=&id=m3u9DwAAQBAJ&oi=fnd&pg=PT17&ots=GhuISv_G0W&sig=TaKRUIf73dk1tmy0tFfMzeP6DHk&redir_esc=y#v=onepage&q&f=false. Google ScholarAmabile, T. In press. Guidepost: Creativity, artificial intelligence, and a world of surprises. Academy of Management Discoveries, DOI:10.5465/amd.2019.0075. Google ScholarAndrews, L. 2018. Public administration, public leadership and the construction of public value in the age of the algorithm and “big data.” Public Administration, 97: 296–310. Google ScholarArcher, M. S. 2007. Making our way through the world: Human reflexivity and social mobility. Cambridge: Cambridge University Press. Google ScholarArendt, H. 1958. The origins of totalitarianism. New York: Meredian Books. Google ScholarBarrat, J. 2013. Our final invention: Artificial intelligence and the end of the human era. New York: Thomas Dunne. Google ScholarBaynes, C. 2018. Chinese police to use facial recognition technology to send jaywalkers instant fines by text. Independent: https://www.independent.co.uk/news/world/asia/china-police-facial-recognition-technology-ai-jaywalkers-fines-text-wechat-weibo-cctv-a8279531.html. Google ScholarBerlin, I. 2013. (First published in 1947.) The crooked timber of humanity: Chapters in the history of ideas. Princeton, NJ: Princeton University Press. Google ScholarBoden, M. A. 1978. Human values in a mechanistic universe. In G. Vesey (Ed.), Human values: 135–171. Hassocks, UK: Harvester Press. Google ScholarBostrom, N. 2014. Superintelligence: Paths, dangers, strategies. Oxford: Oxford University Press. Google ScholarBridle, J. 2018. Rise of the machines: Has technology evolved beyond our control? The Guardian, June 18: https://www.theguardian.com/books/2018/jun/15/rise-of-the-machines-has-technology-evolved-beyond-our-control-. Google ScholarBrunsson, K., & Brunsson, N. 2017. Decisions: The complexities of individual and organizational decision-making. Cheltenham, UK: Edward Elgar. Google ScholarCabantous, L., & Gond, J. P. 2011. Rational decision making as performative praxis: Explaining rationality’s éternel retour. Organization Science, 22: 573–586. Google ScholarClegg, S., Kornberger, M., & Pitsis, T. 2008. Managing and organizations. London: Sage. Google ScholarCohen, M. D. 2007. Perspective—Administrative behavior: Laying the foundations for Cyert and March. Organization Science, 18: 503–506. Google ScholarCopeland, R., & Hope, B. 2016. The world’s largest hedge fund is building an algorithmic model from its employees’ brains. Wall Street Journal, December 22: https://www.wsj.com/articles/the-worlds-largest-hedge-fund-is-building-an-algorithmic-model-of-its-founders-brain-1482423694. Google ScholarDe Vynck, G., & Grant, N. 2018. Google wants to answer the questions you haven’t even asked yet. Gadgets 360, September 25: https://gadgets.ndtv.com/internet/features/google-wants-to-answer-the-questions-you-havent-even-asked-yet-1921664. Google ScholarDewey, J. 1916. Democracy and education. New York: Macmillan. Google ScholarDewey, J. 1922. Human nature and conduct. New York: Henry Holt and Company. Google ScholarDewey, J. 1930. Three independent factors in morals. In J. A. Boydston (Ed.), The later works, 1925–1953, vol. 5: 279–288. Carbondale: Southern Illinois University Press. Google ScholarDewey, J. 1939. Theory of valuation. Chicago: University of Chicago Press. Google ScholarThe Economist. 2018. How an algorithm may decide your career. June 21: https://www.economist.com/business/2018/06/21/how-an-algorithm-may-decide-your-career. Google ScholarElster, J. 1994. Nature and scope of rational-choice explanation. In M. MartinL. C. McIntyre (Eds.), Readings in the philosophy of social science: 311–322. Cambridge, MA: MIT Press. Google ScholarFlusser, V. 2000. (First published in 1983.) Für eine Philosophie der Fotografie [Toward a philosophy of photography. London: Reaktion Books. Google ScholarFøllesdal, D. 1994. The status of rationality assumptions in interpretation and in the explanation of action. In M. MartinL. C. McIntyre (Eds.), Readings in the philosophy of social science: 299–310. Cambridge, MA: MIT Press. Google ScholarForster, E. M. 2011. (First published in 1928.) The machine stops. London: Penguin. Google ScholarFriedland, J. In press. Activating moral agency by design: A model for ethical AI development. MIT Sloan Management Review. Google ScholarFromm, E. 2010. (First published in 1981.) On disobedience: Why freedom means saying “no” to power. New York: HarperCollins. Google ScholarFroomkin, A. M. 2016. Introduction. In R. CaloI. Kerr (Eds.), Robot law: x–xxiii. Cheltenham, UK: Edward Elgar. Google ScholarFuchs, C., & Chandler, D. 2019. Introduction. In D. ChandlerC. Fuchs (Eds.), Digital objects, digital subjects: Interdisciplinary perspectives on capitalism, labour and politics in the age of big data: 1–20. London: University of Westminster Press. Google ScholarHabermas, J. 1976. (First published in 1970.) Theory and practice in a scientific civilization. In P. Connerton (Ed.), Critical sociology: 330–347. Harmondsworth, UK: Penguin. Google ScholarHabermas, J. 1984. The theory of communicative action. Volume 1: Reason and the rationalization of society. Boston: Beacon Press. Google ScholarHackman, J. R., & Oldham, G. R. 1980. Work redesign. Reading, MA: Addison-Wesley. Google ScholarHao, K. 2019. Giving algorithms a sense of uncertainty could make them more ethical. MIT Technology Review, January 18: https://www.technologyreview.com/s/612764/giving-algorithms-a-sense-of-uncertainty-could-make-them-more-ethical/. Google ScholarHelbing, D., Frey, B. S., Gigerenzer, G., Hafen, E., Hagner, M., Hofstetter, Y., van den Hoven, J., Zicari, R. V., & Zwitter, A. 2017. Will democracy survive big data and artificial intelligence? Scientific American, February 25: https://www.scientificamerican.com/article/will-democracy-survive-big-data-and-artificial-intelligence/. Google ScholarHendershott, T., Jones, C. M., & Menkveld, A. J. 2011. Does algorithmic trading improve liquidity? Journal of Finance, 66: 1–33. Google ScholarHill, A. 2019. Artificial intelligence creates real strategic dilemmas. Financial Times, May 19: https://www.ft.com/content/8e3d9386-77c6-11e9-bbad-7c18c0ea0201. Google ScholarHutson, M. 2018. Artificial intelligence faces reproducibility crisis. Science, 359: 725–726. Google ScholarJames, W. 1891. The moral philosopher and the moral life. International Journal of Ethics, 1: 330–354. Google ScholarKahn, J. 2019. Learning to love the bot: Managers need to understand A.I. logic before using it as a business tool. Fortune, September 26: https://fortune.com/2019/09/26/ai-business-strategy-management/. Google ScholarKalberg, S. 1980. Max Weber’s types of rationality: Cornerstones for the analysis of rationalization processes in history. American Journal of Sociology, 85: 1145–1179. Google ScholarKellogg, K. C., Valentine, M., & Christin, A. In press. Algorithms at work: The new contested terrain of control. Academy of Management Annals, DOI:10.5465/annals.2018.0174. Google ScholarKjonstad, B., & Willmott, H. 1995. Business ethics: Restrictive or empowering? Journal of Business Ethics, 14: 445–464. Google ScholarKnight, W. 2017. The dark secret at the heart of AI. MIT Technology Review, April 11: https://www.technologyreview.com/s/604087/the-dark-secret-at-the-heart-of-ai/. Google ScholarLeCun, Y., Bengio, Y., & Hinton, G. 2015. Deep learning. Nature, 521: 436–444. Google ScholarLibert, B., Beck, M., & Bonchek, M. 2017. AI in the boardroom: The next realm of corporate governance. MIT Sloan Management Review, October 19: https://sloanreview.mit.edu/article/ai-in-the-boardroom-the-next-realm-of-corporate-governance/. Google ScholarLindebaum, D., & Courpasson, D. 2019. Becoming the next Charlie Parker: Rewriting the role of passions in bureaucracies with whiplash. Academy of Management Review, 44: 227–239.Link , Google ScholarLuhmann, N. 2000. Organisation und Entscheidung. Wiesbaden: VS Verlag. Google ScholarMader, F. (Producer). 2019. Report Muenchen (Künstliche Intelligenz—Wie Deutschland seinen Wohlstand aufs Spiel setzt [AI—How Germany jeopardizes its prosperity]). München: Bayerischer Rundfunk. Google ScholarMarr, B. 2018. Artificial intelligence: What's the difference between deep learning and reinforcement learning? Forbes, October 22: https://www.forbes.com/sites/bernardmarr/2018/10/22/artificial-intelligence-whats-the-difference-between-deep-learning-and-reinforcement-learning/. Google ScholarMintzberg, H. 1994. Rethinking strategic planning part I: Pitfalls and fallacies. Long Range Planning, 27(3): 12–21. Google ScholarMoore, P. V. 2019. Book review: Jerry Kaplan Artificial Intelligence: What Everyone Needs to Know. Organization Studies, 40: 466–470. Google ScholarMunro, K. 2018. China’s social credit system “could interfere in other nations’ sovereignty.” The Guardian, June 27: https://www.theguardian.com/world/2018/jun/28/chinas-social-credit-system-could-interfere-in-other-nations-sovereignty. Google ScholarO’Neill, C. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. New York: Crown Publishers. Google ScholarParkinson, H. J. 2019. AI can write just like me. Brace for the robot apocalypse. The Guardian, February 15: https://www.theguardian.com/commentisfree/2019/feb/15/ai-write-robot-openai-gpt2-elon-musk. Google ScholarPasquale, F. 2015. The black box society: The secret algorithms that control money and information. Cambridge, MA: Harvard University Press. Google ScholarPolonski, V., & Zavalishina, J. 2017. 3 ways to teach robots right from wrong. World Economic Forum, November 23: https://www.weforum.org/agenda/2017/11/3-ways-to-build-more-moral-robots. Google ScholarRedden, J., & Brand, J. 2018. Data harm record. Data Justice Lab: https://datajusticelab.org/data-harm-record/. Google ScholarSchiller, D. 1999. Digital capitalism: Networking the global market system. Cambridge, MA: MIT Press. Google ScholarSimon, H. 1997. (First published in 1947.) Administrative behavior: A study of decision-making processes in administrative organizations (4th ed.). New York: Free Press. Google ScholarSolomon, R. 1993. Ethics: A short introduction. Dubuque, IA: Brown & Benchmark. Google ScholarSuddaby, R. 2014. Editor’s comments: Why theory? Academy of Management Review, 39: 407–411.Link , Google ScholarSuhartono, H., & Dahrul, F. 2018. Lax safety, faulty systems cited in Indonesian crash of jet. Bloomberg, November 27: https://www.bloomberg.com/news/articles/2018-11-28/lion-air-crash-probe-findings-focus-on-carrier-s-safety-culture. Google ScholarTarnoff, B. 2018. Weaponised AI is coming. Are algorithmic forever wars our future? The Guardian, October 11: https://www.theguardian.com/commentisfree/2018/oct/11/war-jedi-algorithmic-warfare-us-military. Google ScholarTsoukas, H. 2017. Don’t simplify, complexify: From disjunctive to conjunctive theorizing in organization and management studies. Journal of Management Studies, 54: 132–153. Google ScholarTutt, A. 2016. An FDA for algorithms? Administrative Law Review, 69: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2747994. Google ScholarVallor, S. 2016. Technology and the virtues: A philosophical guide to a future worth wanting. Oxford: Oxford University Press. Google ScholarWeber, M. 1946. (First published in 1915.) Religious rejections of the world and their directions. In H. H. GerthC. Wright Mills (Eds.), From Max Weber: Essays in sociology: 323–359. New York: Oxford University Press. Google ScholarWeber, M. 1946. (First published in 1922.) Science as a vocation. In H. H. GerthC. Wright Mills (Eds.), From Max Weber: Essays in sociology: 129–156. New York: Oxford University Press. Google ScholarWeber, M. 1978. (First published in 1922.) Economy and society: An outline of interpretative sociology. Berkeley: University of California Press. Google ScholarWeber, M. 2002. (First published in 1920.) The protestant ethic and the spirit of capitalism. (Translated by S. Kalberg.) Los Angeles: Roxbury. Google ScholarWurzel, S. 2019. Reiseverbot für Millionen Menschen [Travel ban for millions of people]. Tagesschau, March 3: https://www.tagesschau.de/ausland/sozialkredit-ranking-china-101.html. Google ScholarFiguresReferencesRelatedDetailsCited bySubstituting Human Decision-Making with Machine Learning: Implications for Organizational LearningNatarajan Balasubramanian, Yang Ye and Mingtao Xu18 July 2022 | Academy of Management Review, Vol. 47, No. 3Morality in the Age of Artificially Intelligent AlgorithmsChristine Moser, Frank den Hond and Dirk Lindebaum15 March 2022 | Academy of Management Learning & Education, Vol. 21, No. 1Business Schools and Hubris: Cause or Cure?Eugene Sadler-Smith and Irina Cojuharenco29 June 2021 | Academy of Management Learning & Education, Vol. 20, No. 2Artificial Intelligence and Management: The Automation–Augmentation ParadoxSebastian Raisch and Sebastian Krakowski14 January 2021 | Academy of Management Review, Vol. 46, No. 1 Vol. 45, No. 1 Permissions Metrics in the past 12 months History Published online 9 January 2020 Published in print 1 January 2020 Information© Academy of Management ReviewAcknowledgmentsThis essay represents the synthesis of a long process of deliberation and intellectual struggle among the authors about the wider topic of algorithmic decision making at work and in society. Following Parkinson (2019), we underline that this essay is our original work and that it was produced without the help of an algorithm. In addition, some readers may find it useful to learn more about the practical relevance of this essay as reported in the news already (Hill, 2019; Kahn, 2019).Former associate editor Jean Bartunek and the three reviewers provided most insightful and stimulating comments during the review process. In addition, Christine Moser’s comments, and the feedback from the MOTI seminar series at Grenoble Ecole de Management, helped us consolidate the arguments presented in the essay. We are indebted to all of them for the intellectual generosity and guidance. A final thank you from Dirk Lindebaum goes to Virginia Brown for having left Forster’s short story as a small gift on his desk one day. It was only a small gift, but its inspiration for this essay was extraordinary.Download PDF