探索软件自动化带来的意外后果.pdf

1、Exploring the Unintended Consequences of Automation in SoftwareCourtney NashThe VOIDQCon San FranciscoNovember 2024An estimated 500,000 people in India died over the course of 5 years due to the sudden loss of their vulture population.Vultures disappearOther predator populations increaseLivestock ca

2、rcasses build upDisease rates(e.g.rabies)increaseWater quality decreasesIncreasedhumandisease&death“We should try to live in harmony and have a good balance between the species.Because,ultimately,were all interdependent.”Saudamini Das,Professor of Economics at the Institute of Economic Growth(Dehli)

3、Courtney NashHead of The VOIDAbout The VOIDhttps:/munity11About The VOIDhttps:/munity12Whats In The VOID?The Unexpected Consequences of Automation in Software“Although automated technology brings benefits to investors,including increased execution speed and some decreased costs,automated trading als

4、o amplifies certain risks.As market participants increasingly rely on computers to make order routing and execution decisions,it is essential that compliance and risk management functions at brokers or dealers keep pace.”US Securities and Exchange Commission(2013)A CAVEAT(Actually,two.)The assumptio

5、n that automation replaces humans is central to how it has been implemented in software,leading to a host of unintended consequences.Functional Allocation&The Substitution Myth(AKA The Fitts List)Research From Other DomainsFixed Strengths and WeaknessesSeparate TasksThe Substitution Myth in Automati

6、on1.Designers of automation tend to imagine the desired outcomes of automation(e.g.lower workload,higher accuracy)and that only those desired outcomes will occur(see also Norman 1990).2.Automation does not have access to all real-world parameters for accurate problem solving in all contexts,and may