Most AI systems today are neural networks. Neural networks are algorithms that mimic a biological brain to process vast amounts of data. They are known for being fast, but they are inscrutable. Neural networks require enormous amounts of data to learn how to make decisions; however, the reasons for their decisions are concealed within countless layers of artificial neurons, all separately tuned to various parameters.
In other words, neural networks are “black boxes.” And the developers of a neural network not only don’t control what the AI does, they don’t even know why it does what it does.
This a horrifying reality. But it gets worse.
Despite the risk inherent in the technology, neural networks are beginning to run the key infrastructure of critical business and governmental functions. As AI systems proliferate, the list of examples of dangerous neural networks grows longer every day. For example:
These outcomes range from deadly to comical to grossly offensive. And as long as neural networks are in use, we’re at risk for harm in numerous ways. Companies and consumers are rightly concerned that as long as AI remains opaque, it remains dangerous.
A regulatory response is coming
In response to such concerns, the EU has proposed an AI Act and the U.S. has drafted an AI Bill of Rights Blueprint. Both tackle the problem of opacity head-on.
The EU AI Act states that “high-risk” AI systems must be built with transparency, allowing an organization to pinpoint and analyze potentially biased data and remove it from all future analyses. It removes the black box entirely. The EU AI Act defines high-risk systems to include critical infrastructure, human resources, essential services, law enforcement, border control, jurisprudence and surveillance. Indeed, virtually every major AI application being developed for government and enterprise use will qualify as a high-risk AI system and thus will be subject to the EU AI Act.
Similarly, the U.S. AI Bill of Rights asserts that users should be able to understand the automated systems that affect their lives. It has the same goal as the EU AI Act: protecting the public from the real risk that opaque AI will become dangerous AI. The Blueprint is currently a non-binding and therefore toothless white paper. However, its provisional nature might be a virtue, as it will give AI scientists and advocates time to work with lawmakers to shape the law appropriately.
In any case, it seems likely that both the EU and the U.S. will require organizations to adopt AI systems that provide interpretable output to their users. In short, the AI of the future may need to be transparent, not opaque.
But does it go far enough?
Establishing new regulatory regimes is always challenging. History offers us no shortage of examples of ill-advised legislation that accidentally crushes promising new industries. But it also offers counter-examples where well-crafted legislation has benefited both private enterprise and public welfare.
For instance, when the dotcom revolution began, copyright law was well behind the technology it was meant to govern. As a result, the early years of the internet era were marred by intense litigation targeting companies and consumers. Eventually, the comprehensive Digital Millennium Copyright Act (DMCA) was passed. Once companies and consumers adapted to the new laws, internet businesses began to thrive and innovations like social media, which would have been impossible under the old laws, were able to flourish.
The forward-looking leaders of the AI industry have long understood that a similar statutory framework will be necessary for AI technology to reach its full potential. A well-constructed regulatory scheme will offer consumers the security of legal protection for their data, privacy and safety, while giving companies clear and objective regulations under which they can confidently invest resources in innovative systems.
Unfortunately, neither the AI Act nor the AI Bill of Rights meets these objectives. Neither framework demands enough transparency from AI systems. Neither framework provides enough protection for the public or enough regulation for business.
A series of analyses provided to the EU have pointed out the flaws in the AI Act. (Similar criticisms could be lobbied at the AI Bill of Rights, with the added proviso that the American framework isn’t even intended to be a binding policy.) These flaws include:
For AI to safely proliferate in America and Europe, these flaws need to be addressed.
What to do about dangerous AI until then
Until appropriate regulations are put in place, black-box neural networks will continue to use personal and professional data in ways that are completely opaque to us. What can someone do to protect themselves from opaque AI? At a minimum:
The risks of AI are real, but so are the benefits. In tackling the risk of opaque AI leading to dangerous outcomes, the AI Bill of Rights and AI Act are charting the right course for the future. But the level of regulation is not yet robust enough.
Michael Capps is CEO of Diveplane.
Welcome to the VentureBeat community!
Our guest posting program is where technical experts share insights and provide neutral, non-vested deep dives on AI, data infrastructure, cybersecurity and other cutting-edge technologies shaping the future of enterprise.
Read more from our guest post program — and check out our guidelines if you’re interested in contributing an article of your own!