With consumers increasingly worried about privacy and data protection, organizations are under ever greater pressure to establish trust and transparency in data and information systems, with new regulations such as the EU’s GDPR raising the prospect of harsh financial penalties for compliance failures.
Digital ethics is also growing in importance to organizations, given concerns about how companies are using artificial intelligence (AI) to make opaque decisions with major ramifications for society.
Restoring trust in information systems was the central theme of an executive panel discussion at Global Female Leaders 2022, a conference involving Öykü Işık, Professor of Digital Strategy and Cybersecurity at IMD.
A big part of the solution, she said, is to strengthen digital governance from a regulatory perspective. But companies must also ensure effective internal governance surrounding the processing of sensitive information.
Işık pointed to a broader digital responsibility for organizations to understand the impact of technologies on society, noting the potential for AI to displace vast swathes of the global labor force. “This must be a prerequisite; managers as well as consumers must have a basic understanding of how technology works,” she said.
Yet levels of awareness are still low because of the opacity surrounding the decisions companies have reached through AI, given just how complex machine learning is becoming.
Işık highlighted the ethical challenges by using real-world examples, such as Amazon’s ‘sexist’ AI recruiting tool that showed bias against women, and an algorithm that Uber used to verify drivers’ identity that was allegedly biased and led the ride-hailing firm to unfairly dismiss drivers.
She also cited a scandal that engulfed the Dutch government recently after the country’s tax authorities, trying to spot fraud among people applying for childcare benefits, used an algorithm that penalized certain families.
The examples underscore the potential negative implications of automated systems without the right safeguards in place, she said.