Page 77 - AI Governance Day - From Principles to Implementation

AI Governance Day - From Principles to Implementation

Figure 48: Rumman Chowdhury: CEO of Humane Intelligence and USA Science Envoy
for Artificial Intelligence

Professor Stuart Russell on promising areas of research

Stuart Russell emphasized that the private sector needed to ramp up its safety research; the
resources of academia and government are a drop in the bucket. He stressed the importance
of getting the the incentives right that we are training the AI systems to achieve.

Stuart Russell warned that we were hopeless to write down objectives for an AI system
completely and correctly, but that what we were doing with large language models was even
worse because we are simply training them to imitate human beings.

One area of research that Professor Russell has been working is about so-called "assistance
games" where the AI agent is deliberately kept in the dark about the preferences and interests
of humans.

"I am cautiously optimistic, but it does feel as if we're in a race that we shouldn't have
to be in between when we figure out how to control AI systems and when we figure
out how to produce AGI" (Stuart Russell)

5�7 To share or not to share: the dilemma of open source vs� proprietary
large language models

Panelists:

– Jim Zemlin, Executive Director of the Linux Foundation
– Melike Yetken Krilla, Head of International Organizations at Google

67