Page 30 - Turning digital technology innovation into climate action
P. 30
Turning digital technology innovation into climate action
translation, sentence completion, and other standard benchmarking tasks. OpenAI’s infamous
GPT-2 model, as one example, excelled at writing convincing fake news articles. But such advances have
required training ever larger models on sprawling data sets of sentences scraped from the internet.
The approach is computationally expensive – and highly energy intensive.” Furthermore, they found
that ‘the computational and environmental costs of training grew proportionally to model size and
then exploded when additional tuning steps were used to increase the model’s final accuracy.” It
33
is especially important to account for these limitations when considering the deployment of ICTs to
address climate change.
The next few chapters detail the existing (and potential) ways that ICTs do help in monitoring, mitigating
and adapting to climate change impacts.
33 Hao, Karen. ‘Training a Single AI Model Can Emit as Much Carbon as Five Cars in Their Lifetimes.’ MIT Technology
Review, 7 Jun. 2019, www .technologyreview .com/ s/ 613630/ training -a -single -ai -model -can -emit -as -much -carbon
-as -five -cars -in -their -lifetimes/ ?utm _campaign = site _visitor .unpaid .engagement & utm _source = hs _email & utm
_medium = email & utm _content = 7 3608463 & _hsenc = p2ANqtz - -j9p83piXI m9fiL7riodfQuQX0XOkswkP4qgMHSe
_NJI3GIxGsHMPZsEsVt2YyzyC0TqVKV7Zh0by -TudcURQa5bnoKw & _hsmi = 73608464.
16
