ITU's 160 anniversary

Connecting the world and beyond

Challenges with handling keys for secure AI

Challenges with handling keys for secure AI

Authors: Akram Bitar, Greg Boland, Nir Drucker
Status: Final
Date of publication: 15 September 2025
Published in: ITU Journal on Future and Evolving Technologies, Volume 6 (2025), Issue 3, Pages 286-300
Article DOI : https://doi.org/10.52953/NEZP8500
Abstract:
Secure generative AI using Fully Homomorphic Encryption (FHE) enables the utilization of cutting-edge AI capabilities while preserving the privacy of both the model and user queries. Despite its promise, the development and maintenance of scalable solutions in this area remain obscure with challenges that require further exploration. In this paper, we examine key management challenges that are often overlooked in modern research, particularly in offline flows. We identify gaps in current NIST KMS standardization, introduce the concept of a Hierarchical Key Management System (HKMS) solution, and share insights from a recent demonstration of IBM's He4Cloud design.

Keywords: Generative AI, homomorphic encryption, infrastructure setup, key management
Rights: © International Telecommunication Union, available under the CC BY-NC-ND 3.0 IGO license.
electronic file
ITEM DETAILARTICLEPRICE
ENGLISH
PDF format   Full article (PDF)
Free of chargeDOWNLOAD