Page 361 - Big data - Concept and application for telecommunications

Big data - Concept and application for telecommunications 7

Some identified challenges concerning big data in the context of IoT are the following [b-Chen]:

− An increasing number of connected things generates huge amounts of data;
− The generated data are mainly semi-structured or even unstructured;
− The generated data may have different confidence and precision levels;
− The generated data are generally not useful until they are adequately "processed" (including pre-
processing, analysis, etc.).

7.3 Security and privacy

Data security and privacy comprise the people, process and technology required to prevent destructive
forces and unwanted actions [b-IBM]. From a big data perspective, security and privacy requirements are
magnified by the characteristics of big data. Some identified challenges concerning big data in the context of
security and privacy are the following [b-CSA]:

− Secure computations in distributed programing frameworks;
− Secure data storage and transactions logs;
− End-point input validation/filtering and data provenance;
− Real-time security/compliance monitoring;

− Scalable and composable privacy-preserving data mining and analytics;
− Anonymization and de-identification.

7.4 Software-defined networking
Software-defined networking (SDN) is a set of techniques that enables users to directly program, orchestrate,
control and manage network resources, which facilitates the design, delivery and operation of network
services in a dynamic and scalable manner [ITU-T Y.3300]. By abstracting the underlying infrastructure for
applications and network services, SDN lets administrators dynamically adjust network-wide traffic flow to
meet changing needs, while maintaining a global view of the network.
Big data processing requires agile, multi-domain, centrally managed architecture. SDN addresses the
congestion and lack of scalability of current networks by [b-NEC]:
− Allowing for changing traffic patterns;
− Providing functionality to applications that access geographically distributed databases and servers
through public and private clouds;
− Providing access to bandwidth on demand.

7.5 Deep packet inspection
Deep packet inspection (DPI) is a form of filtering used to inspect data packets sent from one computer to
another over a network. Software-based DPI, provides advanced traffic analysis and multidimensional
reporting, showing the possibility of making off-the-shelf hardware work at actual line rates. Software-based
DPI can be pervasively deployed in the network, providing much better analysis capabilities, as well as simpler
mechanisms for deployment, update, testing and scaling to changing workloads [b-ITU-T DPI].

7.6 Big data-driven networking
Big data-driven networking (bDDN) is a group of technologies and methods to facilitate network operation,
administration, maintenance and optimization, etc., based on the big data generated by the network and a
series of methods and tools. That is to say, big data generated by the network is used to serve the network
and make the network better. bDDN solves this problem by introducing and applying the big data technology
to the framework of future networks [b-ITU-T DDN].

Standardization efforts at a glance – roadmap 353