Page 49 - FIGI - Big data, machine learning, consumer protection and privacy

Endnotes

1 The risk of bias in computing systems and approaches to dealing with it have been under discussion for more than 20
years. See Batya Friedman & Helen Nissenbaum, Bias in Computer Systems, 14 ACM TRANSACTIONS ON INFO. SYS.
330 (1996).
2 See, e.g., Cade Metz, In a Huge Breakthrough, Google’s AI Beats a Top Player at the Game of Go,
WIRED (Jan. 27, 2016), https:// www .wired .com/ 2016/ 01/ in -a -huge -breakthrough -googles -ai -beats -a -top -player -at -the
-game -of -go/ .
3 A World That Counts: Mobilizing the Data Revolution for Sustainable Development, United Nations Secretary-General’s
Independent Expert Advisory Group on a Data Revolution for Sustainable Development.
4 https:// www .upstart .com/ .
5 https:// www .lenddo .com/ .
6 http:// www .prnewswire .co .in/ news -releases/ new -fico -credit -scores -provide -lenders -opportunity -to -expand -access -to
-credit -in -india -for -nearly -350 -million -653029163 .html.
7 https:// branch .co/ .
8 https:// corporate .mybucks .com/ .
9 https:// www .businesswire .com/ news/ home/ 20160717005040/ en/ ZestFinance -Receives -Funding -Baidu -Fuel
-Development -Search -Based.
10 https:// www .pymnts .com/ in -depth/ 2015/ how -zestfinance -used -big -data -lending -to -secure -150m -from -fortress/ .
11 https:// www .progressive .com/ auto/ discounts/ snapshot/ .
12 See https:// www .techemergence .com/ machine -learning -at -insurance -companies/ .
13 See, e.g., Ryan Calo, Artificial Intelligence Policy: A Primer and Roadmap, https:// ssrn .com/ abstract = 3015350.
14 GPFI, Use of Alternative Data to Enhance Credit Reporting to Enable Access to Digital Financial Services by Individuals
and SMEs operating in the Informal Economy, Guidance Note, PREPARED BY INTERNATIONAL COMMITTEE ON
CREDIT REPORTING (ICCR) (GPFI Priorities Paper 2018). https:// www .g20 .org/ sites/ default/ files/ documentos
_producidos/ use _of _alternative _data _to _enhance _credit _reporting _to _enable _access _to _digital _financial _services
_iccr .pdf

15 See Ethically Aligned Design, at footnote 224.
16 “The GDPR’s provisions are—to borrow a key term used throughout EU data protection regulation—incompatible with
the data environment that the availability of Big Data generates. Such incompatibility is destined to render many of
the GDPR’s provisions quickly irrelevant.” Zarsky, Tal, ‘Incompatible: The GDPR in the Age of Big Data’ (August 8, 2017).
Seton Hall Law Review, Vol. 47, No. 4(2), 2017, https:// ssrn .com/ abstract = 3022646.
17 See https:// www .oecd .org/ sti/ ieconomy/ 2013 -oecd -privacy -guidelines .pdf.
18 The Amending Protocol to the Convention for the Protection of Individuals with regard to Automatic Processing of
Personal Data, which amended Convention 108 in 2018, now addresses features of automated data processing such as
profiling, automated decisions and use of algorithms. This includes the right not to be subject to a decision significantly
affecting a data subject based solely on automated data processing without considering their view; the right to obtain
knowledge of the reasoning underlying data processing where the results are applied to the data subject; and the right
to object to data processing, among others.
19 Danielle Citron and Frank A Pasquale, ‘The Scored Society: Due Process for Automated Predictions’ (Social Science
Research Network 2014) SSRN Scholarly Paper ID 2376209 https:// papers .ssrn .com/ abstract = 2376209; Tal Z
Zarsky,‘Understanding Discrimination in the Scored Society’ (2014) 89 Wash. L. Rev. 1375; Brent Mittelstadt and others,
‘The Ethics of Algorithms: Mapping the Debate’ (2016) 3 Big Data & Society http:// bds .sagepub .com/ lookup/ doi/ 10
.1177/ 2053951716679679.
20 This is not so for all financial services; for instance, the retail deposit business of a bank, or an investment fund available
for retail investors, have no particular reason to treat investors differently.

21 Ryan Singel, Credit Card Firm Cut Limits After Massage Parlor Visits, Feds Allege, Wired, 20 June 2008, https://
www .wired .com/ 2008/ 06/ credit -card -fir/ ; FTC complaint at https:// www .wired .com/ images _blogs/ threatlevel/ files/
compucreditcmplt .pdf; Subprime Credit Card Marketer to Provide At Least $114 Million in Consumer Redress to Settle
FTC Charges of Deceptive Conduct, 19 December 2008, https:// www .ftc .gov/ news - events/press-releases/2008/12/
subprime-credit-card-marketer-provide-least-114-million-consumer; and FTC v CompuCredit Corporation and Jefferson

Big data, machine learning, consumer protection and privacy 47