Activities of Maria-Manuel LEITÃO-MARQUES related to 2020/2012(INL)
Shadow opinions (1)
OPINION with recommendations to the Commission on the framework of ethical aspects of artificial intelligence, robotics and related technologies
Amendments (17)
Amendment 5 #
Draft opinion
Paragraph 1
Paragraph 1
1. Underlines the importance of an EU regulatory framework being applicable where consumers within the Union are users of or subject to an algorithmic system, irrespective of the place of establishment of the entities that develop, sell or employ the system; furthermore, believes that the rules set out should apply across the value chain, namely development, deployment and use of the relevant technologies and their components and for all developers, and should guarantee the highest level of consumer protection; proposes that these rules take into account the lessons drawn from the adaptation to Regulation (EU) 2016/6791a (GDPR), considered a global benchmark; considers the designation of a liable entity in the Union (such as authorised representative) important for its enforcement; __________________ 1aRegulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) (OJ L 119, 4.5.2016, p. 1).
Amendment 9 #
Draft opinion
Paragraph 2
Paragraph 2
2. Notes that the framework should apply to algorithmic systems, including the fields of artificial intelligence (AI), internet of things (IoT), machine learning, deep learning, automated decision making processes and robotics; further notes that referral systems should be developed to help explain those systems to consumers whenever they present complexity or constitute decisions that impact their lives significantly;
Amendment 21 #
Draft opinion
Paragraph 3
Paragraph 3
3. Stresses that any future regulation should follow a differentiated risk-based approach, based on the potential harm or breaches of rights for the individual as well as for society at large, taking into account the specific use context of the algorithmic system; legal obligations and certification requirements should gradually increase with the identified risk level; in the lowest risk category there should be no additional legal obligations; algorithmic systems that may harm an individual and certification or labelling systems should be voluntary; algorithmic systems that may harm an individual or cause potential breaches of an individual’s rights, impact an individual’s access to resources, or concern their participation in society shall not be deemed to be in the lowest risk category; this risk-based approach should follow clear and transparent rules, providing enough legal certainty whilst being future-proof;
Amendment 30 #
Draft opinion
Paragraph 3 a (new)
Paragraph 3 a (new)
3a. Believes that the ethical principles should be the basis for a harmonised European system of risk classification and related legal obligations;
Amendment 31 #
Draft opinion
Paragraph 4
Paragraph 4
4. Underlines the importance of an ethical and regulatory framework, including in particular provisions on the quality of data sets used in algorithmic systems in relation to the purpose of its use, especially regarding the representativeness of training data used, on the de-biasing of data sets, as well as on the algorithms themselves, and on data and aggregation standards; stresses that those data sets should be auditable and made available to the competent authorities whenever called upon to ensure their fitness with the previously exposed principles;
Amendment 45 #
Draft opinion
Paragraph 5
Paragraph 5
5. Believes that consumers should be adequately informed in a timely, impartial, easily-readable, standardised and accessible manner about the existence, process, rationale, reasoning and possibleintended and reasonably foreseeable unintended outcome of algorithmic systems, about how to reach a human with decision- making powers, and about how the system’s decisions can be checked, meaningfully contested and corrected; this information should not, however, endanger trade secrets and other competitive advantages;
Amendment 47 #
Draft opinion
Paragraph 5
Paragraph 5
5. Believes that consumers should be adequately informed in a timely, impartial, easily-readable, standardised and accessible manner about the existence, the aims or purpose, process, rationale, reasoning and possible outcome and consequences for consumers of algorithmic systems, about how to reach a human with decision- making powers, and about how the system’s decisions can be checked, meaningfully contested and corrected;
Amendment 54 #
Draft opinion
Paragraph 5 a (new)
Paragraph 5 a (new)
5a. Believes that a European legal framework for a system of risk classification and related legal obligations is required to ensure a uniform protection of European consumers;
Amendment 63 #
Draft opinion
Paragraph 7
Paragraph 7
7. Stresses that where public money contributesmoney originating from public sources contributes significantly to the development or implementation of an algorithmic system, the code, the generated data - as far as it is non-personal - and the trained model should be public by default, to enable transparency and reuse, among other goals, to maximise the achievement of the Single Market, and to avoid market fragmentation;
Amendment 71 #
Draft opinion
Paragraph 7 a (new)
Paragraph 7 a (new)
7a. Calls for a uniform implementation of the system of risk classification and related legal obligations to ensure a level-playing field among the Member States and to prevent a fragmentation of the internal market;
Amendment 75 #
Draft opinion
Paragraph 7 b (new)
Paragraph 7 b (new)
7b. Considers that AI, IoT, and other emerging technologies have enormous potential to deliver opportunities for consumers to have access to several amenities in many aspects of their lives alongside with better products and services, as well as to benefit from better market surveillance, as long as all applicable principles, conditions (including transparency and auditability), and regulations continue to apply;
Amendment 81 #
Draft opinion
Paragraph 8
Paragraph 8
8. Underlines the importance of ensuring that the interests of consumers and groups which are marginalised andor in vulnerable consumers and groupsituations are adequately taken into account and represented in any future regulatory framework; notes that for the purpose of analysing the impacts of algorithmic systems on consumers, access to data should be extended to appropriate parties notably independent researchers, media and civil society organisations, while fully respecting Union data protection and privacy law; recalls the importance of training and giving basic skills to consumers to deal with algorithmic systems in order to protect them from potential risks and detriment of their rights;
Amendment 87 #
Draft opinion
Paragraph 8 a (new)
Paragraph 8 a (new)
8a. Considers that, when it comes to filling the gaps on the practical implementation of ethical guidelines on algorithmic systems and connected technologies, models such as the so-called VCIO model (Values, Criteria, Indicators, Observables) should be studied and evaluated in terms of fitness for purpose; further considers that such models to concretise and implement AI system requirements, as well as to produce labels that allow companies to communicate the ethical properties of their products clearly and uniformly through a standardised risk matrix, could enhance consumer literacy, information, and awareness;
Amendment 100 #
Draft opinion
Paragraph 10
Paragraph 10
10. Calls for the Union to consider the establishment of a European market surveillance structure for algorithmic systems issuing guidance, opinions and expertise to Member States’ authorities; further calls for this structure to be appropriately advised by stakeholder organisations (such as consumer protection organisations) in order to ensure wide consumer representation;
Amendment 108 #
Draft opinion
Paragraph 11
Paragraph 11
11. Notes that it is essential for the software documentation, the algorithms and data sets used or produced by artificial intelligence, robotics, and related technologies to be fully accessible to market surveillance authorities, while respecting Union law; further notes that such elements should be preserved by those who are involved in the different stages of the development of algorithmic systems and in proportion of their liability, namely through distributed ledger technologies, such as block-chain; invites the Commission to assess if additional prerogatives should be given to market surveillance authorities in this respect;
Amendment 116 #
Draft opinion
Paragraph 12
Paragraph 12
12. Calls for the designation by each Member State of a competent national authorityenforcement body(NEB) for monitoring the application of the provisions;
Amendment 129 #
Draft opinion
Paragraph 13 a (new)
Paragraph 13 a (new)
13a. Stresses the need for national market surveillance authorities to be reinforced in terms of capacity, skills, and competences in AI, IoT and other related technologies, as well as knowledge about its specific risks;