BETA

Summary for scraper logs from the 2020-08-05

Summary of log messages

LevelCount
Exceptions1
error59
warning1
info82997
debug186192

Summary of changes

TypeAddedUpdated
mep 0 8
dossier 1 10
amendment 46555 0
mep_activity 702 0
TimeModuleLevelMessage
2020-08-05T00:08:14.422724mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197782} (KeyError('abbr'))
2020-08-05T00:08:14.441850mgrerrorTraceback (most recent call last):
File "./scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 149, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 85, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 398, in onchanged
    committee = c['abbr']
KeyError: 'abbr'
2020-08-05T00:16:02.326189dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2020-08-05T00:16:19.177552dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2020-08-05T00:16:35.752902dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2020-08-05T00:16:40.432006dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2020-08-05T00:17:43.150499dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2020-08-05T00:18:50.453849dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2020-08-05T00:18:56.886041dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2020-08-05T00:19:04.755314dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2020-08-05T00:19:04.758966dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2020-08-05T00:19:05.024521dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2020-08-05T00:19:52.124702dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2020-08-05T00:19:52.462083dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2020-08-05T00:19:53.672017dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2020-08-05T00:20:57.100864dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2020-08-05T00:23:52.264435dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2020-08-05T00:23:56.651648dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2020-08-05T00:24:05.726295dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2020-08-05T00:24:15.969651dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2020-08-05T00:24:30.941601dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2020-08-05T00:24:32.442518dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2020-08-05T00:24:32.466515dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2020-08-05T00:24:34.055572dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2020-08-05T00:24:34.060794dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2020-08-05T00:24:34.100222dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2020-08-05T00:24:34.108046dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2020-08-05T00:24:34.113192dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2020-08-05T00:24:34.144023dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2020-08-05T00:24:34.169967dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2020-08-05T00:24:34.329200dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2020-08-05T00:24:36.102316dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2020-08-05T00:24:36.109414dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2020-08-05T00:24:36.122830dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2020-08-05T00:24:36.132796dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2020-08-05T00:24:36.466904dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2020-08-05T00:24:36.481056dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2020-08-05T00:24:36.487067dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2020-08-05T00:24:36.488788dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2020-08-05T00:24:36.489923dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2020-08-05T00:24:36.797333dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2020-08-05T00:24:36.807514dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2020-08-05T00:33:13.250414amendmenterror[!] couldn't find ref: Committee on Development
2020-08-05T00:33:15.074438amendmenterror[!] couldn't find ref: Committee on Development
2020-08-05T00:33:15.101512amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641421_EN.pdf
2020-08-05T00:33:17.149622amendmenterror[!] couldn't find ref: Committee on Development
2020-08-05T00:33:17.157145amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641422_EN.pdf
2020-08-05T00:39:52.498784amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-08-05T00:40:13.739408amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-08-05T00:42:54.008972amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-08-05T00:45:48.492388amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-08-05T00:45:51.073138amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-08-05T00:48:44.274215amendmenterror[!] couldn't find ref: Committee on the Internal Market and Consumer Protection
2020-08-05T00:48:44.351902amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/IMCO-AM-655652_EN.pdf
2020-08-05T00:53:28.575156amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2020-08-05T00:53:28.669711amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-653991_EN.pdf
2020-08-05T00:53:31.145513amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2020-08-05T00:53:31.294170amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-653966_EN.pdf
2020-08-05T00:57:57.485378amendmentwarningno table
Motion for a resolution
Annex I – part A – introductory part – indent 3

          Motion for a resolution                                 paragraph Amendment

-      The proposal aims to strengthen                  -       The proposal aims to bring clarity
the contractual rights in relation to content           on the contractual rights in relation to
moderation and curation.                                content moderation and curation.
2020-08-05T01:02:18.435353amendmenterror[!] couldn't find ref: Committee on Development