BETA

Summary for scraper logs from the 2020-07-31

Summary of log messages

LevelCount
Exceptions1
error59
warning1
info83012
debug186360

Summary of changes

TypeAddedUpdated
mep 0 13
dossier 16 23
amendment 46333 0
mep_activity 702 0
TimeModuleLevelMessage
2020-07-31T00:10:18.452159mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197645} (KeyError('abbr'))
2020-07-31T00:10:18.479624mgrerrorTraceback (most recent call last):
File "./scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 149, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 85, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 398, in onchanged
    committee = c['abbr']
KeyError: 'abbr'
2020-07-31T00:16:50.421321dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2020-07-31T00:17:08.226900dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2020-07-31T00:17:26.592687dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2020-07-31T00:17:31.444670dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2020-07-31T00:18:34.651919dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2020-07-31T00:19:44.139719dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2020-07-31T00:19:49.759952dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2020-07-31T00:19:57.761329dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2020-07-31T00:19:57.762535dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2020-07-31T00:19:58.298259dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2020-07-31T00:20:46.967602dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2020-07-31T00:20:47.612478dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2020-07-31T00:20:48.515331dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2020-07-31T00:21:57.130133dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2020-07-31T00:25:01.304541dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2020-07-31T00:25:06.567843dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2020-07-31T00:25:14.777048dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2020-07-31T00:25:24.960819dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2020-07-31T00:25:41.533061dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2020-07-31T00:25:42.217354dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2020-07-31T00:25:43.355381dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2020-07-31T00:25:43.471183dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2020-07-31T00:25:43.503781dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2020-07-31T00:25:43.819054dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2020-07-31T00:25:43.845368dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2020-07-31T00:25:43.952905dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2020-07-31T00:25:44.259625dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2020-07-31T00:25:44.260659dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2020-07-31T00:25:44.439235dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2020-07-31T00:25:46.158646dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2020-07-31T00:25:46.351107dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2020-07-31T00:25:46.459600dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2020-07-31T00:25:46.557974dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2020-07-31T00:25:46.596766dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2020-07-31T00:25:46.916841dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2020-07-31T00:25:46.917661dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2020-07-31T00:25:46.922904dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2020-07-31T00:25:46.925428dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2020-07-31T00:25:47.377298dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2020-07-31T00:25:47.553460dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2020-07-31T00:34:36.761546amendmenterror[!] couldn't find ref: Committee on Development
2020-07-31T00:34:37.040660amendmenterror[!] couldn't find ref: Committee on Development
2020-07-31T00:34:37.063238amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641421_EN.pdf
2020-07-31T00:34:37.204953amendmenterror[!] couldn't find ref: Committee on Development
2020-07-31T00:34:37.225034amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641422_EN.pdf
2020-07-31T00:41:22.060822amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-07-31T00:41:46.271576amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-07-31T00:44:38.020105amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-07-31T00:47:29.521063amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-07-31T00:47:30.487924amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-07-31T00:50:19.566025amendmenterror[!] couldn't find ref: Committee on the Internal Market and Consumer Protection
2020-07-31T00:50:19.592930amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/IMCO-AM-655652_EN.pdf
2020-07-31T00:54:59.282471amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2020-07-31T00:54:59.295276amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-653991_EN.pdf
2020-07-31T00:55:02.486969amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2020-07-31T00:55:02.487597amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-653966_EN.pdf
2020-07-31T00:59:34.145778amendmentwarningno table
Motion for a resolution
Annex I – part A – introductory part – indent 3

          Motion for a resolution                                 paragraph Amendment

-      The proposal aims to strengthen                  -       The proposal aims to bring clarity
the contractual rights in relation to content           on the contractual rights in relation to
moderation and curation.                                content moderation and curation.
2020-07-31T01:04:00.684976amendmenterror[!] couldn't find ref: Committee on Development