BETA

Summary for scraper logs from the 2020-08-01

Summary of log messages

LevelCount
Exceptions2
error61
warning1
info82982
debug186305

Summary of changes

TypeAddedUpdated
mep 0 9
dossier 1 32
amendment 46333 0
mep_activity 702 0
TimeModuleLevelMessage
2020-08-01T00:09:32.116808mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197453} (KeyError('abbr'))
2020-08-01T00:09:32.117403mgrerrorTraceback (most recent call last):
File "./scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 149, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 85, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 398, in onchanged
    committee = c['abbr']
KeyError: 'abbr'
2020-08-01T00:15:47.055553mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197550} (KeyError('abbr'))
2020-08-01T00:15:47.056063mgrerrorTraceback (most recent call last):
File "./scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 149, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 85, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 398, in onchanged
    committee = c['abbr']
KeyError: 'abbr'
2020-08-01T00:18:08.356278dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2020-08-01T00:18:27.235175dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2020-08-01T00:18:45.989519dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2020-08-01T00:18:50.534404dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2020-08-01T00:19:52.142250dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2020-08-01T00:20:59.960334dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2020-08-01T00:21:06.672176dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2020-08-01T00:21:13.006047dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2020-08-01T00:21:13.008037dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2020-08-01T00:21:14.798701dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2020-08-01T00:22:04.694211dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2020-08-01T00:22:06.190452dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2020-08-01T00:22:09.354791dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2020-08-01T00:23:11.891462dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2020-08-01T00:26:09.648381dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2020-08-01T00:26:14.271185dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2020-08-01T00:26:22.617058dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2020-08-01T00:26:31.115282dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2020-08-01T00:26:46.537885dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2020-08-01T00:26:47.488732dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2020-08-01T00:26:48.094064dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2020-08-01T00:26:48.938628dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2020-08-01T00:26:49.231077dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2020-08-01T00:26:49.231361dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2020-08-01T00:26:49.245010dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2020-08-01T00:26:49.304947dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2020-08-01T00:26:49.307607dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2020-08-01T00:26:49.362599dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2020-08-01T00:26:49.863727dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2020-08-01T00:26:50.489557dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2020-08-01T00:26:51.460823dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2020-08-01T00:26:51.575302dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2020-08-01T00:26:51.619921dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2020-08-01T00:26:51.632781dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2020-08-01T00:26:51.813476dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2020-08-01T00:26:52.037808dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2020-08-01T00:26:52.041592dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2020-08-01T00:26:52.146202dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2020-08-01T00:26:52.740178dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2020-08-01T00:26:52.774649dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2020-08-01T00:35:29.455193amendmenterror[!] couldn't find ref: Committee on Development
2020-08-01T00:35:29.516249amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641421_EN.pdf
2020-08-01T00:35:29.524873amendmenterror[!] couldn't find ref: Committee on Development
2020-08-01T00:35:31.578274amendmenterror[!] couldn't find ref: Committee on Development
2020-08-01T00:35:31.620500amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641422_EN.pdf
2020-08-01T00:42:21.848476amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-08-01T00:42:49.687543amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-08-01T00:45:37.206990amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-08-01T00:48:34.946577amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-08-01T00:48:35.395689amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-08-01T00:51:24.193706amendmenterror[!] couldn't find ref: Committee on the Internal Market and Consumer Protection
2020-08-01T00:51:24.199532amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/IMCO-AM-655652_EN.pdf
2020-08-01T00:56:10.025528amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2020-08-01T00:56:10.140670amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-653991_EN.pdf
2020-08-01T00:56:10.517784amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2020-08-01T00:56:10.666082amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-653966_EN.pdf
2020-08-01T01:00:50.953458amendmentwarningno table
Motion for a resolution
Annex I – part A – introductory part – indent 3

          Motion for a resolution                                 paragraph Amendment

-      The proposal aims to strengthen                  -       The proposal aims to bring clarity
the contractual rights in relation to content           on the contractual rights in relation to
moderation and curation.                                content moderation and curation.
2020-08-01T01:05:15.605195amendmenterror[!] couldn't find ref: Committee on Development