BETA

Summary for scraper logs from the 2019-09-04

Summary of log messages

LevelCount
Exceptions1
error24
warning0
info23562
debug50838

Summary of changes

TypeAddedUpdated
mep 1 62
dossier 0 26
amendment 299 0
mep_activity 487 0
comagenda 9 1

Unknown MEPs

EventCount
NIEBLER Professor Doktor Angelika2
GAMBUS MILLET Francisco de Paula2
BUZEK Professor Jerzy2
KARSKI Professor Karol1
REGO Sira1

Log Entries

TimeModuleLevelMessage
2019-09-04T00:19:11.058353meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-09-04T00:22:04.182835dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-09-04T00:23:08.292278dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-09-04T00:23:18.060138dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-09-04T00:25:00.976617dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-09-04T00:26:57.699386dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-09-04T00:27:07.085824dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-09-04T00:27:18.760701dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-09-04T00:27:19.384905dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-09-04T00:27:19.420748dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-09-04T00:28:41.546394dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-09-04T00:28:41.625375dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-09-04T00:28:42.217434dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-09-04T00:28:48.894908dossiererrorno mepid found for "NIEBLER Professor Doktor Angelika"
2019-09-04T00:28:49.472753dossiererrorno mepid found for "NIEBLER Professor Doktor Angelika"
2019-09-04T00:28:56.631805dossiererrorno mepid found for "KARSKI Professor Karol"
2019-09-04T00:29:46.793902dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-09-04T00:29:56.612763dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-09-04T00:31:15.999574dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-09-04T00:31:38.376930dossiererrorno mepid found for "BUZEK Professor Jerzy"
2019-09-04T00:31:41.410654dossiererrorno mepid found for "BUZEK Professor Jerzy"
2019-09-04T00:35:03.193341dossiererrorno mepid found for "REGO Sira"
2019-09-04T00:39:18.623799mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/LIBE-OJ-2019-09-04-1_EN.html', 'committee': 'LIBE'} (IndexError('list index out of range'))
2019-09-04T00:39:18.625185mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 271, in scrape
    save(res)
  File "scrapers/comagenda.py", line 298, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 318, in onchanged
    date=sorted(doc['changes'].keys())[-1],
IndexError: list index out of range