BETA

Summary for scraper logs from the 2019-08-29

Summary of log messages

LevelCount
Exceptions7
error35
warning0
info70598
debug182881

Summary of changes

TypeAddedUpdated
mep 0 48
dossier 1 2
amendment 232 0
mep_activity 482 0
comagenda 7 0

Unknown MEPs

EventCount
NIEBLER Professor Doktor Angelika2
GAMBUS MILLET Francisco de Paula2
BUZEK Professor Jerzy2
KARSKI Professor Karol1

Log Entries

TimeModuleLevelMessage
2019-08-29T00:20:22.553093meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-08-29T00:23:19.001690dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-08-29T00:24:13.596637dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-08-29T00:24:21.568345dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-08-29T00:25:50.541117dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-08-29T00:27:39.659941dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-08-29T00:27:51.231012dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-08-29T00:28:02.384815dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-08-29T00:28:02.483121dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-08-29T00:28:03.402486dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-08-29T00:29:28.279703dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-08-29T00:29:29.150509dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-08-29T00:29:30.188830dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-08-29T00:29:35.064216dossiererrorno mepid found for "NIEBLER Professor Doktor Angelika"
2019-08-29T00:29:35.516925dossiererrorno mepid found for "NIEBLER Professor Doktor Angelika"
2019-08-29T00:29:43.799552dossiererrorno mepid found for "KARSKI Professor Karol"
2019-08-29T00:30:35.619784dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-08-29T00:30:46.484870dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-08-29T00:32:06.180161dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-08-29T00:32:31.204238dossiererrorno mepid found for "BUZEK Professor Jerzy"
2019-08-29T00:32:37.852503dossiererrorno mepid found for "BUZEK Professor Jerzy"
2019-08-29T00:39:40.799092mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/AFET-OJ-2019-09-02-1_EN.html', 'committee': 'AFET'} (KeyError('epdoc'))
2019-08-29T00:39:40.841102mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'
2019-08-29T00:39:50.898635mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/EMPL-OJ-2019-09-03-1_EN.html', 'committee': 'EMPL'} (KeyError('epdoc'))
2019-08-29T00:39:50.900344mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'
2019-08-29T00:39:53.517332mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/BUDG-OJ-2019-09-03-1_EN.html', 'committee': 'BUDG'} (KeyError('epdoc'))
2019-08-29T00:39:53.549618mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'
2019-08-29T00:39:53.796222mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/ECON-OJ-2019-09-04-1_EN.html', 'committee': 'ECON'} (KeyError('epdoc'))
2019-08-29T00:39:53.861095mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'
2019-08-29T00:40:07.063074mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/CULT-OJ-2019-09-04-1_EN.html', 'committee': 'CULT'} (KeyError('epdoc'))
2019-08-29T00:40:07.064102mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'
2019-08-29T00:40:07.715061mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/JURI-OJ-2019-09-03-1_EN.html', 'committee': 'JURI'} (KeyError('epdoc'))
2019-08-29T00:40:07.716058mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'
2019-08-29T00:40:12.391928mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/AFCO-OJ-2019-09-03-1_EN.html', 'committee': 'AFCO'} (KeyError('epdoc'))
2019-08-29T00:40:12.409672mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 269, in scrape
    save(res)
  File "scrapers/comagenda.py", line 296, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 300, in onchanged
    id = doc['epdoc']
KeyError: 'epdoc'