BETA

Summary for scraper logs from the 2019-08-20

Summary of log messages

LevelCount
Exceptions19
error54
warning1
info70399
debug186700

Summary of changes

TypeAddedUpdated
mep 0 19
dossier 0 7
amendment 149 0
mep_activity 482 0

Unknown MEPs

EventCount
GAMBUS MILLET Francisco de Paula2
Wolters1

Log Entries

TimeModuleLevelMessage
2019-08-20T00:05:09.897064mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 198096} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:05:09.921398mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:05:49.972443mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197437} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:05:49.973109mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:06:00.737739mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197778} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:06:00.743148mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:06:54.855099mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197829} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:06:54.861567mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:07:13.870580mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197782} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:07:13.875500mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:08:09.612565mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 96868} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:08:09.630308mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:08:48.644308mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124779} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:08:48.667839mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:10:34.856268mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 2054} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:10:34.856944mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:10:56.429200mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 58789} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:10:56.467930mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:11:01.151879mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 28266} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:11:01.155352mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:11:14.379730mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197767} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:11:14.380770mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:11:20.112373mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197585} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:11:20.113087mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:12:53.677522mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 1927} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:12:53.757594mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:14:18.834264mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197889} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:14:18.835536mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:15:29.888690mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 188945} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:15:29.889568mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:17:00.006865mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197756} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:17:00.009683mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:17:05.102842mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197831} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:17:05.104233mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:17:07.290571meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-08-20T00:17:39.643548mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124934} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:17:39.660494mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:18:54.098744mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 185341} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-20T00:18:54.099552mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-20T00:19:38.382594dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-08-20T00:20:28.191275dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-08-20T00:20:36.522372dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-08-20T00:22:05.357773dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-08-20T00:23:44.285307dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-08-20T00:23:53.851638dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-08-20T00:24:05.229385dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-08-20T00:24:05.595060dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-08-20T00:24:05.663641dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-08-20T00:25:21.544746dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-08-20T00:25:22.105254dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-08-20T00:25:22.447043dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-08-20T00:26:24.148433dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-08-20T00:26:32.725444dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-08-20T00:27:45.817654dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-08-20T02:51:20.910445dbwarningno mepid found for "Wolters"