BETA

Summary for scraper logs from the 2019-08-21

Summary of log messages

LevelCount
Exceptions24
error64
warning0
info70422
debug182492

Summary of changes

TypeAddedUpdated
mep 0 24
dossier 0 2
amendment 156 0
mep_activity 482 0

Unknown MEPs

EventCount
GAMBUS MILLET Francisco de Paula2

Log Entries

TimeModuleLevelMessage
2019-08-21T00:05:50.452741mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197701} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:05:50.475706mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:06:03.143512mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124766} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:06:03.260643mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:06:28.663339mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197778} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:06:28.755290mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:06:50.202878mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124771} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:06:50.203623mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:08:10.580517mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197714} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:08:10.589999mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:09:04.600428mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197468} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:09:04.601731mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:09:04.611574mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197453} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:09:04.612783mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:09:41.280736mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197430} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:09:41.282517mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:12:38.951615mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 5565} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:12:38.970308mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:13:46.784561mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197525} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:13:46.805805mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:14:39.925955mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124738} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:14:39.927506mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:15:07.933449mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 1927} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:15:08.017409mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:15:45.233342mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197522} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:15:45.236178mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:16:32.052211mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197541} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:16:32.064845mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:17:05.137727mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 4289} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:17:05.163857mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:17:16.577079mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 190099} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:17:16.590458mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:17:49.926311mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124846} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:17:49.978800mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:18:24.323329mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197413} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:18:24.381404mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:19:00.184287mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 125214} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:19:00.185852mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:19:06.507137mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197500} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:19:06.578974mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:19:56.707598mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124834} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:19:56.817414mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:20:22.693862meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-08-21T00:21:20.789282mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 130100} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:21:20.845954mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:22:17.768074mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 197572} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:22:17.902897mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:22:26.897016mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124713} (TypeError("'>' not supported between instances of 'datetime.datetime' and 'str'"))
2019-08-21T00:22:26.910375mgrerrorTraceback (most recent call last):
File "scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep.py", line 143, in scrape
    process(mep, id, db.mep, 'ep_meps', mep['Name']['full'], nopreserve=(['Addresses'], ['assistants']), onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/mep.py", line 374, in onchanged
    if c['end'] > today:
TypeError: '>' not supported between instances of 'datetime.datetime' and 'str'
2019-08-21T00:23:23.217667dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-08-21T00:24:17.750665dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-08-21T00:24:26.697865dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-08-21T00:25:56.751672dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-08-21T00:27:47.367982dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-08-21T00:27:59.693392dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-08-21T00:28:10.244338dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-08-21T00:28:10.416379dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-08-21T00:28:10.920966dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-08-21T00:29:35.566006dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-08-21T00:29:36.048454dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-08-21T00:29:36.663463dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-08-21T00:30:43.407636dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-08-21T00:30:53.489968dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-08-21T00:32:12.225488dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en