BETA

Summary for scraper logs from the 2019-09-11

Summary of log messages

LevelCount
Exceptions1
error23
warning24
info71179
debug184099

Summary of changes

TypeAddedUpdated
mep 0 14
dossier 14 38
amendment 569 0
mep_activity 500 0
comagenda 15 0

Unknown MEPs

EventCount
NIEBLER Professor Doktor Angelika2
GAMBUS MILLET Francisco de Paula2
KARSKI Professor Karol1
BUZEK Professor Jerzy1
REGO Sira1

Log Entries

TimeModuleLevelMessage
2019-09-11T00:05:33.228293mepwarning"Main parliamentary activities" -> "Reports - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197448/name/cv
2019-09-11T00:06:21.518302mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/23868/name/cv
2019-09-11T00:06:39.426013mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197512/name/cv
2019-09-11T00:07:34.791259mepwarning"Main parliamentary activities" -> "Opinions - as rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/96711/name/cv
2019-09-11T00:08:24.923666mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/2309/name/cv
2019-09-11T00:08:36.293655mepwarning"Main parliamentary activities" -> "Reports - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197731/name/cv
2019-09-11T00:08:49.396026mepwarning"Main parliamentary activities" -> "Opinions - as rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/96891/name/cv
2019-09-11T00:09:27.675320mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/96725/name/cv
2019-09-11T00:10:26.088694mepwarning"Main parliamentary activities" -> "Reports - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197555/name/cv
2019-09-11T00:10:46.312421mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/183916/name/cv
2019-09-11T00:11:34.620429mepwarning"Main parliamentary activities" -> "Opinions - as rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197444/name/cv
2019-09-11T00:12:19.029086mepwarning"Main parliamentary activities" -> "Reports - as rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/188636/name/cv
2019-09-11T00:12:19.074047mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/188636/name/cv
2019-09-11T00:12:44.348340mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197627/name/cv
2019-09-11T00:12:48.516069mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197767/name/cv
2019-09-11T00:13:02.103862mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/191693/name/cv
2019-09-11T00:13:27.416612mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/23699/name/cv
2019-09-11T00:14:52.009414mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/111011/name/cv
2019-09-11T00:17:11.899051mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197527/name/cv
2019-09-11T00:17:48.797310mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/125706/name/cv
2019-09-11T00:20:11.326935meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-09-11T00:20:15.416636mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/119431/name/cv
2019-09-11T00:20:40.566084mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/37324/name/cv
2019-09-11T00:21:54.579805mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197572/name/cv
2019-09-11T00:22:09.890625mepwarning"Main parliamentary activities" -> "Opinions - as shadow rapporteur" not in known_sidebar items, in http://www.europarl.europa.eu/meps/en/197621/name/cv
2019-09-11T00:23:06.278290dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-09-11T00:24:04.712148dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-09-11T00:24:11.610370dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-09-11T00:25:47.279613dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-09-11T00:27:37.750157dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-09-11T00:27:48.747904dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-09-11T00:27:59.902882dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-09-11T00:27:59.930881dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-09-11T00:28:01.155660dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-09-11T00:29:21.254996dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-09-11T00:29:21.731430dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-09-11T00:29:22.714201dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-09-11T00:29:29.923257dossiererrorno mepid found for "NIEBLER Professor Doktor Angelika"
2019-09-11T00:29:30.071113dossiererrorno mepid found for "NIEBLER Professor Doktor Angelika"
2019-09-11T00:29:38.249896dossiererrorno mepid found for "KARSKI Professor Karol"
2019-09-11T00:30:24.361054dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-09-11T00:30:35.040666dossiererrorno mepid found for "GAMBUS MILLET Francisco de Paula"
2019-09-11T00:31:51.383267dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-09-11T00:32:14.362729dossiererrorno mepid found for "BUZEK Professor Jerzy"
2019-09-11T00:35:35.316933dossiererrorno mepid found for "REGO Sira"
2019-09-11T00:40:20.200956mgrerrorfailed to execute comagenda job {'url': 'http://www.europarl.europa.eu/doceo/document/FEMM-OJ-2019-09-23-1_EN.html', 'committee': 'FEMM'} (NameError("name 'd' is not defined"))
2019-09-11T00:40:20.223934mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/comagenda.py", line 271, in scrape
    save(res)
  File "scrapers/comagenda.py", line 298, in save
    process(item, id, db.comagenda, 'ep_comagendas', id+' - '+item['title'], onchanged=onchanged)
  File "/home/pt/pt2/utils/process.py", line 78, in process
    onchanged(obj, d)
  File "scrapers/comagenda.py", line 326, in onchanged
    (u"a change on " if d else u'',
NameError: name 'd' is not defined