BETA

Summary for scraper logs from the 2019-07-09

Summary of log messages

LevelCount
Exceptions1
error27
warning38
info72974
debug596714

Summary of changes

TypeAddedUpdated
mep 0 14
dossier 6 46
mep_activity 747 0
comagenda 997 611
pvote 284 0

Dossier events without known bodies

EventCount

Unknown MEPs

EventCount
PIETIKÄINEN Sirpa7

Log Entries

TimeModuleLevelMessage
2019-07-09T01:13:57.371862_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/189525_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:14:02.679546_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197836_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:14:04.565187_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197848_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:14:10.722723_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125110_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:14:23.458568_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197701_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:14:24.944402_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197695_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:16:04.802281_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/26837_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:17:07.528173_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124873_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:17:44.800770_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197414_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:18:14.044409_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197819_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:19:40.653659_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125109_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:19:45.870163_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197839_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:19:51.366475_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125068_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:19:59.756494_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197415_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:08.076521_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197740_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:12.201021_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/130833_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:12.901911_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197699_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:26.873834_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197737_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:28.738499_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197692_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:28.834540_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125063_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:20:29.359357_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124866_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:21:34.421784_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/124691_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:21:35.523544_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/98341_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:21:51.304712_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/125128_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:22:27.511212_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197734_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:22:44.007369_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/28586_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:22:48.604171_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/124692_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:22:57.882142_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197845_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:23:25.517103_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124850_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:24:35.899445_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197849_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:24:43.428548_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125064_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:24:44.256459_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124852_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:25:08.727983meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-07-09T01:25:48.710755_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197747_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:25:56.198632_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197844_DFI_LEG9_rev0_BG.pdf
2019-07-09T01:26:02.623686_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125065_DFI_LEG9_rev0_EL.pdf
2019-07-09T01:27:27.485203dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-07-09T01:28:03.256653dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T01:28:19.010206dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-07-09T01:28:21.135732dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T01:28:25.554902dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-07-09T01:28:56.997780dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T01:29:54.888287dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-07-09T01:31:38.891752dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-07-09T01:31:47.994865dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-07-09T01:31:59.098133dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-07-09T01:31:59.223060dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-07-09T01:31:59.263619dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-07-09T01:33:12.661242dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-07-09T01:33:13.222302dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-07-09T01:33:13.626215dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-07-09T01:34:22.529804dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T01:35:43.251103dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T01:35:43.565380dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T01:35:50.998406dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-07-09T01:36:34.197375dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-09T03:11:57.776745pvoteerrorfailed to parse xml from url: http://www.europarl.europa.eu/RegData/seance_pleniere/proces_verbal/2019/03-26/liste_presence/P8_PV(2019)03-26(RCV)_XC.xml
2019-07-09T03:11:57.777524mgrerrorfailed to execute pvote job {'term': 8, 'date': '2019-03-26'} (XMLSyntaxError(None))
2019-07-09T03:11:57.796398mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 64, in consume
    ret = scraper.scrape(**job)
  File "scrapers/pvote.py", line 118, in scrape
    url, root = getXML(term, date)
  File "scrapers/pvote.py", line 102, in getXML
    return _get(url_templates[template], term,_date)
  File "scrapers/pvote.py", line 94, in _get
    xml = fromstring(raw)
  File "src/lxml/etree.pyx", line 3222, in lxml.etree.fromstring
  File "src/lxml/parser.pxi", line 1877, in lxml.etree._parseMemoryDocument
  File "src/lxml/parser.pxi", line 1765, in lxml.etree._parseDoc
  File "src/lxml/parser.pxi", line 1127, in lxml.etree._BaseParser._parseDoc
  File "src/lxml/parser.pxi", line 601, in lxml.etree._ParserContext._handleParseResultDoc
  File "src/lxml/parser.pxi", line 711, in lxml.etree._handleParseResult
  File "src/lxml/parser.pxi", line 651, in lxml.etree._raiseParseError
  File "", line 0
lxml.etree.XMLSyntaxError: 
2019-07-09T03:59:28.909527pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-09T03:59:28.911454pvoteerrorcould not get votes for 9 2019-07-03
2019-07-09T03:59:29.162979pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-09T03:59:29.165257pvoteerrorcould not get votes for 9 2019-07-03
2019-07-09T03:59:29.346381pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-09T03:59:29.347877pvoteerrorcould not get votes for 9 2019-07-03