BETA

Summary for scraper logs from the 2019-07-11

Summary of log messages

LevelCount
Exceptions1
error27
warning42
info72603
debug594702

Summary of changes

TypeAddedUpdated
mep 0 118
dossier 1 42
mep_activity 748 0
comagenda 0 1136

Dossier events without known bodies

EventCount

Unknown MEPs

EventCount
PIETIKÄINEN Sirpa7
SASSOLI David-Maria1
Nart Peñalver1
PUNSET BANNEL1
Ceballos1
Solé I Ferrando1

Log Entries

TimeModuleLevelMessage
2019-07-11T00:33:55.425674_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/189525_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:34:00.287931_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197836_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:34:02.053055_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197848_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:34:11.848326_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125110_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:34:21.385536_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197695_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:34:21.591775_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197701_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:36:04.588745_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/26837_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:37:01.937532_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124873_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:37:41.148125_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197414_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:38:06.370685_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197819_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:39:36.500315_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125109_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:39:38.674490_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197839_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:39:47.248336_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125068_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:39:54.386383_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197415_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:02.398507_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197740_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:06.664415_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/130833_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:08.928761_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197699_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:23.710506_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197692_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:26.417451_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125063_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:26.496704_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197737_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:40:26.643419_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124866_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:41:29.018147_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/98341_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:41:29.685013_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/124691_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:41:45.742347_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/125128_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:42:22.105880_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197734_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:42:36.202523_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/124692_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:42:37.947071_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/28586_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:42:50.385666_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197845_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:43:16.827387_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124850_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:44:20.996034_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197849_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:44:29.211630_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125064_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:44:30.599131_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124852_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:44:54.540280meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-07-11T00:45:32.036325_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197747_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:45:41.845680_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197844_DFI_LEG9_rev0_BG.pdf
2019-07-11T00:45:48.203136_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125065_DFI_LEG9_rev0_EL.pdf
2019-07-11T00:47:11.928138dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-07-11T00:47:42.052763dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:47:58.599294dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-07-11T00:47:59.936071dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:48:03.983618dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-07-11T00:48:34.359230dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:49:08.368802dossiererrorno mepid found for "SASSOLI David-Maria"
2019-07-11T00:49:29.929547dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-07-11T00:51:05.356590dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-07-11T00:51:14.003122dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-07-11T00:51:24.517487dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-07-11T00:51:24.618259dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-07-11T00:51:26.556460dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-07-11T00:52:45.368245dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-07-11T00:52:45.777615dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-07-11T00:52:47.133078dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-07-11T00:53:54.276736dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:55:06.687226dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:55:08.191805dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:55:17.269740dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-07-11T00:55:55.275222dossiererrorno mepid found for "PIETIKÄINEN Sirpa"
2019-07-11T00:58:00.501666mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2028(BUD)&l=en'} (ValueError('not enough values to unpack (expected 2, got 1)'))
2019-07-11T00:58:00.563623mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 64, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 71, in scrape
    'committees': scrape_ep_key_players(root),
  File "scrapers/dossier.py", line 250, in scrape_ep_key_players
    (abbr, group) = toGroup(x.xpath('./preceding-sibling::span/span[@class="tiptip"]/@title')[-1])
  File "scrapers/dossier.py", line 642, in toGroup
    _, group = txt.split(' - ', 1)
ValueError: not enough values to unpack (expected 2, got 1)
2019-07-11T01:06:05.832741dbwarningno mepid found for "Nart Peñalver"
2019-07-11T01:06:05.904998dbwarningno mepid found for "PUNSET BANNEL"
2019-07-11T01:06:09.255636dbwarningno mepid found for "Ceballos"
2019-07-11T01:06:09.444210dbwarningno mepid found for "Solé I Ferrando"
2019-07-11T03:15:52.592564pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-11T03:15:52.601371pvoteerrorcould not get votes for 9 2019-07-03
2019-07-11T03:15:52.795375pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-11T03:15:52.796211pvoteerrorcould not get votes for 9 2019-07-03
2019-07-11T03:15:52.891454pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-11T03:15:52.893972pvoteerrorcould not get votes for 9 2019-07-03