BETA

Summary for scraper logs from the 2019-07-14

Summary of log messages

LevelCount
Exceptions1
error19
warning41
info68898
debug180120

Summary of changes

TypeAddedUpdated
mep 0 69
dossier 0 30
mep_activity 135 0
TimeModuleLevelMessage
2019-07-14T01:39:07.120537_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/189525_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:39:07.928684_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197747_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:39:13.858535_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197836_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:39:17.118358_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197848_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:39:24.431104_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125110_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:39:35.707078_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197701_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:39:37.989758_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197695_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:41:14.359274_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/26837_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:42:17.641503_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124873_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:43:01.527743_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197414_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:43:26.175725_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197819_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:44:57.509340_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125109_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:00.105189_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197839_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:45:08.656954_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125068_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:14.819481_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197415_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:25.031974_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197743_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:29.187100_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197740_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:30.993279_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/130833_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:34.801936_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197699_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:43.866035_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197692_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:45.912179_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197737_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:47.639080_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125063_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:45:47.908185_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124866_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:46:57.319327_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/98341_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:46:57.380925_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/124691_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:47:01.540195_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197662_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:47:09.599948_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/125128_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:47:45.277975_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/197734_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:48:00.761803_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/124692_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:48:02.275340_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/28586_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:48:16.740807_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197845_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:48:46.345901_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124850_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:49:53.984316_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197849_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:50:00.414814_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125064_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:50:01.333510_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/124852_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:50:22.062210meperrorfailed to extract findecl from http://www.europarl.europa.eu/mepdif/197599_DFI_LEG9_rev0_EN.pdf
2019-07-14T01:51:13.007244_findeclwarningdid not reach final state 0 in http://www.europarl.europa.eu/mepdif/197844_DFI_LEG9_rev0_BG.pdf
2019-07-14T01:51:20.897864_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125065_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:51:44.921869_findeclwarningdid not reach final state 2 in http://www.europarl.europa.eu/mepdif/125067_DFI_LEG9_rev0_EL.pdf
2019-07-14T01:52:43.526755dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2019-07-14T01:53:32.115098dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2019-07-14T01:53:39.078477dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2019-07-14T01:55:00.741294dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2019-07-14T01:56:33.080222dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2019-07-14T01:56:42.063448dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2019-07-14T01:56:50.660339dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2019-07-14T01:56:50.665936dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2019-07-14T01:56:51.915581dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2019-07-14T01:57:57.537255dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2019-07-14T01:57:58.969220dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2019-07-14T01:57:59.135354dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2019-07-14T02:00:19.927662dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2019-07-14T02:02:57.719934mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0806(CNS)&l=en'} (KeyError('Group of Progressive Alliance of Socialists and Democrats'))
2019-07-14T02:02:57.752384mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 71, in scrape
    'committees': scrape_ep_key_players(root),
  File "scrapers/dossier.py", line 250, in scrape_ep_key_players
    (abbr, group) = toGroup(x.xpath('./preceding-sibling::span/span[@class="tiptip"]/@title')[-1])
  File "scrapers/dossier.py", line 649, in toGroup
    return GROUP_MAP[group], group
KeyError: 'Group of Progressive Alliance of Socialists and Democrats'
2019-07-14T04:05:02.798578pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-14T04:05:02.803090pvoteerrorcould not get votes for 9 2019-07-03
2019-07-14T04:05:02.992495pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-14T04:05:02.996773pvoteerrorcould not get votes for 9 2019-07-03
2019-07-14T04:05:03.103326pvotewarningstill no xml for plenary votes at (9, 2019-07-03)
2019-07-14T04:05:03.105411pvoteerrorcould not get votes for 9 2019-07-03