BETA

Summary for scraper logs from the 2021-04-06

Summary of log messages

LevelCount
Exceptions1
error80
warning66
info41526
debug178707

Summary of changes

TypeAddedUpdated
mep 0 4
amendment 25744 0
mep_activity 701 0

Dossier events without known bodies

EventCount
"Committee report tabled for plenary"47

Unknown MEPs

EventCount
TANNOCK Charles1

Log Entries

TimeModuleLevelMessage
2021-04-06T00:15:07.638276dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-04-06T00:15:14.241913dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-04-06T00:15:16.090550dossiererrorno mepid found for "TANNOCK Charles"
2021-04-06T00:15:27.046142dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-04-06T00:15:32.281393dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-04-06T00:15:39.424671dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-04-06T00:15:41.763115dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-04-06T00:16:32.956474dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-04-06T00:16:36.699502dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-04-06T00:17:24.904168dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-04-06T00:17:31.963974dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-04-06T00:17:36.936512dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-04-06T00:17:37.080036dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-04-06T00:17:37.325397dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-04-06T00:18:18.975170dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-04-06T00:18:19.756481dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-04-06T00:18:20.365897dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-04-06T00:18:57.367198dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-04-06T00:19:13.286267dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-04-06T00:20:15.525753dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-04-06T00:20:45.714595dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-04-06T00:20:50.407750dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-04-06T00:20:56.596495dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:20:56.603271dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:20:56.764321dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-04-06T00:21:01.736259dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-04-06T00:21:03.314705dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-04-06T00:21:11.587668dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-04-06T00:21:11.956496dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-04-06T00:21:13.107757dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-04-06T00:21:13.288848dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-04-06T00:21:13.426871dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-04-06T00:21:13.537001dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-04-06T00:21:13.772898dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-04-06T00:21:13.857040dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-04-06T00:21:13.883471dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-04-06T00:21:14.233114dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-04-06T00:21:14.246152dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-04-06T00:21:14.754997dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-04-06T00:21:14.883515dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-04-06T00:21:15.107889dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-04-06T00:21:15.265867dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-04-06T00:21:15.410624dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-04-06T00:21:15.512647dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-04-06T00:21:15.743724dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-04-06T00:21:15.745014dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-04-06T00:21:15.796955dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-04-06T00:21:15.853192dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-04-06T00:21:15.993031dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-04-06T00:21:25.372906dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:33.187424dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-04-06T00:21:33.325117dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-04-06T00:21:38.159068dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:40.189478dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:40.231246dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:40.242727dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:40.245538dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:40.253909dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:42.946133dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:42.962355dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:42.999453dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:43.001251dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:43.013054dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:43.019312dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.847550dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.853549dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.858113dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.867216dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.874960dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.896382dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:44.913625dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:46.691177dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:46.737693dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:46.750304dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:46.777890dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:46.799822dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:47.175989dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:48.866259dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:48.882947dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:48.891530dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:48.907428dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:48.926360dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:48.966077dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:50.942570dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:51.013565dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:51.053268dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:51.062124dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:51.075560dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:52.989322dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:53.025792dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:53.037831dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:21:58.234019dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:22:03.113298dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:22:03.493167dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-04-06T00:22:03.736112dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-04-06T00:22:12.460420dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:22:17.381684dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-04-06T00:22:22.222496dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:22:31.068633dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-06T00:24:19.661126amendmenterror[!] couldn't find ref: Committee on Development
2021-04-06T00:25:43.209504amendmenterror[!] couldn't find ref: Committee on International Trade
2021-04-06T00:25:47.874580amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-06T00:25:47.883072amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689785_EN.pdf
2021-04-06T00:25:54.449943amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-06T00:25:54.450205amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689510_EN.pdf
2021-04-06T00:26:15.943215amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-04-06T00:26:16.015390amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-04-06T00:26:45.038211amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-04-06T00:26:45.038898amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-04-06T00:27:14.275815amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2021-04-06T00:27:34.819124mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T00:28:33.673500amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-04-06T00:28:33.674983amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-04-06T00:28:41.644320amendmentwarningno table
Proposal for a directive
Annex I – point 2
Directive 2004/37/EC
Annex III – Point A – rows 2 a (new) and 2 b(new)

 Text proposed by the Commisson
 Name of agent                             Limit values / 8              Notation
                                           hours
 …                                         …                             …
 …                                         …

 Amendment

 Name of agent                             Limit values / 8              Notation
                                           hours
 Cobalt                                    0,0005(9a)                    Derma and
                                                                         respiratory
 Cobalt compounds                          0,001 (10a)
                                                                         sensitisation 11
                                           _____________                 ________________
                                           9a Respirable                 11 The substance can
                                           fraction,                     cause sensitisation of
                                           measured as                   the skin and of the
                                           cobalt                        respiratory tract.
                                           10a Inhalable
                                           fraction,
                                           measured as
                                           cobalt
2021-04-06T00:30:02.479818amendmenterror[!] couldn't find ref: Committee on Transport and Tourism
2021-04-06T00:30:02.480363amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/TRAN-AM-680950_EN.pdf
2021-04-06T00:30:51.249080amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-04-06T00:30:51.249411amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-680976_EN.pdf
2021-04-06T00:31:15.473506amendmenterror[!] couldn't find ref: Committee on Fisheries
2021-04-06T00:31:15.499685amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PECH-AM-658791_EN.pdf
2021-04-06T00:31:31.313907amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-06T00:31:31.329869amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-04-06T00:31:36.748643amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-06T00:31:57.325519amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-06T00:31:59.934638amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-06T00:32:29.305716amendmenterror[!] couldn't find ref: Committee on Petitions
2021-04-06T00:32:29.308910amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-04-06T00:46:10.875603mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-04-06T00:46:10.884340mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-04-06T00:55:15.258728mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:01:51.918436mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:01:52.385627mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:04:12.750583mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:04:59.989516mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:07:38.423639mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:07:38.731053mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:13:09.764704mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:18:34.801740mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:20:57.684869mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:22:55.736233mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:23:23.572757mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:24:15.302730mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:25:20.136076mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:31:06.575945mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:32:01.730489mep_activitywarningpe, has not expected format: 'Commission'
2021-04-06T01:40:30.110372mep_activitywarningpe, has not expected format: 'Commission'