BETA

Summary for scraper logs from the 2021-04-05

Summary of log messages

LevelCount
Exceptions1
error80
warning66
info41518
debug178740

Summary of changes

TypeAddedUpdated
amendment 25744 0
mep_activity 701 0

Dossier events without known bodies

EventCount
"Committee report tabled for plenary"47

Unknown MEPs

EventCount
TANNOCK Charles1

Log Entries

TimeModuleLevelMessage
2021-04-05T00:15:30.752725dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-04-05T00:15:37.122642dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-04-05T00:15:39.195962dossiererrorno mepid found for "TANNOCK Charles"
2021-04-05T00:15:49.527926dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-04-05T00:15:56.008480dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-04-05T00:16:02.077058dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-04-05T00:16:06.072724dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-04-05T00:16:57.660075dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-04-05T00:17:00.846343dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-04-05T00:17:53.020038dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-04-05T00:17:59.852612dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-04-05T00:18:04.545985dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-04-05T00:18:04.546814dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-04-05T00:18:04.841234dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-04-05T00:18:46.482924dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-04-05T00:18:47.658396dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-04-05T00:18:48.674107dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-04-05T00:19:23.929992dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-04-05T00:19:40.376013dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-04-05T00:20:41.219497dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-04-05T00:21:11.912238dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-04-05T00:21:15.440683dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-04-05T00:21:21.810782dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:21:21.814829dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:21:22.315216dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-04-05T00:21:27.236112dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-04-05T00:21:28.199641dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-04-05T00:21:36.939657dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-04-05T00:21:37.339247dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-04-05T00:21:38.753639dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-04-05T00:21:38.791364dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-04-05T00:21:38.820827dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-04-05T00:21:39.194284dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-04-05T00:21:39.240324dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-04-05T00:21:39.305770dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-04-05T00:21:39.632920dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-04-05T00:21:39.633291dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-04-05T00:21:39.642741dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-04-05T00:21:40.194419dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-04-05T00:21:40.261822dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-04-05T00:21:40.765787dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-04-05T00:21:40.920494dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-04-05T00:21:41.043383dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-04-05T00:21:41.240868dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-04-05T00:21:41.241924dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-04-05T00:21:41.257843dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-04-05T00:21:41.259470dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-04-05T00:21:41.776882dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-04-05T00:21:41.864270dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-04-05T00:21:50.262077dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:21:57.311507dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-04-05T00:21:57.313995dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-04-05T00:22:02.338649dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:03.894846dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:03.914926dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:03.936460dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:03.960657dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:05.510326dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:05.560490dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:05.573854dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:05.589150dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:07.379364dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:07.409192dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:07.421980dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:07.441191dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:07.481963dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:07.728646dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.368437dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.401919dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.435978dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.461967dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.467478dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.484531dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:09.496393dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:11.469311dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:11.565832dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:11.577688dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:11.608289dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:11.661504dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:13.526753dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:13.560370dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:13.586617dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:13.651392dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:13.652954dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:13.653780dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:15.578414dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:15.929390dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:15.970658dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:15.993767dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:16.004184dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:17.689709dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:22.091955dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:26.610093dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:26.958473dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-04-05T00:22:27.206646dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-04-05T00:22:36.695668dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:42.116048dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-04-05T00:22:47.007517dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:22:55.700911dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-05T00:24:40.765363amendmenterror[!] couldn't find ref: Committee on Development
2021-04-05T00:26:03.938075amendmenterror[!] couldn't find ref: Committee on International Trade
2021-04-05T00:26:10.555510amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-05T00:26:10.556042amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689785_EN.pdf
2021-04-05T00:26:18.047633amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-05T00:26:18.048958amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689510_EN.pdf
2021-04-05T00:26:42.468517amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-04-05T00:26:42.468787amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-04-05T00:27:18.347352amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-04-05T00:27:18.347971amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-04-05T00:27:48.166023amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2021-04-05T00:27:55.306813mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T00:29:05.600981amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-04-05T00:29:05.602737amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-04-05T00:29:09.839273amendmentwarningno table
Proposal for a directive
Annex I – point 2
Directive 2004/37/EC
Annex III – Point A – rows 2 a (new) and 2 b(new)

 Text proposed by the Commisson
 Name of agent                             Limit values / 8              Notation
                                           hours
 …                                         …                             …
 …                                         …

 Amendment

 Name of agent                             Limit values / 8              Notation
                                           hours
 Cobalt                                    0,0005(9a)                    Derma and
                                                                         respiratory
 Cobalt compounds                          0,001 (10a)
                                                                         sensitisation 11
                                           _____________                 ________________
                                           9a Respirable                 11 The substance can
                                           fraction,                     cause sensitisation of
                                           measured as                   the skin and of the
                                           cobalt                        respiratory tract.
                                           10a Inhalable
                                           fraction,
                                           measured as
                                           cobalt
2021-04-05T00:30:35.615768amendmenterror[!] couldn't find ref: Committee on Transport and Tourism
2021-04-05T00:30:35.634680amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/TRAN-AM-680950_EN.pdf
2021-04-05T00:31:24.753479amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-04-05T00:31:24.790227amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-680976_EN.pdf
2021-04-05T00:31:57.832738amendmenterror[!] couldn't find ref: Committee on Fisheries
2021-04-05T00:31:57.866533amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PECH-AM-658791_EN.pdf
2021-04-05T00:32:16.355111amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-05T00:32:16.396595amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-04-05T00:32:20.608859amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-05T00:32:39.474409amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-05T00:32:41.860766amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-05T00:33:12.183303amendmenterror[!] couldn't find ref: Committee on Petitions
2021-04-05T00:33:12.202883amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-04-05T00:46:47.681828mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-04-05T00:46:47.684816mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-04-05T00:56:09.571466mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:02:20.415602mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:02:21.033182mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:04:35.461825mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:05:28.438331mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:07:42.818592mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:07:43.321030mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:13:21.033202mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:17:52.247446mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:20:23.042425mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:22:08.189054mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:22:42.582234mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:23:21.610063mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:24:25.081791mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:30:20.787588mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:31:13.059975mep_activitywarningpe, has not expected format: 'Commission'
2021-04-05T01:40:18.762276mep_activitywarningpe, has not expected format: 'Commission'