BETA

Summary for scraper logs from the 2021-04-07

Summary of log messages

LevelCount
Exceptions1
error80
warning67
info41850
debug179252

Summary of changes

TypeAddedUpdated
mep 0 11
dossier 0 6
amendment 25990 0
mep_activity 701 0
comagenda 67 0

Dossier events without known bodies

EventCount
"Committee report tabled for plenary"47

Unknown MEPs

EventCount
TANNOCK Charles1
Evelyn1

Log Entries

TimeModuleLevelMessage
2021-04-07T00:15:16.243653dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-04-07T00:15:24.165658dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-04-07T00:15:26.734667dossiererrorno mepid found for "TANNOCK Charles"
2021-04-07T00:15:35.574426dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-04-07T00:15:42.457006dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-04-07T00:15:47.766443dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-04-07T00:15:51.790833dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-04-07T00:16:42.013539dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-04-07T00:16:45.784282dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-04-07T00:17:36.062344dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-04-07T00:17:42.566044dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-04-07T00:17:47.265193dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-04-07T00:17:47.274732dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-04-07T00:17:47.811390dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-04-07T00:18:31.211001dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-04-07T00:18:31.264439dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-04-07T00:18:32.186728dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-04-07T00:19:07.967689dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-04-07T00:19:24.639721dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-04-07T00:20:26.253040dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-04-07T00:20:56.489738dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-04-07T00:21:01.080767dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-04-07T00:21:06.878390dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:06.916132dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:06.958858dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-04-07T00:21:12.127641dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-04-07T00:21:12.661047dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-04-07T00:21:21.444159dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-04-07T00:21:22.872513dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-04-07T00:21:23.008730dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-04-07T00:21:24.280177dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-04-07T00:21:24.304709dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-04-07T00:21:24.326160dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-04-07T00:21:24.330964dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-04-07T00:21:24.348762dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-04-07T00:21:24.362163dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-04-07T00:21:24.415122dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-04-07T00:21:24.554451dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-04-07T00:21:25.087832dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-04-07T00:21:25.195669dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-04-07T00:21:25.560420dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-04-07T00:21:25.834915dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-04-07T00:21:25.843281dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-04-07T00:21:26.071470dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-04-07T00:21:26.091425dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-04-07T00:21:26.098392dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-04-07T00:21:26.099660dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-04-07T00:21:26.366406dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-04-07T00:21:26.449035dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-04-07T00:21:34.896401dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:41.692026dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-04-07T00:21:41.695766dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-04-07T00:21:47.176636dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:48.623866dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:48.632027dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:48.639062dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:48.645698dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:48.674187dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:50.221632dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:50.243909dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:50.257376dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:50.273738dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:51.996084dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:52.010367dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:52.028983dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:52.039910dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.827123dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.829663dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.841550dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.884631dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.919403dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.940402dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:53.955374dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:56.002276dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:56.031709dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:56.064300dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:56.095683dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:56.181891dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.841966dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.856363dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.870857dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.881762dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.935686dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.961819dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:57.969798dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:59.856512dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:59.938353dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:59.945430dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:21:59.953736dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:01.158293dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:01.202241dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:06.300520dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:11.816211dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:12.120766dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-04-07T00:22:12.453052dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-04-07T00:22:21.305357dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:26.979158dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-04-07T00:22:31.248490dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:22:41.105160dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-07T00:24:31.152534amendmenterror[!] couldn't find ref: Committee on Development
2021-04-07T00:25:50.134708amendmenterror[!] couldn't find ref: Committee on International Trade
2021-04-07T00:25:55.973535amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-07T00:25:55.981647amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689785_EN.pdf
2021-04-07T00:26:03.440011amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-07T00:26:03.456010amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689510_EN.pdf
2021-04-07T00:26:26.952763amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-04-07T00:26:26.953021amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-04-07T00:26:56.709464amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-04-07T00:26:56.714799amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-04-07T00:27:15.888414dbwarningno mepid found for "Evelyn"
2021-04-07T00:27:30.091650amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2021-04-07T00:27:50.792125mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T00:28:50.666684amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-04-07T00:28:50.673837amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-04-07T00:29:03.055245amendmentwarningno table
Proposal for a directive
Annex I – point 2
Directive 2004/37/EC
Annex III – Point A – rows 2 a (new) and 2 b(new)

 Text proposed by the Commisson
 Name of agent                             Limit values / 8              Notation
                                           hours
 …                                         …                             …
 …                                         …

 Amendment

 Name of agent                             Limit values / 8              Notation
                                           hours
 Cobalt                                    0,0005(9a)                    Derma and
                                                                         respiratory
 Cobalt compounds                          0,001 (10a)
                                                                         sensitisation 11
                                           _____________                 ________________
                                           9a Respirable                 11 The substance can
                                           fraction,                     cause sensitisation of
                                           measured as                   the skin and of the
                                           cobalt                        respiratory tract.
                                           10a Inhalable
                                           fraction,
                                           measured as
                                           cobalt
2021-04-07T00:30:23.026053amendmenterror[!] couldn't find ref: Committee on Transport and Tourism
2021-04-07T00:30:23.101111amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/TRAN-AM-680950_EN.pdf
2021-04-07T00:31:09.916248amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-04-07T00:31:09.943015amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-680976_EN.pdf
2021-04-07T00:31:43.051792amendmenterror[!] couldn't find ref: Committee on Fisheries
2021-04-07T00:31:43.084661amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PECH-AM-658791_EN.pdf
2021-04-07T00:31:56.404474amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-07T00:31:56.404740amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-04-07T00:32:00.620180amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-07T00:32:27.978125amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-07T00:32:29.852236amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-07T00:33:01.975791amendmenterror[!] couldn't find ref: Committee on Petitions
2021-04-07T00:33:01.976467amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-04-07T00:46:43.891068mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-04-07T00:46:43.908909mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-04-07T00:55:52.186699mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:02:30.799490mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:02:31.816733mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:05:06.866550mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:05:49.146193mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:08:08.582972mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:08:09.058943mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:14:37.621372mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:19:01.798076mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:21:17.021035mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:23:21.771419mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:23:57.682543mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:24:37.071742mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:25:49.643246mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:31:40.909884mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:32:40.496881mep_activitywarningpe, has not expected format: 'Commission'
2021-04-07T01:41:42.772698mep_activitywarningpe, has not expected format: 'Commission'