BETA

Summary for scraper logs from the 2021-04-08

Summary of log messages

LevelCount
Exceptions1
error83
warning72
info41641
debug179129

Summary of changes

TypeAddedUpdated
mep 0 16
dossier 0 13
amendment 25820 0
mep_activity 701 0
comagenda 15 0

Dossier events without known bodies

EventCount
"Committee report tabled for plenary"52

Unknown MEPs

EventCount
TANNOCK Charles1
Jan-1

Log Entries

TimeModuleLevelMessage
2021-04-08T00:15:21.263597dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-04-08T00:15:28.365364dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-04-08T00:15:30.020408dossiererrorno mepid found for "TANNOCK Charles"
2021-04-08T00:15:39.914306dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-04-08T00:15:46.548918dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-04-08T00:15:51.470723dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-04-08T00:15:55.218400dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-04-08T00:16:44.702936dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-04-08T00:16:47.765870dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-04-08T00:17:36.219780dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-04-08T00:17:43.307924dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-04-08T00:17:48.632967dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-04-08T00:17:48.636544dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-04-08T00:17:48.953068dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-04-08T00:18:30.441120dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-04-08T00:18:30.694459dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-04-08T00:18:31.613422dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-04-08T00:19:07.886890dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-04-08T00:19:24.990065dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-04-08T00:20:26.685341dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-04-08T00:20:59.611535dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-04-08T00:21:02.407927dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-04-08T00:21:07.605844dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:08.327570dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-04-08T00:21:09.106863dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:14.321602dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-04-08T00:21:15.340194dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-04-08T00:21:23.698282dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-04-08T00:21:25.287957dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-04-08T00:21:25.506046dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-04-08T00:21:25.732733dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-04-08T00:21:26.100779dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-04-08T00:21:26.354495dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-04-08T00:21:26.366160dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-04-08T00:21:26.406276dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:26.442330dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-04-08T00:21:26.447247dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-04-08T00:21:26.506661dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-04-08T00:21:26.618664dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-04-08T00:21:26.798240dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-04-08T00:21:27.159348dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-04-08T00:21:27.538299dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-04-08T00:21:27.699566dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-04-08T00:21:27.862042dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-04-08T00:21:27.903715dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-04-08T00:21:27.982803dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-04-08T00:21:27.997188dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-04-08T00:21:28.020898dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-04-08T00:21:28.282462dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-04-08T00:21:28.499714dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-04-08T00:21:38.178293dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:43.646685dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-04-08T00:21:44.067927dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-04-08T00:21:49.146110dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:50.544112dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:50.599963dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:50.950385dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:50.959166dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:51.148632dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:51.174043dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:52.791748dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:52.872320dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:52.879498dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:52.912053dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.767339dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.829631dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.836042dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.882599dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.898402dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.908454dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:54.923154dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:55.297498dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:57.336619dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:57.355474dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:57.363119dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:57.373277dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:57.375559dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:57.437763dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:59.458947dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:59.475327dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:59.479011dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:59.486572dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:59.500303dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:21:59.505851dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.315147dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.325764dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.362202dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.414890dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.434931dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.449821dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:01.450058dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:03.001541dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:03.047549dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:03.095703dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:03.101736dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:03.149783dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:08.209134dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:13.148085dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:13.754465dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-04-08T00:22:14.382471dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-04-08T00:22:24.610946dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:29.816926dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-04-08T00:22:34.475560dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:22:43.323640dossierwarningno body mapping found for "Committee report tabled for plenary"
2021-04-08T00:24:31.738162amendmenterror[!] couldn't find ref: Committee on Development
2021-04-08T00:25:51.016833amendmenterror[!] couldn't find ref: Committee on International Trade
2021-04-08T00:25:57.030075amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-08T00:25:57.041685amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689785_EN.pdf
2021-04-08T00:26:04.504357amendmenterror[!] couldn't find ref: Committee on Budgets
2021-04-08T00:26:04.504780amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/BUDG-AM-689510_EN.pdf
2021-04-08T00:26:30.018215amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-04-08T00:26:30.018884amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-04-08T00:26:59.741227amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-04-08T00:27:02.390435amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-04-08T00:27:02.417888amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-04-08T00:27:32.089857amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2021-04-08T00:27:51.586487mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T00:28:44.403571amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-04-08T00:28:44.404052amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-04-08T00:28:50.187347amendmentwarningno table
Proposal for a directive
Annex I – point 2
Directive 2004/37/EC
Annex III – Point A – rows 2 a (new) and 2 b(new)

 Text proposed by the Commisson
 Name of agent                             Limit values / 8              Notation
                                           hours
 …                                         …                             …
 …                                         …

 Amendment

 Name of agent                             Limit values / 8              Notation
                                           hours
 Cobalt                                    0,0005(9a)                    Derma and
                                                                         respiratory
 Cobalt compounds                          0,001 (10a)
                                                                         sensitisation 11
                                           _____________                 ________________
                                           9a Respirable                 11 The substance can
                                           fraction,                     cause sensitisation of
                                           measured as                   the skin and of the
                                           cobalt                        respiratory tract.
                                           10a Inhalable
                                           fraction,
                                           measured as
                                           cobalt
2021-04-08T00:30:03.543960dbwarningno mepid found for "Jan-"
2021-04-08T00:30:17.396234amendmenterror[!] couldn't find ref: Committee on Transport and Tourism
2021-04-08T00:30:17.396616amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/TRAN-AM-680950_EN.pdf
2021-04-08T00:31:05.688696amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-04-08T00:31:05.743060amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/AGRI-AM-680976_EN.pdf
2021-04-08T00:31:32.185511amendmenterror[!] couldn't find ref: Committee on Fisheries
2021-04-08T00:31:32.192364amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PECH-AM-658791_EN.pdf
2021-04-08T00:31:47.395803amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-08T00:31:47.425859amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-04-08T00:31:49.626758amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-04-08T00:32:17.169669amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-08T00:32:17.222573amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-04-08T00:32:46.492653amendmenterror[!] couldn't find ref: Committee on Petitions
2021-04-08T00:32:46.493590amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-04-08T00:43:06.083091mep_activityerrorfailed to fetch http://www.europarl.europa.eu/meps/en/124929/loadmore-activities/written-explanations/9/?page=20&count=20
2021-04-08T00:46:33.907401mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-04-08T00:46:33.909670mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-04-08T00:55:19.440950mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T00:55:40.559386mep_activityerrorfailed to fetch http://www.europarl.europa.eu/meps/en/24505/loadmore-activities/written-explanations/9/?page=14&count=20
2021-04-08T01:01:26.370842mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:01:26.526920mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:03:48.176331mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:04:37.452593mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:06:51.943095mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:06:52.361829mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:12:38.100794mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:17:32.118738mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:20:03.282325mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:21:34.403878mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:22:39.769640mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:23:17.247746mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:24:25.314246mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:30:15.485144mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:31:10.256907mep_activitywarningpe, has not expected format: 'Commission'
2021-04-08T01:40:17.562697mep_activitywarningpe, has not expected format: 'Commission'