2024-12-23T00:36:00.608273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:00.608999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:00.878133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:01.150674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:01.151680 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:36:01.318393 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:01.318975 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:36:02.082861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:03.165118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:03.286594 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:03.380517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:04.000439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:04.702548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:05.021448 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en |
2024-12-23T00:36:05.410150 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:05.843411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:05.844873 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:05.997825 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:05.998581 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2024-12-23T00:36:06.629951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:06.834681 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:07.776016 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:07.840458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:08.724983 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:08.726778 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2024-12-23T00:36:09.911135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:10.304882 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:10.452562 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:10.454346 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:11.252030 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:11.525494 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:12.457284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:12.832367 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en |
2024-12-23T00:36:12.841256 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:13.080735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:13.551675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:14.016312 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:14.087243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:21.013818 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:21.016558 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:21.018589 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:21.020696 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:21.023288 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:21.031535 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:23.282784 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:28.379613 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:28.380482 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:28.813580 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:28.816994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:28.818349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:30.683400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:30.750388 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:30.754299 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:30.755659 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:36:30.838606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:31.291867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:31.685736 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:31.909929 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:31.910805 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2024-12-23T00:36:32.742292 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:33.036246 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:33.562526 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:33.635928 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:33.638702 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:33.645368 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:34.081881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:35.058802 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:35.139461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:35.140318 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:36:35.265470 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:35.943086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:35.943669 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 4.0 month(s)" |
2024-12-23T00:36:36.199319 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:36.202219 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:36.540998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:37.314180 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:37.506323 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:37.759118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:37.760307 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:36:37.927178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:38.226643 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:38.556683 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en |
2024-12-23T00:36:38.680117 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:38.718049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:39.160993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:39.516138 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:40.519352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:40.868585 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:40.871120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:41.403514 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:41.727571 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:36:41.728273 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0212(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:36:41.729777 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:36:41.735539 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:43.053129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:43.111667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:43.119782 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en |
2024-12-23T00:36:43.830981 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:45.107636 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:45.198017 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:46.662000 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:46.885477 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:36:46.886018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:46.886658 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0273(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:36:46.888145 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:36:47.484616 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:47.735495 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:47.961007 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:47.962051 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:36:47.963503 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:36:47.965134 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:36:47.965957 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:36:49.090116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:49.091385 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:36:49.092735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:49.476265 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en |
2024-12-23T00:36:50.099561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:50.100193 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:36:50.321111 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:36:50.321809 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:36:50.529232 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:50.879390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:51.480692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:51.566607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:52.276955 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:52.455407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:53.105045 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:53.106540 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:53.111222 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:53.415302 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en |
2024-12-23T00:36:53.797596 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:53.876728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:55.059673 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:55.512179 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:55.668852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:56.001471 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:57.447011 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:57.942173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:57.943074 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:36:58.087098 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:58.088749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:36:59.294607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:36:59.467911 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:00.230171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:00.230905 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:00.470626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:00.471442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:00.637976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:00.913777 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:01.176413 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2012/0164(APP)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257')) |
2024-12-23T00:37:01.178024 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 84, in scrape
docs = scrape_docs(root, edocs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 614, in scrape_docs
doc['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257 |
2024-12-23T00:37:02.481130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:02.932270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:02.976164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:02.997097 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:02.997851 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:37:03.567672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:03.800908 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:03.801641 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:37:04.384595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:04.518425 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:04.519044 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:04.623126 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:05.261621 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:05.382684 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:05.385883 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:05.841748 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:06.075192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:06.682960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:06.684308 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:06.841359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:06.842176 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:37:07.484652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:07.771659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:08.302162 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:08.304260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:08.306893 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:08.312729 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:08.669978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:09.323188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:09.401940 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:09.714017 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:10.230863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:10.501884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:11.034250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:11.152832 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:11.327261 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:11.327910 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:11.536983 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:11.537726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:11.855523 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:12.114536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:12.637650 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:12.949051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:13.332482 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:13.441054 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:13.588644 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:13.966310 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:14.272216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:14.446130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:14.868925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:15.189726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:15.502253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:15.789677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:16.599350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:16.600211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:16.991614 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:17.225574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:17.558873 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:17.886619 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:18.187614 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:18.188529 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2024-12-23T00:37:18.415657 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:18.864828 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:19.294528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:19.295237 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:19.385546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:19.690235 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:19.756167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:19.759507 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:19.760356 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:20.088519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:20.647066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:20.648346 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:20.649502 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:21.003940 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:21.591017 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:21.874788 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:22.047339 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:22.277420 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:22.283085 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:22.775622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:22.938156 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:23.433260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:23.717196 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:24.365475 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:24.550228 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:24.979565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:25.338595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:25.484927 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:25.842561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:25.982165 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:25.988921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:27.210273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:27.302811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:27.305640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:27.306995 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:27.483264 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:27.820879 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:27.821590 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:28.116805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:28.117612 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:28.265473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:28.266260 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:28.618042 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:28.618991 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:29.489852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:29.802461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:29.803268 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:30.005284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:30.240641 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:30.241723 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:30.243314 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:30.333543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:30.786805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:31.009891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:31.542365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:31.963147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:32.705668 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:32.709013 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:32.711553 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:32.713416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:32.715732 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:32.909885 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:32.911595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:33.835619 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:33.961214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:34.739298 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:34.966985 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:35.245367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:35.428151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:35.510845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:35.833246 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:36.193721 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:36.450909 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:36.809584 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:37.343116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:37.558797 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:37.792652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:38.047350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:38.047973 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:37:38.119536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:38.821740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:38.984359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:38.984939 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:39.337383 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:39.667845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:40.265012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:40.265875 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:40.594544 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:41.201286 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:41.491219 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:41.591027 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:41.878092 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:42.691391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:42.822451 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:42.823301 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:42.824047 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:43.792314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:43.793365 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:43.794767 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:43.795993 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:43.879392 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:44.154671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:44.334717 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:44.962611 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:44.963478 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:45.692804 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:46.485815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:46.488048 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:46.488883 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:46.490075 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:46.491319 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:46.640046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:47.209838 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:47.812242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:48.829718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:49.108014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:49.109738 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:49.110718 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:37:49.539922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:49.541459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:49.651775 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:50.226057 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:50.226887 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:50.298124 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:50.298947 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:51.048032 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:51.050365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:51.230821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:51.745396 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:52.070415 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:52.071051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:52.072928 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:37:52.467928 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:52.471238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:53.581416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:53.864719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:53.870058 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:53.870935 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:37:54.079530 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:37:54.156199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:37:54.612677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:54.832370 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:56.417374 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:56.664966 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:56.814626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:56.967715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:57.261862 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:57.269831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:58.540148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:58.653661 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:58.756256 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:58.816679 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:37:59.134586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:37:59.135713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:00.082219 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:00.094659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:00.095415 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:38:00.855860 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:00.856596 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:38:00.973114 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:01.055959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:01.202116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:01.205262 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:01.828359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:38:03.052502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:03.252378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:03.423297 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:03.424420 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:03.574215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:03.575205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:03.575935 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:38:04.220049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:04.844073 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0012(NLE)&l=en'} (ValueError()) |
2024-12-23T00:38:04.845231 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:38:05.475162 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:06.045583 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:06.049680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:13.159419 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:13.163763 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:13.165706 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:13.167837 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:38:13.170222 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:13.172361 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:13.175787 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2004/0148(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:38:13.184850 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:38:14.889913 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en |
2024-12-23T00:38:15.094892 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:15.422558 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:15.454360 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:15.690571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:15.691357 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2024-12-23T00:38:15.781065 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:15.912904 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:17.063718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:17.330903 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:17.582363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:17.601603 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en |
2024-12-23T00:38:17.658355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:17.745274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:18.583349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:18.695439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:19.206166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:19.924506 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:38:20.099503 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:20.182473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:20.392064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:38:20.392833 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:38:20.980836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:21.828482 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:22.084247 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:22.510394 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:22.952476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:23.369849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:24.258412 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:24.748041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:24.833220 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:24.985411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:24.986181 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:38:25.260204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:26.470439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:27.182605 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:27.237164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:38:28.912981 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:29.618200 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:29.619671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:30.400662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:30.497897 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:30.599442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:31.643702 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:32.416672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:32.808948 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:32.928992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:33.234625 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:33.499921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:33.501083 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:38:33.502842 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:38:34.118823 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:34.879082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:36.085249 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:36.087962 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:36.793370 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:36.950874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:36.953557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:37.809892 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:38.219990 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:38.220950 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:38:38.221663 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:38:38.662424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:38.935555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:39.735530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:40.263812 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:40.629247 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:40.630154 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:38:40.800125 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:41.183252 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:42.457900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:38:43.538028 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0815(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982')) |
2024-12-23T00:38:43.540095 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982 |
2024-12-23T00:38:47.281024 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2009/0814(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092')) |
2024-12-23T00:38:47.282551 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092 |
2024-12-23T00:38:48.882026 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:38:48.882414 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0090(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:38:48.883279 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:38:50.939916 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0171(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121')) |
2024-12-23T00:38:50.945113 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121 |
2024-12-23T00:38:53.484145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:53.883627 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:38:53.892331 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:01.245717 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:01.522835 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:01.709975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:02.019831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:02.831640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:02.834602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:04.348287 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:04.431190 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:04.737943 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:05.109907 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:05.995957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:06.674600 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:07.543450 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:07.906410 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:08.266021 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:08.349971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:08.553486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:09.355992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:09.358923 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:10.244355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:10.359314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:10.787707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:11.041688 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:11.044627 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:12.119042 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:12.178379 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:13.559380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:13.925783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:13.927359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:13.931060 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:39:13.933502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:13.940423 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:39:14.582697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:14.583676 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:39:15.405420 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:15.509327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:16.851987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:16.979662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:17.106792 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:17.581630 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:17.582638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:17.584833 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:18.730032 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:19.029119 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:19.030019 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:39:19.916601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:19.919588 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:20.379728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:20.821742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:20.925012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:20.926819 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:21.992083 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:21.992745 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:39:22.341314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:22.705994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:23.024951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:23.747800 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:23.751254 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:23.832128 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:39:23.832898 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:39:23.833535 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:39:24.103139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:24.319230 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:25.541861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:25.821391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:26.125866 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:26.638564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:26.747385 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:26.808077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:27.336194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:28.697260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:29.399721 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:29.826326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:29.827297 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:39:30.015609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:30.346580 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en |
2024-12-23T00:39:30.561536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:32.524826 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:32.724779 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:33.520946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:34.028674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:34.249150 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/0035(COD)&l=en'} (ValueError()) |
2024-12-23T00:39:34.250173 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:39:36.096461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:36.608021 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:36.947447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:36.951763 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:37.176204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:37.178326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:37.287567 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:37.393476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:39.669123 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:40.381245 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:40.383505 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:40.570081 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:40.572282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:40.675074 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:40.930574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:41.024457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:41.521967 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en |
2024-12-23T00:39:42.297103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:43.327250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:43.530921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:43.646537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:44.200483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:44.332801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:44.333824 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:44.518194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:45.597069 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:46.102084 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:46.453265 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:46.747697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:47.322161 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:48.006320 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:48.767237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:49.282406 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en |
2024-12-23T00:39:49.523229 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:49.525982 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:49.953029 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:50.348073 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=1995/0057(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823')) |
2024-12-23T00:39:50.349762 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823 |
2024-12-23T00:39:51.322004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:51.414646 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:51.828129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:51.961926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:52.415972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:52.482271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:52.483082 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:39:52.758728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:53.055931 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:54.017514 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:54.022199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:54.448293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:54.981579 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:55.274908 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:55.415151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:56.601110 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:56.963803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:57.144713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:39:58.003295 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:58.366408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:59.263792 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:59.264511 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:39:59.675005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:59.688431 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:59.947543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:39:59.948423 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:00.452635 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:00.644733 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0072(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574')) |
2024-12-23T00:40:00.646224 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574 |
2024-12-23T00:40:01.765367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:02.257651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:02.387340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:02.496288 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:02.557888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:02.999433 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:03.360327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:03.808226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:04.406593 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:04.693445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:05.212355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:05.577452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:05.579839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:05.861062 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:06.103492 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:06.451945 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:06.959388 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:07.965085 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:08.081748 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:08.335646 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:40:08.336462 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:40:09.172201 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:09.174532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:09.176317 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:16.570326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:16.573588 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:16.577038 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:16.578871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:16.581723 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:16.584881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:16.587854 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:16.591912 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:18.865809 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:18.948634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:19.279962 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:19.539167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:19.710289 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:19.939281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:20.585808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:21.173012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:21.533389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:21.812138 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:22.354720 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:22.499408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:23.274411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:23.653551 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:23.807423 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:24.353992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:24.721000 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:25.242620 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:25.879592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:25.883483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:26.075096 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:26.684988 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:28.122859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:28.460872 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:28.519631 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:29.390062 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:30.724273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:30.725331 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:30.843071 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:30.933253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:31.949461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:32.714343 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:32.908331 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:33.397975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:33.398782 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:33.400049 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:33.561172 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:33.813381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:35.760681 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:36.624922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:37.849741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:37.850745 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:40:38.789686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:39.066014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:39.230346 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:39.901522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:40.596605 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:40.604600 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:41.107961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:41.399538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:41.469521 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:42.396731 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:42.528369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:42.867964 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en |
2024-12-23T00:40:42.980468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:40:42.986342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:43.405708 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en |
2024-12-23T00:40:43.668680 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en |
2024-12-23T00:40:44.256735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:44.412686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:44.413702 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:44.774548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:45.456259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:45.457063 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:45.458416 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:46.427965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:46.707920 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:46.810603 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:47.067456 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:47.121206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:47.125964 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:47.723721 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:47.947073 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0062(NLE)&l=en |
2024-12-23T00:40:48.232302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:49.253561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:49.254406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:49.530550 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:49.536177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:50.020112 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:50.349170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:50.350403 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:51.279655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:51.657992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:53.564937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:54.356260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:55.441801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:56.060827 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:56.323397 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:56.456476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:56.889948 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:57.141393 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:57.308532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:57.377493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:57.378310 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:40:57.735851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:58.647591 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:58.651886 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:59.518462 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:59.524322 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:40:59.526724 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:40:59.614664 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:40:59.904011 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:40:59.904859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:00.000055 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:01.149722 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:01.151876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:01.667948 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:02.104705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:02.278345 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:02.479183 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:02.784089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:03.561116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:03.657050 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:03.658013 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:41:04.140311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:04.431924 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:06.020301 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:06.389265 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:07.080033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:07.084592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:07.088546 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:41:08.691341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:09.103406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:09.808157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:10.218740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:12.049225 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:12.049996 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:41:12.102708 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en |
2024-12-23T00:41:12.378401 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:41:12.379122 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:41:12.380716 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:41:12.886277 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0224(COD)&l=en |
2024-12-23T00:41:13.181957 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en |
2024-12-23T00:41:16.197961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:20.856638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:21.150439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:21.614136 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0225(COD)&l=en |
2024-12-23T00:41:23.384464 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:23.385235 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:41:23.647902 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:23.714851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:23.831300 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:25.020369 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:41:25.020702 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0329(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:41:25.021515 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:41:25.183989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:26.214605 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:26.455970 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:26.526655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:27.614978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:27.688464 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:27.832141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:28.152079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:28.673734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:28.930869 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2688(RSO)&l=en |
2024-12-23T00:41:29.049858 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:29.209113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:29.864392 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:29.997973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:30.132549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:31.109128 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:31.899629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:41:32.503086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:32.506430 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:41:34.104446 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:34.718659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:35.171045 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:35.444043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:35.531425 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:36.687470 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:36.688267 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:41:36.815646 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:36.893108 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:36.944732 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:37.625969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:37.728216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:37.976678 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:38.254839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:39.206381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:39.349697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:39.353086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:39.357070 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:40.588579 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:40.676203 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:40.677239 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:41:40.748033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:41.055742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:41.975253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:42.119936 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:42.417875 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:42.555708 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:43.073295 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:43.296237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:43.593497 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:43.594434 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:44.491338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:44.546290 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:45.169274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:45.255363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:45.612376 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:45.615131 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:46.195995 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:46.623473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:46.973800 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:47.047352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:47.694635 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:47.695568 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:41:47.840872 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:47.844459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:48.270845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:55.296084 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:55.299387 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:55.302632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:55.305510 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:55.310137 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:57.588138 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:57.864139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:57.865142 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:58.054245 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:58.146002 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en |
2024-12-23T00:41:58.287814 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:41:58.591759 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:41:58.812991 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:00.303471 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:00.456910 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:00.661003 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:00.946577 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:42:01.285023 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:01.427961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:01.609122 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0005(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015')) |
2024-12-23T00:42:01.610684 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015 |
2024-12-23T00:42:03.089674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:03.207667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:03.447116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:03.450405 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:03.452722 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:42:03.533143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:03.963046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:04.298628 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:04.299257 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:04.685357 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:04.686476 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:42:05.825086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:06.437846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:06.438449 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:06.580173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:06.584272 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:06.718127 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:06.725007 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:06.725623 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:06.916938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:42:06.917605 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:42:06.918219 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:42:07.463735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:08.985147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:09.485501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:09.666744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:09.717994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:09.788009 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:10.047226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:10.110670 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:10.264340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:11.416321 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:11.742925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:11.743603 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:42:12.406960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:12.410498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:12.698733 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:12.825120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:13.128882 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:13.130255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:14.178822 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:14.402076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:15.009026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:15.013349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:15.323166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:15.670119 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:15.738519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:15.739117 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:17.338459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:17.339367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:17.601907 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:19.134511 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:42:19.135340 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0400B(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:42:19.136464 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:42:19.444841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:20.265850 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:20.267207 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:21.003799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:21.004369 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:21.455555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:22.053649 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:22.586916 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:22.987963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:23.299300 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:23.441252 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:23.814079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:24.100937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:24.338703 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:24.339563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:24.340358 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:25.191416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:25.486190 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:25.921475 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:26.149863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:26.442326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:26.592046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:26.866930 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:26.867941 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:42:27.036644 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:27.885226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:27.888732 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:28.489884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:28.568114 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:29.083171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:29.268486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:29.677937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:29.731426 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:30.142829 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:42:30.389084 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:31.020842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:31.021601 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:31.705912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:32.304473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:32.306986 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:32.310829 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:32.312840 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:32.314086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:32.505517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:32.977997 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en |
2024-12-23T00:42:33.411268 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:33.592452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:34.328822 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:42:35.000629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:35.121406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:35.203193 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:35.374046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:35.661749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:35.956932 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:35.958747 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:42:36.311950 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2852(RSP)&l=en |
2024-12-23T00:42:36.562025 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:37.428764 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:37.429693 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:37.434179 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:37.768356 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en |
2024-12-23T00:42:38.447073 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:38.508439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:38.790985 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2858(RSP)&l=en |
2024-12-23T00:42:39.113625 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:39.181134 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:39.182056 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:40.254303 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:40.256575 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:40.259907 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:41.099780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:41.190436 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:41.563274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:41.856524 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:42:42.493900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:42.496582 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:42.498480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:42.500004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:43.218388 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:43.754364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:43.755397 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:43.968358 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en |
2024-12-23T00:42:44.027637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:44.081499 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2212(INI)&l=en |
2024-12-23T00:42:44.086426 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:44.267583 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2211(INI)&l=en |
2024-12-23T00:42:44.838474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:44.909653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:45.387604 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:45.388349 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:45.388984 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:42:45.767170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:46.447626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:46.623122 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:46.709231 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:46.815682 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:47.119542 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:47.423384 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:48.129780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:48.130578 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:48.202725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:48.203724 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:42:48.432963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:48.706472 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:49.088821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:49.658575 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:49.884740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:50.180094 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en |
2024-12-23T00:42:50.186610 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:50.284520 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:50.290643 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:50.489749 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en |
2024-12-23T00:42:50.496910 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2163(INI)&l=en |
2024-12-23T00:42:51.115349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:51.240416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:51.241855 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:52.539992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:52.605191 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:42:52.879076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:52.948339 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:53.580236 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:53.612897 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2519(RSP)&l=en |
2024-12-23T00:42:54.036651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:55.072921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:56.026234 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en |
2024-12-23T00:42:56.031552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:56.164329 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:56.439242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:56.651928 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:56.877973 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en |
2024-12-23T00:42:56.907948 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en |
2024-12-23T00:42:58.214923 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:58.298364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:58.428767 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en |
2024-12-23T00:42:58.589330 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en |
2024-12-23T00:42:58.807856 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en |
2024-12-23T00:42:58.860245 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:58.984997 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:59.010320 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en |
2024-12-23T00:42:59.171530 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en |
2024-12-23T00:42:59.218435 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en |
2024-12-23T00:42:59.303652 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en |
2024-12-23T00:42:59.331973 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en |
2024-12-23T00:42:59.361299 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:59.378564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:59.385552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:42:59.635681 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en |
2024-12-23T00:42:59.721874 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en |
2024-12-23T00:42:59.934911 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en |
2024-12-23T00:43:00.192969 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en |
2024-12-23T00:43:00.272179 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en |
2024-12-23T00:43:00.399965 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en |
2024-12-23T00:43:00.488712 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en |
2024-12-23T00:43:00.712331 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en |
2024-12-23T00:43:01.021699 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en |
2024-12-23T00:43:01.506532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:01.594543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:01.827722 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2591(RSP)&l=en |
2024-12-23T00:43:01.835398 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en |
2024-12-23T00:43:02.074187 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:03.640211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:04.072280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:04.080447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:04.792813 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:05.085390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:05.571386 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:05.969722 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:06.772915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:06.776446 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:07.209020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:07.298238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:07.447098 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:07.987408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:08.602223 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:08.604694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:08.609642 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:09.124251 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:43:09.135275 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2072(INL)&l=en |
2024-12-23T00:43:09.412815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:09.468367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:09.763500 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:10.416702 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:10.639662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:10.845127 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:11.702773 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:11.757841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:11.864260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:11.870398 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:12.153409 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:13.022734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:13.231953 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:14.043019 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:14.320393 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en |
2024-12-23T00:43:14.406863 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en |
2024-12-23T00:43:14.581152 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:14.881892 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:14.882621 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:15.453155 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:15.454818 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:15.659854 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:16.602378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:16.878723 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:16.985439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:17.369014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:17.508590 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:17.999421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:18.548919 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:18.549630 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:19.023255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:19.337441 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:19.623133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:20.645302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:20.951030 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:21.676320 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:21.680440 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:21.690159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:21.751602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:23.111705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:23.486938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:23.833438 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:24.167918 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:24.168655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:24.170012 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:24.288164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:24.614629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:25.218609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:26.277135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:26.700216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:26.701577 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:26.858546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:27.144551 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2200(IMM)&l=en |
2024-12-23T00:43:27.484796 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en |
2024-12-23T00:43:27.793958 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en |
2024-12-23T00:43:28.453877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:28.458858 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:29.373024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:29.470163 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:30.212475 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:30.810632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:31.733720 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:31.735234 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:32.379717 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:32.506522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:32.507574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:32.727898 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:33.336488 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:33.515178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:33.967951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:34.321305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:34.657900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:34.944911 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:35.123546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:35.180899 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:36.440224 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:36.961204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:36.967773 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:37.208101 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:37.591988 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:37.957500 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en |
2024-12-23T00:43:38.053759 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:38.461951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:38.539673 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:38.540415 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:39.674415 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:43:39.860033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:40.107210 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:40.110686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:41.086041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:41.316967 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:41.317537 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:43:41.550833 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:41.768987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:42.487842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:42.847981 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:43.038976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:43.337736 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:43.505606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:43.848984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:44.095674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:44.315039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:45.133795 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:45.905457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:45.906445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:46.018894 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:46.234421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:47.082880 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:47.396135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:47.471829 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:47.597868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:48.300478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:48.381250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:49.083634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:49.290128 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:49.638639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:49.958437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:50.602115 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:50.874324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:51.568458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:51.874934 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:43:52.195279 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:52.252385 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:53.106120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:43:53.264226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.120277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.126240 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.128837 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.131398 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.132760 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.135147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:00.137374 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:02.492836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:02.929705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:02.962974 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:03.012001 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:03.036270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:03.037041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:04.278375 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:44:04.278784 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0060(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:44:04.279634 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:44:05.198402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:05.371845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:05.452697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:05.543972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:06.055222 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:06.056022 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:44:07.318729 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:07.520143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:07.766743 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:07.767429 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:08.495247 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:08.574159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:09.577545 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:09.857129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:09.960865 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:09.962653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:10.092060 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:10.095497 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:11.072685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:11.181541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:12.307678 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:12.364932 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:12.668473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:12.671168 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:12.952426 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:13.006243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:13.654744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:13.730253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:14.696549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:15.163137 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:15.166726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:15.168920 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:15.487727 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:15.488491 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:16.220448 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:16.342465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:16.467336 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2061(INI)&l=en |
2024-12-23T00:44:16.624765 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en |
2024-12-23T00:44:17.116038 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:17.392635 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:17.754801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:18.087570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:18.088904 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:44:18.092821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:18.738383 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:19.136922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:19.323541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:19.594705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:20.109118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:20.374278 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:20.375297 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:20.671185 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2730(RSP)&l=en |
2024-12-23T00:44:21.020470 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:21.761251 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:21.876387 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:22.866913 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:22.871215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:23.045927 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:23.430838 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:23.590031 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
2024-12-23T00:44:23.590881 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:44:24.228572 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:24.512235 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:24.512957 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:44:25.448448 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:25.450376 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:25.812708 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:25.926361 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:25.928695 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:26.613646 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:27.189133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:27.637525 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:27.768502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:28.441459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:28.661486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
2024-12-23T00:44:28.847018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:29.183393 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:30.120950 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:31.205184 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:32.312734 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2157(DEC)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966')) |
2024-12-23T00:44:32.332244 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966 |
2024-12-23T00:44:32.621506 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:33.358600 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:33.748098 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:33.750483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:34.941825 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:34.942741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:35.226545 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:35.259023 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0211(COD)&l=en |
2024-12-23T00:44:35.589369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:35.714856 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:35.985568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:36.195450 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:36.650747 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:37.623332 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:38.043361 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:38.369549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:38.751209 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:38.827022 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:39.747360 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:39.750258 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:39.763071 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:44:39.763443 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0213(CNS)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:44:39.764212 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:44:40.195707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:40.845793 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:41.115467 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:41.350799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:42.023658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:42.299549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:42.300580 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:42.690975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:42.926509 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:43.292977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:43.293779 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:44:43.572740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:44.267167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:44.602732 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:44.975212 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:45.053787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:45.118187 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:45.524430 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:45.527857 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:45.530316 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:44:47.175350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:47.176103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:47.432712 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2175(IMM)&l=en |
2024-12-23T00:44:47.663342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:47.665878 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:47.669998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:48.018202 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:49.791468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:49.925009 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:50.043396 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:50.486711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:52.040145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:52.451294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:44:52.452441 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:44:53.152602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:53.156114 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:44:53.160019 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:44:54.550440 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:54.910002 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:54.912853 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:44:55.237903 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:55.445464 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:55.687468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:55.688269 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:44:56.115241 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:56.189616 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:57.388800 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:57.645082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:57.750990 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:57.813746 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:58.379082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:58.653834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:44:58.764447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:58.986714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:59.951513 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:44:59.952263 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:45:00.050219 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:00.713228 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:00.903244 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:01.081539 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:01.617132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:01.621452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:02.512556 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:03.413694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:03.420965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:03.424656 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:04.016601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:04.187655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:04.337442 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2939(RSP)&l=en |
2024-12-23T00:45:04.739146 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2998(RSP)&l=en |
2024-12-23T00:45:04.966303 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:04.967152 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:45:05.448746 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:05.970064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:05.993892 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:45:06.165118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:06.259641 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:06.393355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:06.410401 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2198(INI)&l=en |
2024-12-23T00:45:06.484726 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2213(INI)&l=en |
2024-12-23T00:45:07.011527 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:45:07.011905 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0387(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:45:07.012788 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:45:08.324291 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:08.606598 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:08.699302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:09.028137 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/3011(RSP)&l=en |
2024-12-23T00:45:10.328804 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:10.424337 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:45:10.425155 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0375(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:45:10.426624 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:45:10.883234 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:11.336693 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:11.700987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:12.896727 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:12.990957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:12.991772 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:13.436147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:13.863561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:14.043875 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:14.340668 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:14.738445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:15.339725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:15.342353 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:15.470624 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:15.726180 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:16.119365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:16.428519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:16.458192 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2020/2259(INI)&l=en |
2024-12-23T00:45:16.599668 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:17.096867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:17.424410 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:17.842816 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:18.141391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:19.030435 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:19.246871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:19.747880 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:19.831129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:20.130638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:21.145984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:21.516586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:21.591140 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:21.999029 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:22.378335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:22.482845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:22.949412 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:22.950393 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:45:23.346029 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:23.809318 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:24.057344 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2238(INI)&l=en |
2024-12-23T00:45:24.491629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:24.497942 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:24.741888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:45:25.089637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:25.232298 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:25.562102 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:25.822965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:26.642656 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:26.817407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:27.200537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:27.867807 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2506(RSP)&l=en |
2024-12-23T00:45:29.292952 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:29.633391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:45:30.063454 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:31.000860 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:31.385651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:31.683211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:32.147160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:32.278199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:32.594363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:34.115792 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:34.172328 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:34.332847 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:34.410894 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:34.415596 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2554(RSP)&l=en |
2024-12-23T00:45:34.511197 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:34.590675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:34.591507 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:45:35.673717 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:36.881086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:36.884976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:36.888158 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:36.891549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:36.894371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:36.997648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:38.227603 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:39.272012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:39.404719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:39.664676 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:39.669456 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:40.026889 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:40.351358 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:40.950546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:48.604974 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:48.607898 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:48.609791 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:48.611501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:48.614616 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:49.381411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
2024-12-23T00:45:50.660173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:50.983537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:51.280622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:51.281434 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:45:51.337912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:51.407567 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:51.619641 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:52.092150 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:52.418766 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:53.169517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:53.275239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:53.823743 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:53.825884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:54.342917 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:54.974264 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:55.037620 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:55.597030 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:56.022543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:56.450171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:56.455216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:56.927883 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:57.432862 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:57.512280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:57.768054 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:58.554047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:59.092955 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:45:59.093518 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0125(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:45:59.094858 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:45:59.099841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:59.281743 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:45:59.786742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:45:59.903868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:00.125846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:00.126606 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:01.541796 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:01.545890 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:01.548335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:01.899936 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:02.169830 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:02.342227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:03.635562 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:03.771093 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:04.053638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:04.491008 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:04.580944 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:05.137799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:05.138618 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:06.193796 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:06.348645 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:06.470098 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:06.470985 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:06.702225 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:06.954352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:07.203463 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:07.400004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:08.781480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:08.782666 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:08.783677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:08.936014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:09.928157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:09.929228 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:09.930271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:10.212618 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:11.102487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:11.247617 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:11.311204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:11.578176 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:12.270361 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:12.369479 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:12.529338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:12.831288 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:13.530352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:13.984574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:13.985319 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:14.110018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:14.671698 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:14.800404 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:14.801182 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:14.932177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:15.886510 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:16.915258 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:17.020871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:17.416993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:17.676505 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:17.815534 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:18.243336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:18.706262 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:19.104985 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:19.742711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:19.753269 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:20.100283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:20.356359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:21.149507 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:21.447272 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:22.130929 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:22.132177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:22.284282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:22.795714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:23.118963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:24.020487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:24.021285 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:24.516021 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:24.599563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:24.886837 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:25.148924 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2863(RSP)&l=en |
2024-12-23T00:46:25.396069 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:25.605948 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:26.738039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:27.024912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:27.344279 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:27.352377 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:28.133214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:28.133995 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:28.905697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:29.002679 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:29.683838 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:29.826895 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:29.827625 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:46:30.729790 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:30.832658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:30.833935 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:31.316209 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:31.967243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:31.972856 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:33.013195 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:33.173260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:33.762192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:33.764973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:33.786585 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:33.790653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:35.357161 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:35.577776 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:36.105313 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:36.793897 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:36.794728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:37.675983 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:37.679248 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:38.415584 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:38.656300 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:38.943562 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:39.986593 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:40.255735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:40.618867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:41.262528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:41.366196 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:41.425726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:42.549963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:42.796273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:42.918243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:42.994980 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:43.218137 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:44.361559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:44.364088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:44.367745 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:45.169434 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:45.170186 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:45.773442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:46:45.823727 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:46:46.262292 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/3010(RSP)&l=en |
2024-12-23T00:46:46.493256 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2209(IMM)&l=en |
2024-12-23T00:46:47.045350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:48.991259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:49.137562 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0391(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360')) |
2024-12-23T00:46:49.140114 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360 |
2024-12-23T00:46:49.715155 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:51.703437 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0394(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287')) |
2024-12-23T00:46:51.704909 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287 |
2024-12-23T00:46:51.721413 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0396(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419')) |
2024-12-23T00:46:51.722706 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419 |
2024-12-23T00:46:51.796638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:52.727355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:46:52.727974 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2024-12-23T00:46:53.198902 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:53.274914 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2203(INI)&l=en |
2024-12-23T00:46:53.279529 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:53.425609 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2008(IMM)&l=en |
2024-12-23T00:46:54.161329 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:54.535672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:55.450365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:55.572334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:55.631383 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:56.659925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:56.892020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:46:57.836311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:57.903853 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:57.956683 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:58.188389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:58.189162 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:46:59.077749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:46:59.278863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:00.168912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:00.170665 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:00.456233 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2567(RSP)&l=en |
2024-12-23T00:47:00.464855 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:00.466282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:00.467546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:02.275782 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:02.277051 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:47:02.617579 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:02.911472 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:02.915110 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:03.126685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:03.129641 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:47:03.584859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:03.882520 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:04.178061 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2592(RSP)&l=en |
2024-12-23T00:47:04.195697 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2597(RSP)&l=en |
2024-12-23T00:47:04.907160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:05.124469 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2614(RSP)&l=en |
2024-12-23T00:47:05.359700 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0077(COD)&l=en |
2024-12-23T00:47:06.053534 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:06.230578 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:06.590511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:08.223867 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:47:08.224630 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0059(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:47:08.225911 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:47:08.624442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:08.921821 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0053(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293')) |
2024-12-23T00:47:08.923397 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:08.924060 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293 |
2024-12-23T00:47:09.240510 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:09.578908 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2039(IMM)&l=en |
2024-12-23T00:47:09.819242 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2649(RSP)&l=en |
2024-12-23T00:47:11.042070 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:47:11.042447 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0085(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:47:11.043285 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:47:11.138376 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:11.428876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:11.890841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:13.415277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:13.537158 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:14.236241 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:16.355832 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:17.080709 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:18.123916 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:19.166186 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:19.167413 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:47:19.168201 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:21.550527 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:24.876279 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:25.360216 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:47:25.360581 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0130(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:47:25.361492 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:47:31.926968 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:47:31.928346 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0128(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:47:31.930505 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:47:31.939896 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:32.482617 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:34.374244 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:34.376156 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:34.527665 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:35.139587 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:47:35.600173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:36.717328 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:36.888921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:37.785609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:38.265151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:39.450020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:39.604065 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:40.378037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:41.036229 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:41.902014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:42.581326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:42.857908 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:44.185311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:45.050517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:45.175097 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:45.177353 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:45.246502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:46.107399 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:47.518197 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:50.343995 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
2024-12-23T00:47:50.541270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:50.559107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
2024-12-23T00:47:50.741256 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:52.176477 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:57.063720 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:47:57.848882 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0259(NLE)&l=en'} (ValueError()) |
2024-12-23T00:47:57.850471 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:47:58.392956 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2104(INL)&l=en |
2024-12-23T00:47:58.581025 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:58.887703 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:47:59.039207 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2125(INI)&l=en |
2024-12-23T00:47:59.173650 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:00.752391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:00.756971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:00.761670 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:48:01.458620 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:01.461305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:01.788961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:04.630023 | dossier | warning | no body mapping found for "Matter referred back to the committee responsible for reconsideration" |
2024-12-23T00:48:05.138726 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:48:05.139124 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0134(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:48:05.139934 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:48:05.488746 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2710(RSP)&l=en |
2024-12-23T00:48:07.869533 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:08.767738 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:09.156049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:09.157455 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:09.167727 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:09.737476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:48:10.494426 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:10.812329 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:11.104204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:11.467881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:11.932632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:12.074352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:12.155822 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:12.688844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:12.972324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:13.436915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:48:13.538162 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:13.989280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:14.554318 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:14.880336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:15.162054 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:15.574479 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:15.734370 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:16.183192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:16.716148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:17.436095 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:17.438219 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:17.439451 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:17.718273 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2191(IMM)&l=en |
2024-12-23T00:48:18.032104 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:19.275770 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:19.890283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:20.028214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:20.533169 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:21.758431 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:22.014085 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:23.156201 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:24.021790 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:24.027275 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:24.345817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:24.347176 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:24.798462 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2199(IMM)&l=en |
2024-12-23T00:48:24.835053 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2200(IMM)&l=en |
2024-12-23T00:48:25.987102 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:26.752224 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:27.220699 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:27.481581 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:28.200249 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:28.656439 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2927(RSP)&l=en |
2024-12-23T00:48:29.110721 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:30.169493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:30.173309 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:30.176174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:30.537807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:30.920486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:31.274350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:32.211398 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:32.851728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:32.963441 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:33.711854 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:33.824925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:33.960411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:34.057651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:34.910557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:35.765138 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:36.654658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:37.081682 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:37.117181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:37.483227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:37.946960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:38.380470 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2989(RSP)&l=en |
2024-12-23T00:48:38.587570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:39.905522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:40.269624 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:40.588720 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:40.870615 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:42.090445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:42.552325 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:42.812622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:45.344607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:46.344612 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:46.347181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:46.616987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:48.916660 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:49.407992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:49.872874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:49.960812 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:50.153107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:48:57.803975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:58.379087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:58.603211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:48:59.076096 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:48:59.304138 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:48:59.304525 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0448(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:48:59.306681 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:49:01.479691 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:01.839582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:02.674439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:03.007203 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:03.076047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:11.746891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:11.763586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:11.766371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:11.770162 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:11.771949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:11.773896 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:49:15.070667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:15.695194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:15.933525 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:16.034227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:16.431377 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:16.751633 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:20.206181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:20.346018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:21.959863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:23.389846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:23.880642 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:23.957271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:24.663359 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2024-12-23T00:49:24.663796 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0035(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:49:24.664816 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:49:25.146675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:25.808740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:26.030311 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:49:26.030784 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0038(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:49:26.031648 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:49:27.009164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:27.290861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:27.877140 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:28.273592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:28.624098 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:29.173686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:29.256093 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:30.270287 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:31.116128 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:31.390599 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:31.394502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:31.876988 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:32.202605 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:32.470644 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:32.902332 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:33.532504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:35.297421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:35.340851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:35.355365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:35.928888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:36.444455 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2593(RSP)&l=en |
2024-12-23T00:49:36.572836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:37.206377 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2622(RSP)&l=en |
2024-12-23T00:49:39.100523 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:49:39.100959 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0060(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:49:39.102031 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:49:39.105839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:39.463588 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:49:39.464053 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0059(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:49:39.464833 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:49:40.599006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:41.507926 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2024-12-23T00:49:41.508328 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0061(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2024-12-23T00:49:41.509109 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2024-12-23T00:49:42.293524 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:42.704745 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:42.709042 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:42.847662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:43.064726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:43.135021 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:43.997142 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:44.763125 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:45.459685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:45.519776 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:45.640914 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:45.779564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:45.859465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:46.379031 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:47.585233 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:48.185338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:48.336910 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:48.591660 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:48.842972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:48.845102 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:49.367148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:49.734382 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:50.541003 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:51.158556 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:51.483810 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:51.781845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:51.903840 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:52.084826 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:52.414947 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:52.841440 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:53.463980 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:53.951810 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:49:54.269014 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2010(IMM)&l=en |
2024-12-23T00:49:54.427087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:55.054844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:55.967077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2024-12-23T00:49:55.967980 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2024-12-23T00:49:56.219702 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:56.228637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:56.388682 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:49:59.645014 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:49:59.645390 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0101(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:49:59.646483 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:49:59.816414 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2711(DEA)&l=en |
2024-12-23T00:50:00.406342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:02.516256 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:50:02.516724 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0155(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:50:02.517949 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:50:06.418786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:07.369083 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:08.251053 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:08.251655 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:50:08.556108 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:08.610205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:09.237408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:09.464156 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:09.883451 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:11.109638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:11.146264 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:11.166779 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:11.169276 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:50:12.006362 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:12.101719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:12.385086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:13.836667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:13.985314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
2024-12-23T00:50:13.989237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:14.082009 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:14.927004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:14.927668 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:50:15.553474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:20.550120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:20.551709 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:20.552896 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:50:20.795541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:23.007284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:23.122980 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:50:23.123862 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0178(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:50:23.125041 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:50:23.852603 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:24.081548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:24.302734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:24.304699 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:25.604230 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:25.885242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:26.804628 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:26.924328 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:27.001221 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:27.238367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:27.238991 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:50:27.777949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:27.778847 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2024-12-23T00:50:28.361728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:28.544143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:28.544878 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2024-12-23T00:50:28.963344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:30.003130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:30.348217 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:30.355269 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:30.631541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:30.699691 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:30.976111 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:30.976939 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2024-12-23T00:50:31.768691 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:32.291659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:32.727913 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:33.205236 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:33.630667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:33.711996 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:35.262390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:35.522363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:35.847950 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:36.390991 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:36.986176 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:38.634745 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:39.028311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:39.285283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:40.598669 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:41.977750 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:41.980868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:41.982214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:42.056965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:43.244535 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2783(RSP)&l=en |
2024-12-23T00:50:44.813131 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:45.163229 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:50:45.163682 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0245(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:50:45.164589 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:50:45.238519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:45.769194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:46.583822 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:46.721342 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
2024-12-23T00:50:48.592842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:49.695104 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2053(INI)&l=en'} (ValueError()) |
2024-12-23T00:50:49.696098 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:50:52.732559 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2057(INI)&l=en'} (ValueError()) |
2024-12-23T00:50:52.733552 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:50:53.671819 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2056(INI)&l=en'} (ValueError()) |
2024-12-23T00:50:53.672822 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:50:54.596467 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:54.955765 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:56.277026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:56.613310 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:57.691400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:59.013028 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:50:59.983189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:50:59.987570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:51:00.060635 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:51:01.149264 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0267(NLE)&l=en'} (IndexError('list index out of range')) |
2024-12-23T00:51:01.150464 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 265, in scrape_ep_key_players
tmp = junws(cells[2])
~~~~~^^^
IndexError: list index out of range |
2024-12-23T00:51:03.571640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:51:03.688807 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:51:03.689237 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0263(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:51:03.690111 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:51:03.862998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:51:03.864338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:51:04.216852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:51:04.784328 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
2024-12-23T00:51:04.785129 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
2024-12-23T00:51:04.975119 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0275(COD)&l=en'} (ValueError()) |
2024-12-23T00:51:04.976125 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2024-12-23T00:51:05.083960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:51:07.004184 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2024-12-23T00:51:07.550783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:51:08.123373 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:51:08.123905 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0260(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:51:08.125092 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:51:08.126296 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2024-12-23T00:51:08.457524 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:51:08.457984 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0159M(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:51:08.458803 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:51:08.550853 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
2024-12-23T00:51:08.551230 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0253(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2024-12-23T00:51:08.552151 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2024-12-23T00:52:58.059575 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T00:53:33.259186 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T00:54:01.817827 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T00:56:52.819579 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T00:57:01.820456 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T00:57:01.822842 comvote info adding A9-0129/2024-CONT-responsible (A9-0129/2024-CONT-responsible)
2024-12-23T00:57:01.823936 plenary info scraping plenary: https://www.europarl.europa.eu/doceo/document/A-9-2024-0180_EN.html |
2024-12-23T00:57:54.451388 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:04:12.552835 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:05:20.115488 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:05:21.401864 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:07:36.026640 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:09:06.245845 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:10:15.035153 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:12:17.856989 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:12:29.062993 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:12:30.598814 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:14:44.698654 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:16:39.783791 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:16:51.091654 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:17:35.073006 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:18:48.057746 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:19:07.386571 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:19:50.774142 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:21:44.594726 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:22:02.011692 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:23:35.586919 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:24:04.640528 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:24:34.034569 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:24:41.114376 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:24:55.007050 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:25:08.577734 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:25:41.322625 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-23T01:26:08.279031 | mep_activity | warning | pe, has not expected format: 'Commission' |