| 2024-12-22T00:36:32.857696 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:32.860862 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:36:32.864772 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:32.867586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:32.869905 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:32.872952 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:32.876440 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:36:32.882912 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:36:35.322714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:35.516670 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:35.519109 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:35.520141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:35.635443 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:36.136251 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en |
| 2024-12-22T00:36:36.354651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:36.740944 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:37.678787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:37.679532 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-22T00:36:37.748857 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:38.163118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:38.609884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:38.716302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:39.009066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:40.157728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:40.159432 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-22T00:36:41.150957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:41.302084 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:41.662040 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:41.992933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:43.144654 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:36:43.259999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:44.052998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:44.159354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:44.287273 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en |
| 2024-12-22T00:36:44.380193 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:44.650247 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:45.623263 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:45.624863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:46.813259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:46.814133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:47.061953 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:47.173496 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:48.332373 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:48.719006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:49.329185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:49.459635 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:49.879697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:49.881392 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:50.942281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:51.678063 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:52.079431 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:52.080083 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:36:52.149389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:52.496674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:53.606638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:53.608073 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:36:53.609308 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:36:54.448166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:54.449144 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-22T00:36:54.760331 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:55.446129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:55.671314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:55.905403 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:55.979842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:56.560066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:56.666385 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:57.457268 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:57.458161 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:57.459676 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:36:57.737926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:58.405483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:58.880049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:36:58.880661 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 4.0 month(s)" |
| 2024-12-22T00:36:59.287623 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:59.291129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:36:59.940544 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:00.187656 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:00.821082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:00.822255 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:01.063725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:01.144048 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:01.465686 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en |
| 2024-12-22T00:37:01.553849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:01.835415 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:02.136486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:02.415434 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:03.597052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:03.978000 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:04.441089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:04.445206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:04.794105 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:37:04.794480 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0212(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:37:04.795718 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:37:04.915357 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:06.312047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:06.389661 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:06.487321 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en |
| 2024-12-22T00:37:07.353064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:08.380079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:08.538215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:10.168354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:10.289930 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:37:10.290327 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0273(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:37:10.291098 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:37:10.648023 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:10.724563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:11.439305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:11.447814 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:11.448781 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:37:11.453879 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:37:11.454271 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:37:11.455047 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:37:12.438765 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:12.439445 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:37:12.641239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:12.663834 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en |
| 2024-12-22T00:37:13.539012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:13.539591 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:37:13.846377 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:13.847001 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:37:13.987508 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:14.594804 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:14.858897 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:15.083426 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:15.709077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:16.170984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:16.629069 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:16.996749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:17.028367 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en |
| 2024-12-22T00:37:17.223855 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:17.277873 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:17.801148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:19.292846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:19.297524 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:19.366697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:19.466037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:21.322334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:21.602698 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:21.604199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:21.684019 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:21.870085 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:21.871762 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:37:22.916639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:23.443262 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:23.444065 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:37:23.479091 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:23.791368 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:23.847874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:24.688801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:25.797847 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2012/0164(APP)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257')) |
| 2024-12-22T00:37:25.799323 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 84, in scrape
docs = scrape_docs(root, edocs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 614, in scrape_docs
doc['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257 |
| 2024-12-22T00:37:25.887103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:25.976025 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:26.361213 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:26.362574 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:37:26.364667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:27.087198 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:27.657861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:27.658551 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:37:28.022443 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:28.023033 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:28.117812 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:28.273097 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:28.363045 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:28.599108 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:28.682957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:29.525414 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:29.775836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:30.074354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:30.075246 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:37:30.603277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:30.609420 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:30.687436 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:30.909407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:31.135189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:31.136240 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:37:31.878607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:32.196262 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:32.604470 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:32.662911 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:32.957371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:32.959117 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:33.137842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:33.242649 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:34.463978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:34.573942 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:34.865407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:34.866029 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:35.031052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:35.367162 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:35.369088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:35.370282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:35.375241 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:35.479124 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:36.802449 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:36.804258 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:37.230786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:37.604153 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:37.607229 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:37.609540 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:37.744344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:37.745458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:39.300338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:39.457535 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:39.986132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:39.987277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:40.224986 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:40.493557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:40.494480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:41.685693 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:41.686777 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-22T00:37:41.774105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:42.082817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:42.362013 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:42.535688 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:42.536303 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:42.911906 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:42.913067 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:42.921933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:43.217142 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:37:43.271008 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:44.232327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:44.598674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:44.599292 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:44.676830 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:44.797645 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:44.873975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:45.245381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:45.762940 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:46.131472 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:46.461181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:47.025971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:47.189271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:47.507704 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:47.510313 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:47.729764 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:47.984047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:48.282969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:48.772915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:48.774926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:49.544938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:49.840674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:50.108977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:50.698153 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:50.699382 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:50.702498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:50.705310 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:51.042896 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:51.256874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:51.257513 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:52.095304 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:52.096063 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:52.175653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:52.176370 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:52.520115 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:52.520993 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:53.070129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:53.073690 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:53.077723 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:53.441500 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:53.442346 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:53.704024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:53.760389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:54.431511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:54.603400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:54.889090 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:55.196198 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:55.295190 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:55.696323 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:56.336796 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:56.593150 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:56.593796 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:56.647402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:37:56.735119 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:37:56.735715 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:37:57.595396 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:57.599070 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:57.882457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:58.008672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:58.856866 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:58.919853 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:59.020259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:37:59.630314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:00.035515 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:00.100205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:00.206201 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:00.212488 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:00.854341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:01.317965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:01.573491 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:01.574132 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:38:01.873881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:02.345599 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:02.347171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:02.439342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:02.526009 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:02.526692 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:38:03.260342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:03.530255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:04.013456 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:04.843089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:04.843976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:04.845151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:04.913051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:05.698844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:05.699445 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:38:06.213861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:06.394555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:06.994587 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:07.105599 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:07.106423 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:07.112207 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:07.362680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:07.363337 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:07.727136 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:08.149487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:08.150360 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:38:09.000158 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:09.660292 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:09.677984 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:38:10.006039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:10.006900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:10.007611 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:38:10.177601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:10.232468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:11.933424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:12.146101 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:12.147313 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:12.231013 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:12.231576 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:38:12.485437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:12.863249 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:12.891787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:14.427282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:14.431314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:14.433356 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:14.434477 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:14.439190 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:14.441128 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:14.549364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:14.827936 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:14.828669 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:38:21.743965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:21.752452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:21.761447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:21.764468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:21.769707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:21.772574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:21.774595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:21.787869 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:22.096938 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:38:24.176578 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:24.434344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:24.731278 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:24.976957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:24.980935 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:24.983419 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:26.037178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:26.758536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:27.470781 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:27.474052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:27.476287 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:27.478043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:27.483012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:28.443711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:28.760871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:29.432350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:29.433182 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:29.616435 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:29.783811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:29.852168 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:29.852915 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:30.156884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:30.332268 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:30.828885 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:30.977435 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:32.427275 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:32.428718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:32.430293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:32.433411 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:32.435020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:32.522236 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:32.737619 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:33.203998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:33.338809 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0012(NLE)&l=en'} (ValueError()) |
| 2024-12-22T00:38:33.340014 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:38:34.615330 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:34.671060 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:34.826457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:35.062014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:35.826808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:36.340901 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:37.492894 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:37.559906 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:37.923863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:38.176306 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:38:38.176699 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2004/0148(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:38:38.177531 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:38:38.642179 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en |
| 2024-12-22T00:38:38.953390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:39.879199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:40.570548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:41.084008 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:41.160087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:41.395587 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:41.396335 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-22T00:38:41.684177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:41.685744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:41.942919 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en |
| 2024-12-22T00:38:42.681506 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:43.244685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:43.337152 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:43.797775 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:44.035253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:44.485439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:44.486302 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:38:44.846049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:45.724543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:45.893277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:45.899336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:47.180531 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:47.620317 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:48.102444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:49.154548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:49.282450 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:50.360399 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:50.362925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:50.434417 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:50.662892 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:50.663657 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:38:51.746314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:52.640806 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:53.212106 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:38:53.436989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:55.398012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:56.142954 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:57.060900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:57.202624 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:57.266552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:38:57.804508 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:58.264612 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:38:59.977222 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:00.921621 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:00.924970 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:00.927038 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:00.939803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:39:00.941023 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:39:01.004808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:01.268258 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:02.874304 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:03.445640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:04.010634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:04.072043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:04.164653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:04.381860 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:05.506159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:05.507084 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:39:05.507779 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:39:05.807728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:05.906235 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:06.384570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:07.050933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:07.365713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:07.546143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:07.547267 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:39:08.070107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:08.876363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:09.323984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:10.239106 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0815(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982')) |
| 2024-12-22T00:39:10.240893 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982 |
| 2024-12-22T00:39:13.476488 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2009/0814(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092')) |
| 2024-12-22T00:39:13.477958 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092 |
| 2024-12-22T00:39:14.611204 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:39:14.611590 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0090(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:39:14.612513 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:39:16.875959 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0171(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121')) |
| 2024-12-22T00:39:16.878247 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121 |
| 2024-12-22T00:39:19.336067 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:19.338233 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:19.614926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:20.695011 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:21.803121 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:22.152452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:22.261592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:22.491284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:23.041348 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:23.042189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:23.770047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:24.241199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:24.515024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:25.574988 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:26.050206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:26.344023 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:26.772042 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:26.909662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:27.331004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:28.258445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:28.833999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:28.914479 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0270(COD)&l=en'} (ValueError()) |
| 2024-12-22T00:39:28.915489 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:39:29.101444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:29.443679 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:29.446120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:29.643450 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:30.681206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:30.826460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:31.964901 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:32.099132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:32.592881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:32.594213 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:39:32.752035 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:33.618546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:33.619312 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:39:33.695875 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:33.696820 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:39:33.887398 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:35.209319 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:35.215811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:35.743799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:35.859499 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:36.260512 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:36.262746 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:36.385498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:36.558583 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:38.084457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:38.704806 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:38.705647 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:39:38.813932 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:39.020460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:39.024841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:39.278619 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:39.282596 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:39.480910 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:40.519909 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:40.520525 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:39:40.738116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:41.506035 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:41.563155 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:41.766720 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:41.770523 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:42.071026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:42.358137 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:39:42.358979 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:39:42.359733 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:39:42.543488 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:43.686610 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:43.909459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:44.196414 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:44.624621 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:44.933789 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:45.524741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:45.685319 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:47.157444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:47.482310 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:47.845532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:48.244367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:48.245291 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:39:48.329430 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en |
| 2024-12-22T00:39:48.603798 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:50.205530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:50.635523 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:51.179076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:51.295915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:51.944328 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/0035(COD)&l=en'} (ValueError()) |
| 2024-12-22T00:39:51.945595 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:39:52.547403 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:53.485870 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:53.486651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:53.755529 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:53.758975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:53.760789 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:54.357709 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:54.358750 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:55.736016 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:56.332446 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:56.334118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:56.435849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:56.691070 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:39:57.233962 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:57.373271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:57.714126 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:58.012238 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en |
| 2024-12-22T00:39:58.338509 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:59.271563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:59.272403 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:59.273692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:39:59.859685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:00.191297 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:00.544306 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:00.801431 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:01.065064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:01.722738 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:01.954050 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:02.549863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:02.794515 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:03.744648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:03.988063 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:05.065749 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en |
| 2024-12-22T00:40:05.128040 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:05.129202 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:05.391265 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=1995/0057(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823')) |
| 2024-12-22T00:40:05.393907 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823 |
| 2024-12-22T00:40:05.619805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:06.746897 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:06.844814 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:07.684780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:07.685577 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:07.864323 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:07.923060 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:16.082847 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:16.086364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:16.088898 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:16.090878 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:16.095642 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:16.098731 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:18.675883 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:18.678401 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:18.680336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:18.681645 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:18.686048 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:18.690342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:20.003628 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:20.933685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:20.934935 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:20.937037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:21.071909 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:21.072595 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:21.513741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:21.515664 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:22.227981 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0188(NLE)&l=en'} (ValueError()) |
| 2024-12-22T00:40:22.229900 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:40:22.299799 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0072(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574')) |
| 2024-12-22T00:40:22.301236 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574 |
| 2024-12-22T00:40:22.461043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:23.186954 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:23.349422 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:23.577577 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:24.086911 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:24.150851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:24.711009 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:24.806210 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:25.546276 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:25.621421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:26.025519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:26.103749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:26.404386 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:26.405479 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:26.941289 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:26.994523 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:27.713774 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:27.768536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:28.603659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:28.772238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:40:28.773097 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:40:28.970535 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:29.076922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:29.656593 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:30.076655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:30.275708 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:31.052693 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:31.379764 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:31.380624 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:31.975493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:31.976388 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:32.195504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:32.232842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:32.669792 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:33.231963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:33.869871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:34.379983 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:34.729778 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:34.731977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:35.004530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:35.661218 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:35.943973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:36.161101 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:36.822566 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:36.900977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:37.089795 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:37.557363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:37.644469 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:38.288044 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:38.609395 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:39.241154 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:39.473237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:39.769618 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:40.028968 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:40.704857 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:41.891823 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:42.245379 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:43.011340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:43.648157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:44.141006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:44.147626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:44.452946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:45.262203 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:45.335174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:45.783658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:46.351871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:46.692237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:46.694400 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:46.749041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:47.366468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:47.813720 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:48.990871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:50.199651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:51.209737 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:51.210700 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:40:52.074278 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:52.230498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:52.721701 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:52.725690 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:53.162165 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:53.438185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:54.252428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:54.538345 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:54.868497 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:55.267257 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:55.764361 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:40:55.821294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:40:55.914200 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:56.156275 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en |
| 2024-12-22T00:40:56.421895 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en |
| 2024-12-22T00:40:56.903216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:56.904167 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:57.223281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:57.438795 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:57.915913 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:58.250631 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:58.251373 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:40:59.501584 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:40:59.863434 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:00.106281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:01.533016 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:01.727662 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en |
| 2024-12-22T00:41:02.002132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:02.181821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:02.377267 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:02.871574 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0062(NLE)&l=en |
| 2024-12-22T00:41:03.621606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:03.726005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:04.151730 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:04.653092 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:04.906550 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:04.908664 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:04.909836 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:41:04.911689 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:41:05.179971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:06.052330 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:07.985918 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:08.125899 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:10.177171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:10.330841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:10.513507 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:10.679430 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:11.313732 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:11.466829 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:11.468365 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:41:11.469311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:11.934133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:12.662135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:12.961675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:12.963947 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:13.591282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:13.846554 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:14.089888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:14.090674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:41:14.092362 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:41:14.201807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:15.175413 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:15.235528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:15.389028 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:16.279480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:16.282900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:16.344409 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:16.603310 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:16.658512 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:17.290648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:17.758949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:17.759998 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:41:18.518327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:18.519199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:19.452208 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:19.666477 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:20.883859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:20.885335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:20.886718 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:41:22.056768 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:22.058249 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:23.255536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:23.345035 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:24.706110 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:41:24.706629 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:41:24.708234 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:41:24.958118 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en |
| 2024-12-22T00:41:25.865993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:25.867737 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:41:25.869627 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0224(COD)&l=en |
| 2024-12-22T00:41:26.684727 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en |
| 2024-12-22T00:41:30.844161 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:31.060211 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0225(COD)&l=en |
| 2024-12-22T00:41:32.900741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:32.902410 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:41:34.649936 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:34.930666 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:35.271826 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:35.861527 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:36.098884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:37.178285 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:37.816902 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:41:37.817254 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0329(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:41:37.818212 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:41:38.170243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:38.451854 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:38.888616 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:39.133308 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:39.972919 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:40.220212 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:40.654439 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:41.258180 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:41.605911 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:41.726671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:41.876135 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2688(RSO)&l=en |
| 2024-12-22T00:41:41.948925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:42.356580 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:43.853140 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:44.629864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:41:44.750985 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:53.335876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:41:53.340363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:53.358946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:53.360801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:55.583052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:55.788334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:55.893737 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:55.954321 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:56.191256 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:56.191999 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:41:56.482428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:56.796964 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:57.950904 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:58.080236 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:58.216201 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:58.499711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:58.563672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:41:58.695451 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:58.827000 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:41:59.053915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:00.538867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:00.825315 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:00.835100 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:00.836159 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:42:00.896326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:01.034147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:01.540622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:01.545739 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:01.902509 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:02.846480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:03.132980 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:03.264733 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:03.586499 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:03.818483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:03.909123 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:04.205244 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:04.286582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:04.917238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:05.414705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:05.683209 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:05.848353 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:06.199405 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:06.600595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:06.697055 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:06.698022 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:42:06.757431 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:07.050915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:08.047571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:08.317688 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:08.567185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:08.889868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:09.674995 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:10.330563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:11.605164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:11.609674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:11.620144 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:12.047332 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en |
| 2024-12-22T00:42:12.259311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:12.343051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:12.584850 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:12.592740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:13.828158 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:14.576617 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:14.890296 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:14.893196 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:42:15.122719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:15.511347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:15.705280 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0005(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015')) |
| 2024-12-22T00:42:15.707001 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015 |
| 2024-12-22T00:42:16.441331 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:17.194095 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:17.195186 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:17.197261 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:17.199967 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:42:17.601077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:17.845676 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:17.964466 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:17.965641 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:42:18.422198 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:18.422872 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:18.713458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:19.726088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:19.941713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:19.942316 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:20.230595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:20.235560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:20.238398 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:20.539802 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:20.595938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:42:20.596504 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:42:20.597077 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:20.967849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:21.684839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:22.529364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:22.920145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:22.922996 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:23.016307 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:23.107605 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:23.354992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:23.585999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:24.354028 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:24.953104 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:24.953667 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:42:25.548181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:25.640400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:25.950801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:25.954405 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:26.071008 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:26.074084 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:27.180246 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:27.181595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:27.825046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:28.225847 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:28.431534 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:28.432340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:29.014048 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:29.014627 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:30.272969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:30.488971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:30.776890 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:30.789293 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:42:30.789637 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0400B(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:42:30.790472 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:42:32.952175 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:33.327293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:33.328243 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:33.329029 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:33.329832 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:33.331003 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:34.534591 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:35.283801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:35.493585 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:35.702917 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:35.706332 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:35.838831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:37.010949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:37.158066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:37.158688 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:37.477978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:37.668715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:37.780014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:38.075010 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:38.075907 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:39.264285 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:39.265190 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:42:39.666336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:39.667340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:39.805329 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:40.120461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:40.352161 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:40.443497 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:40.777550 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:41.733936 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:42.189758 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:42.260162 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:42.342373 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:42.586578 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:42:42.680347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:42.923560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:42.924306 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:43.393103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:44.090119 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:44.883989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:44.884778 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:45.110372 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:45.220548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:45.292845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:45.664426 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en |
| 2024-12-22T00:42:45.670339 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:45.748839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:46.445938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:42:47.342068 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:47.940448 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:48.027359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:48.274728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:48.277103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:48.623354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:42:48.879335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:48.931119 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2852(RSP)&l=en |
| 2024-12-22T00:42:49.234467 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:49.585516 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:50.437878 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:50.514934 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:50.731010 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en |
| 2024-12-22T00:42:51.117575 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:51.479503 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:51.745634 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2858(RSP)&l=en |
| 2024-12-22T00:42:51.948106 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:51.954541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:51.962205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:51.967589 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:52.937143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:52.937915 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:53.606487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:54.231618 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:54.234528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:54.559749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:54.560526 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:55.030299 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:55.245034 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:55.291766 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:42:55.302960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:56.177301 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:56.628329 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en |
| 2024-12-22T00:42:56.672795 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:56.674428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:56.679296 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:56.990170 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2211(INI)&l=en |
| 2024-12-22T00:42:57.065815 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2212(INI)&l=en |
| 2024-12-22T00:42:57.525262 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:57.526196 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:57.815905 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:58.265664 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:58.266272 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:42:58.266912 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:42:59.177626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:59.296945 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:59.376684 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:42:59.498471 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:42:59.621316 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:00.079142 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:00.851509 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:00.852372 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:00.853747 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:00.854576 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:01.537855 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:01.749453 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:02.004226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:02.323168 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:02.324278 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:02.556259 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en |
| 2024-12-22T00:43:02.714238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:02.834334 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en |
| 2024-12-22T00:43:03.029919 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2163(INI)&l=en |
| 2024-12-22T00:43:03.277589 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:03.434467 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:03.954638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:04.174674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:04.389296 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:05.339229 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:05.747183 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:05.976160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:06.090334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:06.418692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:06.626438 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2519(RSP)&l=en |
| 2024-12-22T00:43:06.690024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:08.285559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:08.955862 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:08.986944 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en |
| 2024-12-22T00:43:09.748774 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:09.750648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:09.987327 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en |
| 2024-12-22T00:43:10.226803 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en |
| 2024-12-22T00:43:10.347306 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:11.512426 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:11.891603 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en |
| 2024-12-22T00:43:11.896639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:12.079174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:12.233114 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en |
| 2024-12-22T00:43:12.306569 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en |
| 2024-12-22T00:43:12.361998 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en |
| 2024-12-22T00:43:12.367791 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:12.540253 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en |
| 2024-12-22T00:43:12.594026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:12.647255 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en |
| 2024-12-22T00:43:12.769082 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en |
| 2024-12-22T00:43:12.769610 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en |
| 2024-12-22T00:43:13.200787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:13.292549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:13.489996 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en |
| 2024-12-22T00:43:13.542589 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en |
| 2024-12-22T00:43:13.757152 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en |
| 2024-12-22T00:43:13.848672 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en |
| 2024-12-22T00:43:14.046394 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en |
| 2024-12-22T00:43:14.102734 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en |
| 2024-12-22T00:43:14.269860 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en |
| 2024-12-22T00:43:14.307351 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en |
| 2024-12-22T00:43:14.779169 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:15.088380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:15.090589 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:15.132713 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2591(RSP)&l=en |
| 2024-12-22T00:43:15.498577 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en |
| 2024-12-22T00:43:17.125347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:17.556857 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:17.831793 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:18.877183 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:19.512298 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en |
| 2024-12-22T00:43:19.630166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:19.736385 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:19.737133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:20.205805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:21.260993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:21.824584 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:21.919901 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:22.162036 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:22.537540 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:22.541952 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:22.545180 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:23.646371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:43:23.724900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:23.786967 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:23.952199 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2072(INL)&l=en |
| 2024-12-22T00:43:24.106293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:24.651824 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:24.747354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:24.820397 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:24.979877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:26.144803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:26.701046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:26.800167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:26.995147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:27.225544 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:27.226998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:27.556072 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:28.930841 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en |
| 2024-12-22T00:43:29.035024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:29.042731 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:29.262653 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en |
| 2024-12-22T00:43:29.904658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:29.921274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:29.973953 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:29.974811 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:30.246867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:31.401640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:31.570812 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:31.730858 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:32.096454 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:32.188170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:32.432921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:32.739938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:32.740666 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:33.759006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:34.308662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:34.593011 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:35.351650 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:35.353205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:36.113073 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:36.184797 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:36.943114 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:37.166874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:37.731193 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:37.839509 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:38.687144 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:39.054576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:39.055343 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:39.056715 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:39.645629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:39.726281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:40.005316 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:41.595924 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:41.640231 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:41.989339 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:42.043696 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:42.259648 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2200(IMM)&l=en |
| 2024-12-22T00:43:42.629852 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en |
| 2024-12-22T00:43:42.938630 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en |
| 2024-12-22T00:43:43.238794 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:43.488002 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:44.761285 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:44.969327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:45.489128 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:46.213312 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:46.835495 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:46.836336 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:47.768943 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:47.835408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:47.985034 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:48.444830 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:48.455716 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:48.457347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:48.465779 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:49.457270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:50.139211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:50.525873 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:50.620834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:50.782141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:50.909151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:51.167847 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.844437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.847840 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.850408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.852460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.854537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:43:58.859105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.862061 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:43:58.868569 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:43:58.885664 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:43:59.164416 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en |
| 2024-12-22T00:44:01.398590 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.399181 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:44:01.728854 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.730723 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.741643 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.744438 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.757780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.871531 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:01.872408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:03.222267 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:03.880515 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:04.416292 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:04.434443 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:04.644629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:04.646149 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:04.651266 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:04.656946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:05.843643 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:06.112160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:06.762241 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:07.052511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:07.062960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:07.112975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:07.360512 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:08.017424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:08.276402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:09.034786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:09.349040 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:09.401815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:09.778934 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:10.453925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:10.601034 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:11.474243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:11.565655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:11.859953 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:12.720017 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:13.140319 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:13.141113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:13.142039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:13.853876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:13.980332 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:14.375869 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:14.872101 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:15.614505 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:15.700991 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:15.859113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:16.212806 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:16.645335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:17.312880 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:18.217891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:18.273979 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:18.797670 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:18.859090 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:44:18.859413 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0060(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:44:18.860569 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:44:19.088211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:19.764343 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:20.510601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:21.514378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:21.515944 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:21.517079 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:44:21.858701 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:22.338270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:22.714762 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:24.128445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:24.129787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:24.132739 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:24.391632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:24.622348 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:24.681544 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:24.794220 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:25.183680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:26.440580 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:26.447238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:26.552496 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:26.929684 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:26.930421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:27.201514 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:27.499523 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:27.827560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:28.727427 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:28.921407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:29.152402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:29.406908 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:29.408376 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:29.877833 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:30.020215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:30.143448 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:31.269735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:31.483325 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2061(INI)&l=en |
| 2024-12-22T00:44:31.609635 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:31.611215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:31.813427 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en |
| 2024-12-22T00:44:32.016266 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:32.202443 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:32.809548 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:32.816807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:32.818272 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:44:34.087811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:34.166638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:34.296275 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:34.791826 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:34.939991 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:34.941890 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:35.263563 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2730(RSP)&l=en |
| 2024-12-22T00:44:35.623666 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:36.196442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:36.424371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:36.565612 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:37.622128 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:37.626218 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:37.788173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:38.195249 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-22T00:44:38.196120 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:44:38.722165 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:38.930281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:39.632035 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:39.632853 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:44:40.240535 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:40.241324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:40.320943 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:40.508622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:40.514971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:41.301803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:42.145922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:42.553604 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:42.782796 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:43.071627 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:43.130344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:43.226307 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-22T00:44:43.819937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:45.154891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:46.216713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:46.658138 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2157(DEC)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966')) |
| 2024-12-22T00:44:46.661249 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966 |
| 2024-12-22T00:44:47.538718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:48.198942 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:48.874198 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:48.881482 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:49.096745 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:49.337600 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0211(COD)&l=en |
| 2024-12-22T00:44:50.113249 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:50.117604 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:50.118987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:50.220143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:50.651324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:51.187518 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:51.731294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:52.388334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:52.570661 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:52.984709 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:53.530657 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:54.368986 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:54.392194 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:44:54.392504 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0213(CNS)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:44:54.393285 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:44:54.833334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:54.969612 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:55.069624 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:55.319855 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:56.185914 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:56.812442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:56.948678 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:57.648801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:44:57.651503 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:57.652654 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:57.877671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:58.396062 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:58.397444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:58.398520 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:44:59.546451 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:44:59.608184 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:00.067244 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:00.070077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:00.197131 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:00.198438 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:00.765569 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:00.766298 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:45:01.872820 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:02.331855 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:02.428377 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2175(IMM)&l=en |
| 2024-12-22T00:45:02.433130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:02.714340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:02.828075 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:03.161227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:04.674728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:04.675750 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:04.955209 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:05.542208 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:07.100859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:07.629675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:45:07.631074 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:07.633375 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:45:07.999541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:45:08.000604 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:45:09.459139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:09.726571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:09.727366 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:09.794803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:10.648866 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:10.738456 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:10.739207 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:11.116974 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:11.205980 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:11.858956 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:12.096006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:12.233418 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:12.657379 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:12.718266 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:13.290242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:13.855087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:13.857047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:14.670188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:14.815390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:15.512968 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:15.514282 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:15.522343 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:15.581705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:16.199014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:16.396559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:17.022742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:17.631052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:17.808440 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:18.005337 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:18.616698 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:18.618073 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:18.618834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:18.892312 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2939(RSP)&l=en |
| 2024-12-22T00:45:18.896692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:19.128380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:19.259893 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2998(RSP)&l=en |
| 2024-12-22T00:45:19.974024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:19.974897 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:20.022416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:20.082818 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:20.247995 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2198(INI)&l=en |
| 2024-12-22T00:45:20.419698 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2213(INI)&l=en |
| 2024-12-22T00:45:21.086553 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:21.096516 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:45:21.096944 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0387(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:45:21.097953 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:45:22.459666 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:22.463083 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:23.108200 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:45:23.108673 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0375(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:45:23.109490 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:45:23.290552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:23.452026 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/3011(RSP)&l=en |
| 2024-12-22T00:45:23.863362 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:25.606670 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:25.848212 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:25.849758 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:25.961912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:26.050843 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:26.496168 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:27.937963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:27.941987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:27.943817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:28.007891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:28.254255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:28.399273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:29.099302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:29.105940 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:30.405182 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:30.467783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:30.701478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:30.702332 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:30.703685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:30.764897 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2020/2259(INI)&l=en |
| 2024-12-22T00:45:30.929567 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:31.416043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:32.668277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:33.169104 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:33.658349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:33.663079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:33.667384 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:33.669824 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:34.554649 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:34.902973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:35.560419 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:35.763164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:35.828484 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:36.106441 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:36.273842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:36.274732 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:36.821891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:37.558217 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:37.823134 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:37.914971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:37.920936 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2238(INI)&l=en |
| 2024-12-22T00:45:38.086397 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:38.298174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:38.641972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:45:38.986746 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:39.100386 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:39.819093 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:40.325819 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:40.666850 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:41.297945 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2506(RSP)&l=en |
| 2024-12-22T00:45:42.596587 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:45:42.777857 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:43.343571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:43.482088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:43.980652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:44.221135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:44.588832 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:45.275559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:45.341214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:52.173974 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:52.175773 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:52.181131 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:52.182692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:52.187474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:52.501467 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2554(RSP)&l=en |
| 2024-12-22T00:45:54.414796 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:54.495396 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:54.559797 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:54.749293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:54.750788 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:45:54.753513 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:54.881079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:54.960325 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:56.503620 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:57.040087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:57.260310 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:57.366041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:57.594354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:57.641305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:57.642976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:45:58.688816 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:59.118772 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:45:59.897218 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:00.142151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:00.228170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-22T00:46:00.382942 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:00.384396 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:01.125244 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:01.619129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:02.505945 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:02.507726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:02.510257 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:02.603438 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:02.773984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:02.970718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:03.881037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:04.274557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:04.843416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:04.995820 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:05.122743 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:05.126180 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:05.339822 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:06.446992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:06.646582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:07.125576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:07.800327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:07.804636 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:07.819275 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:08.093800 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:08.759844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:09.025607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:09.921482 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:10.415561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:10.530663 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:10.675774 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:46:10.676422 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0125(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:46:10.677580 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:46:10.681779 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:11.185059 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:11.738464 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:11.739221 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:12.235026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:12.936327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:13.103340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:13.195418 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:13.373969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:14.318468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:14.319325 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:15.211994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:15.301465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:15.559312 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:16.551328 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:16.622237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:16.848593 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:16.849844 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:17.617367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:17.890964 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:18.680333 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:18.681941 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:18.683410 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:19.018917 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:19.307581 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:19.650917 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:20.087052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:20.149238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:21.080559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:21.252233 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:21.340716 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:21.657135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:21.798407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:22.349278 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:22.740642 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:23.101280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:23.884242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:23.889731 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:23.997553 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:24.275497 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:24.345808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:25.081177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:26.198609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:26.482538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:26.483725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:27.010668 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:27.011435 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:27.088623 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:27.638842 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:28.046653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:29.006315 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:29.721937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:29.722897 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:30.661141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:30.662284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:30.671566 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:30.857007 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:32.091963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:32.094504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:32.414126 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:33.160113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:33.297780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:33.443815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:34.563210 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:34.648848 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:34.716851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:34.923265 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:35.551581 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:35.952284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:36.908989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:36.910022 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:36.911488 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:37.141697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:37.637918 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:38.273712 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:38.591469 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2863(RSP)&l=en |
| 2024-12-22T00:46:38.716917 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:39.276080 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:39.452543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:39.755000 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:40.214522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:40.831580 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:41.155576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:41.370602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:41.916710 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:42.075105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:43.170086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:43.173244 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:46:43.582933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:43.637419 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:44.076444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:44.077226 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:46:44.371994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:44.652192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:45.680375 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:45.781857 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:46.301370 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:46.682859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:46.744638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:47.076170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:47.077634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:48.690570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:49.287192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:49.288600 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:49.631597 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:49.632969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:51.087167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:51.430394 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:51.599966 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:51.819319 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:51.979257 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:52.380235 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:53.312240 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:53.852970 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:53.891596 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:53.988959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:54.217270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:54.218054 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:54.809809 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:54.810603 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:55.473402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:56.788996 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:57.256786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:57.259349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:46:57.513148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:57.677652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:58.067638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:46:58.574418 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:46:59.487615 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:47:00.028703 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/3010(RSP)&l=en |
| 2024-12-22T00:47:00.374947 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2209(IMM)&l=en |
| 2024-12-22T00:47:00.382648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:02.348215 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0391(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360')) |
| 2024-12-22T00:47:02.349658 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360 |
| 2024-12-22T00:47:02.502659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:02.644034 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:04.652380 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0394(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287')) |
| 2024-12-22T00:47:04.668277 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287 |
| 2024-12-22T00:47:04.712038 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:05.057281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:47:05.057873 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-22T00:47:05.326745 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0396(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419')) |
| 2024-12-22T00:47:05.329602 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419 |
| 2024-12-22T00:47:05.554575 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2203(INI)&l=en |
| 2024-12-22T00:47:05.852521 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:05.860077 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2008(IMM)&l=en |
| 2024-12-22T00:47:06.372490 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:07.385637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:07.631865 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:08.036164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:08.475844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:08.999688 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:10.322442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:10.464566 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:10.470977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:10.767501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:10.973140 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:11.746998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:11.747736 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:47:12.264201 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:12.969730 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:12.974545 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:12.979871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:13.335125 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2567(RSP)&l=en |
| 2024-12-22T00:47:13.340177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:13.609640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:14.150041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:15.705293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:15.840135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:15.842052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:16.611181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:16.612607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:16.614136 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:47:16.615107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:16.616132 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:47:16.967790 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:17.277714 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2592(RSP)&l=en |
| 2024-12-22T00:47:17.338021 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2597(RSP)&l=en |
| 2024-12-22T00:47:17.783350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:18.055963 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2614(RSP)&l=en |
| 2024-12-22T00:47:18.309540 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0077(COD)&l=en |
| 2024-12-22T00:47:18.786921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:19.542517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:19.987631 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:21.101138 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:47:21.101548 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0059(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:47:21.102420 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:47:21.534309 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:22.804877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:22.815352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:23.375189 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2039(IMM)&l=en |
| 2024-12-22T00:47:23.606851 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2649(RSP)&l=en |
| 2024-12-22T00:47:23.628412 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0053(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293')) |
| 2024-12-22T00:47:23.629938 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293 |
| 2024-12-22T00:47:23.884157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:24.493881 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:47:24.494267 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0085(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:47:24.495007 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:47:25.109388 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:25.919487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:26.023016 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:27.230725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:27.581571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:29.912732 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:30.498346 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:38.424987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:38.427124 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:38.431561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:38.447100 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:47:41.564817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:43.380631 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:47:43.380996 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0130(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:47:43.381721 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:47:43.857230 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:43.868598 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:47:43.870474 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0128(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:47:43.872207 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:47:46.354287 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:46.867710 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:47.152969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:47.626949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:48.188105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:48.957728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:47:49.765046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:50.548340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:51.047957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:47:52.364457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:52.366258 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:53.806174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:53.990476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:55.201202 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:55.305896 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:56.506891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:57.257804 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:58.579943 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:58.876241 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:59.242983 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:59.619866 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:59.855766 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:47:59.975401 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:00.935560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:02.162597 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:04.519633 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-22T00:48:05.188664 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:05.256151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-22T00:48:06.223680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:06.614973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:11.932476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:12.134519 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0259(NLE)&l=en'} (ValueError()) |
| 2024-12-22T00:48:12.135949 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:48:12.363960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:12.439719 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2104(INL)&l=en |
| 2024-12-22T00:48:12.620641 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2125(INI)&l=en |
| 2024-12-22T00:48:13.179033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:13.561958 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:14.289734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:14.290296 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:48:14.805659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:15.374615 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:15.497727 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:15.811165 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:18.723822 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:48:18.724454 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0134(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:48:18.725678 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:48:19.555360 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2710(RSP)&l=en |
| 2024-12-22T00:48:22.100999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:22.149522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:22.168341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:23.057108 | dossier | warning | no body mapping found for "Matter referred back to the committee responsible for reconsideration" |
| 2024-12-22T00:48:23.809800 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:24.136705 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:48:24.138719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:24.610058 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:24.934145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:25.175502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:26.058564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:26.244974 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:26.885106 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:27.243221 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:27.594462 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:27.765454 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:27.982929 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:29.054579 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:48:29.279563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:29.280741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:30.345262 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:30.628490 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:31.704325 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:31.765493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:32.353167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:32.447554 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:33.096340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:33.231157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:33.519320 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2191(IMM)&l=en |
| 2024-12-22T00:48:33.525473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:34.600076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:34.779341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:35.563729 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:37.147836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:37.454170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:38.116865 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:38.237134 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:40.826113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:41.053491 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:41.107489 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:41.253637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:41.413281 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2200(IMM)&l=en |
| 2024-12-22T00:48:41.593675 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2199(IMM)&l=en |
| 2024-12-22T00:48:44.124728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:44.131876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:44.933043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:44.939415 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:45.359663 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:47.876365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:48.295828 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:48.458239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:48.498296 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2927(RSP)&l=en |
| 2024-12-22T00:48:48.650275 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:49.235375 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:49.890926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:50.604218 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:50.605184 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:52.139801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:52.379923 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:53.075193 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:53.376279 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:53.756208 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:53.880460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:54.061004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:55.834026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:56.255730 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:57.546189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:57.921173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:58.296205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:58.723454 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:48:59.444314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:48:59.742114 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2989(RSP)&l=en |
| 2024-12-22T00:48:59.844127 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:01.896437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:01.963348 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:02.261100 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:02.574302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:03.005281 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:03.787147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:04.130828 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:06.858575 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:07.286478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:07.795574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:08.820648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:09.849739 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:10.930851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:11.433182 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:11.487145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:19.694946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:49:24.409821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:24.542503 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:24.632177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:26.149815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:26.983251 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:49:26.983633 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0448(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:49:26.984808 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:49:27.800012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:27.853811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:29.713171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:30.026248 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:30.377012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:31.309710 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:31.608202 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:31.608894 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:49:33.445470 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:33.668954 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:33.940738 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:34.986020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:35.597933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:36.212662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:38.050390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:38.052909 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:38.303077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:41.328786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:42.919064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:44.177219 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:45.253748 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:46.670611 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:46.673214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:47.070175 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:47.074565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:47.089667 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-22T00:49:47.090084 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0035(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:49:47.090970 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:49:47.383340 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:49:47.383852 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0038(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:49:47.384732 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:49:48.884211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:49.192132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:50.585783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:50.795348 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:50.797518 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:51.400615 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:51.477130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:51.552998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:53.232279 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:54.095416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:54.323750 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:55.087051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:55.304877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:55.981935 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:56.060926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:56.331203 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:57.855921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:58.523889 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:49:58.524952 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:58.845274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:59.344880 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2593(RSP)&l=en |
| 2024-12-22T00:49:59.567993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:49:59.858166 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2622(RSP)&l=en |
| 2024-12-22T00:50:01.485018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:01.979446 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:50:01.979867 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0059(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:50:01.980722 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:50:02.669356 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:50:02.669817 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0060(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:50:02.670866 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:50:03.450820 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:03.633711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:04.489658 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-22T00:50:04.490057 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0061(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-22T00:50:04.490864 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-22T00:50:04.914227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:05.054814 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:05.250046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:05.415228 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:05.617564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:07.126248 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:07.191716 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:08.188345 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:08.292574 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:08.385744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:08.547519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:09.013273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:09.225983 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:10.745658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:11.651285 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:11.803458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:11.807531 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:11.809568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:11.999250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:12.000494 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:12.366586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:14.020311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:14.750226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:14.827015 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:15.036511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:15.438285 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:15.737078 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:15.830276 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:16.517018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:17.430783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:17.864846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:17.992636 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:18.175804 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2010(IMM)&l=en |
| 2024-12-22T00:50:19.002487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:19.181741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:19.336352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-22T00:50:19.337283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:19.338971 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-22T00:50:19.831836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:21.947731 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2711(DEA)&l=en |
| 2024-12-22T00:50:23.266773 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:23.646995 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:50:23.647429 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0101(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:50:23.648336 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:50:25.742272 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:50:25.742742 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0155(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:50:25.743945 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:50:29.987900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:32.181741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:32.579978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:33.709378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:33.711454 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:33.712924 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:50:33.914295 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:34.457611 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:36.091022 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:36.245566 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:36.246158 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:50:36.784527 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:37.150949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:37.293483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:37.486441 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:38.577737 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:38.847698 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:39.335863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:39.987476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-22T00:50:40.314215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:40.371212 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:40.371881 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:50:40.859001 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:47.468302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:48.231026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:48.402400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:48.403087 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:50:49.134328 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:50.929547 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:51.226501 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:50:51.226914 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0178(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:50:51.227869 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:50:51.278167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:51.568351 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:52.156287 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:53.935476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:54.934424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:55.058194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:50:55.535817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:55.742505 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:55.743123 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:50:56.109465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:56.110196 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-22T00:50:56.726389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:58.247814 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:58.248536 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-22T00:50:59.008899 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:59.010066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:50:59.212652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:00.657103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:00.827465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:00.882968 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:00.955435 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:00.956308 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-22T00:51:02.916305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:03.384466 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:03.531692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:04.631043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:04.896529 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:04.951422 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:06.473077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:07.780461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:08.127511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:08.321094 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:09.896664 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:10.230082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:12.049122 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:12.981218 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:13.560556 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:14.295418 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:16.455575 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:16.952893 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:16.954338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:17.414538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:18.644889 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2783(RSP)&l=en |
| 2024-12-22T00:51:20.460232 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:51:20.460572 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0245(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:51:20.461396 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:51:20.924445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:21.387291 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:22.105337 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:22.551595 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
| 2024-12-22T00:51:22.830959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:25.078874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:25.688275 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2053(INI)&l=en'} (ValueError()) |
| 2024-12-22T00:51:25.689299 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:51:29.048034 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2057(INI)&l=en'} (ValueError()) |
| 2024-12-22T00:51:29.049121 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:51:30.151901 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2056(INI)&l=en'} (ValueError()) |
| 2024-12-22T00:51:30.152990 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:51:31.286722 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:32.659382 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:33.336243 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:33.433310 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:34.429630 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:35.039902 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:37.125012 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:37.126805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:37.369712 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:37.983828 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0267(NLE)&l=en'} (IndexError('list index out of range')) |
| 2024-12-22T00:51:37.984749 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 265, in scrape_ep_key_players
tmp = junws(cells[2])
~~~~~^^^
IndexError: list index out of range |
| 2024-12-22T00:51:38.305435 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
| 2024-12-22T00:51:38.593793 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0275(COD)&l=en'} (ValueError()) |
| 2024-12-22T00:51:38.594733 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-22T00:51:40.379622 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:51:40.380044 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0263(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:51:40.380978 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:51:41.216166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:41.507735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:41.688174 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
| 2024-12-22T00:51:41.690023 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:41.913845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:42.885874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:42.965557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:44.558529 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-22T00:51:45.311759 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:51:45.312194 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0260(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:51:45.312998 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:51:45.581978 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:51:45.583160 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0159M(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:51:45.584716 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:51:45.585309 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-22T00:51:46.152321 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-22T00:51:46.152727 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0253(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-22T00:51:46.153606 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-22T00:53:32.158337 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T00:54:05.987350 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T00:54:43.401559 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-22T00:54:43.476250 plenaries warning no url in 1996/2679(RSP) {'date': '1996-11-12T00:00:00', 'docs': [{'url': 'https://eur-lex.europa.eu/JOHtml.do?uri=OJ:C:1996:362:SOM:EN:HTML', 'title': 'OJ C 362 02.12.1996, p. 0019'}, {'title': 'B4-1326/1996'}], 'type': 'Motion for a resolution', 'body': 'EP'} |
| 2024-12-22T00:57:38.413384 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T00:57:42.170169 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T00:58:42.648509 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:05:33.610238 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:06:31.150034 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:06:32.749897 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:08:19.575479 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:10:00.419157 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:11:08.339291 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:13:10.853201 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:13:21.231598 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:13:32.169427 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:15:55.020489 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:17:59.713406 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:18:15.006415 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:19:01.488365 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:20:15.616942 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:20:39.327896 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:21:15.987401 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:23:00.789586 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:23:18.242842 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:24:58.640130 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:25:32.058728 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:25:59.938790 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:26:08.204954 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:26:26.017266 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:26:41.919975 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:27:13.630217 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-22T01:27:42.646796 | mep_activity | warning | pe, has not expected format: 'Commission' |