BETA

Summary for scraper logs from the 2020-05-21

Summary of log messages

LevelCount
Exceptions1
error13
warning52
info44104
debug124581

Summary of changes

TypeAddedUpdated
mep 0 7
dossier 3 0
amendment 23458 0
mep_activity 697 0
comagenda 46 0

Unknown MEPs

EventCount
Pierfrancesco2
Nathalie2
Klemen2
Paolo De2
Jordi2
Alicia Homs2
Alicia2
Fredrick2
Sylwia2
Robert2
Nikos1
Miriam1
Theodoros1
Maria1
Malik1
Martin1
Ondřej1
Costas1
Gabriele Bischoff Costas Mavrides1
Antonio Maria1
Estrella Durá1
Sylvie1
Bartosz1
Alex Agius1
Pierfrancesco Majorin1
Brando BenifeiVilija Blinkevičiūtė1
Javi1
Agnes1
César1
Alexandra Louise1
Evelyne1
Liesje1
José Ramón Bauzá Díaz Elsi Katainen1
José Ramón Bauzá Díaz Jan-Christoph Oetjen1
Carmen1
Attila1
Monika1
Cornelia1
Laurence1
Giuliano PisapiaDomènec Ruiz Devesa1
Ramona1
Gianna Gancia Mara Bizzotto1

Log Entries

TimeModuleLevelMessage
2020-05-21T00:13:08.311628mgrerrorfailed to execute dossiers job {'all': False, 'onfinished': {'daisy': True}} (AttributeError("object has no attribute 'title'"))
2020-05-21T00:13:08.314575mgrerrorTraceback (most recent call last):
File "/usr/lib/python3/dist-packages/feedparser.py", line 406, in __getattr__
    return self.__getitem__(key)
  File "/usr/lib/python3/dist-packages/feedparser.py", line 364, in __getitem__
    return dict.__getitem__(self, key)
KeyError: 'title'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 63, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossiers.py", line 101, in scrape
    get_new_dossiers(**kwargs)
  File "scrapers/dossiers.py", line 49, in get_new_dossiers
    ref = item.title
  File "/usr/lib/python3/dist-packages/feedparser.py", line 408, in __getattr__
    raise AttributeError("object has no attribute '%s'" % key)
AttributeError: object has no attribute 'title'
2020-05-21T00:14:03.136405dbwarningno mepid found for "Pierfrancesco"
2020-05-21T00:14:05.125137dbwarningno mepid found for "Nikos"
2020-05-21T00:14:20.756257dbwarningno mepid found for "Miriam"
2020-05-21T00:14:38.480504dbwarningno mepid found for "Theodoros"
2020-05-21T00:14:38.689261dbwarningno mepid found for "Nathalie"
2020-05-21T00:15:40.320921dbwarningno mepid found for "Maria"
2020-05-21T00:16:21.060003dbwarningno mepid found for "Klemen"
2020-05-21T00:17:10.322411amendmenterror[!] couldn't find ref: Committee on Development
2020-05-21T00:17:11.451635amendmenterror[!] couldn't find ref: Committee on Development
2020-05-21T00:17:11.452680amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641421_EN.pdf
2020-05-21T00:17:12.634093amendmenterror[!] couldn't find ref: Committee on Development
2020-05-21T00:17:12.639994amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/DEVE-AM-641422_EN.pdf
2020-05-21T00:17:17.117163dbwarningno mepid found for "Malik"
2020-05-21T00:17:39.403077dbwarningno mepid found for "Paolo De"
2020-05-21T00:19:00.714484dbwarningno mepid found for "Jordi"
2020-05-21T00:20:18.378610dbwarningno mepid found for "Martin"
2020-05-21T00:21:21.044089amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-05-21T00:21:26.026080dbwarningno mepid found for "Ondřej"
2020-05-21T00:21:36.784554amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2020-05-21T00:22:05.128767dbwarningno mepid found for "Costas"
2020-05-21T00:22:07.037540dbwarningno mepid found for "Alicia Homs"
2020-05-21T00:22:07.396801dbwarningno mepid found for "Gabriele Bischoff Costas Mavrides"
2020-05-21T00:22:48.280820dbwarningno mepid found for "Antonio Maria"
2020-05-21T00:23:10.998487dbwarningno mepid found for "Alicia"
2020-05-21T00:23:11.028689dbwarningno mepid found for "Estrella Durá"
2020-05-21T00:23:12.675086dbwarningno mepid found for "Alicia Homs"
2020-05-21T00:23:16.194957dbwarningno mepid found for "Sylvie"
2020-05-21T00:23:21.016779dbwarningno mepid found for "Jordi"
2020-05-21T00:23:21.406626dbwarningno mepid found for "Alicia"
2020-05-21T00:23:22.464135dbwarningno mepid found for "Bartosz"
2020-05-21T00:23:36.427197dbwarningno mepid found for "Pierfrancesco"
2020-05-21T00:23:39.475985dbwarningno mepid found for "Fredrick"
2020-05-21T00:23:45.798198dbwarningno mepid found for "Alex Agius"
2020-05-21T00:23:49.694919dbwarningno mepid found for "Pierfrancesco Majorin"
2020-05-21T00:24:03.072267amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-05-21T00:24:05.325759amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-05-21T00:24:17.769686dbwarningno mepid found for "Brando BenifeiVilija Blinkevičiūtė"
2020-05-21T00:24:29.949919dbwarningno mepid found for "Javi"
2020-05-21T00:24:51.401134amendmenterror[!] couldn't find ref: Committee on the Environment, Public Health and Food Safety
2020-05-21T00:24:55.489855dbwarningno mepid found for "Agnes"
2020-05-21T00:25:18.035977dbwarningno mepid found for "César"
2020-05-21T00:25:22.747163dbwarningno mepid found for "Sylwia"
2020-05-21T00:25:32.645333dbwarningno mepid found for "Alexandra Louise"
2020-05-21T00:26:01.821566dbwarningno mepid found for "Klemen"
2020-05-21T00:27:12.351586dbwarningno mepid found for "Evelyne"
2020-05-21T00:27:18.787238dbwarningno mepid found for "Robert"
2020-05-21T00:27:42.402413dbwarningno mepid found for "Liesje"
2020-05-21T00:27:59.557020dbwarningno mepid found for "José Ramón Bauzá Díaz Elsi Katainen"
2020-05-21T00:28:15.275249dbwarningno mepid found for "José Ramón Bauzá Díaz Jan-Christoph Oetjen"
2020-05-21T00:29:03.440973dbwarningno mepid found for "Robert"
2020-05-21T00:29:09.475995dbwarningno mepid found for "Paolo De"
2020-05-21T00:29:14.501357dbwarningno mepid found for "Carmen"
2020-05-21T00:29:22.140248dbwarningno mepid found for "Attila"
2020-05-21T00:29:22.862064dbwarningno mepid found for "Fredrick"
2020-05-21T00:29:39.839213dbwarningno mepid found for "Monika"
2020-05-21T00:31:12.737939dbwarningno mepid found for "Nathalie"
2020-05-21T00:31:23.201746dbwarningno mepid found for "Cornelia"
2020-05-21T00:31:23.862052dbwarningno mepid found for "Laurence"
2020-05-21T00:31:32.828879dbwarningno mepid found for "Giuliano PisapiaDomènec Ruiz Devesa"
2020-05-21T00:31:41.640192dbwarningno mepid found for "Sylwia"
2020-05-21T00:31:49.186355amendmenterror[!] couldn't find ref: Committee on Development
2020-05-21T00:31:50.362252dbwarningno mepid found for "Ramona"
2020-05-21T00:32:16.078802dbwarningno mepid found for "Gianna Gancia Mara Bizzotto"