BETA

Summary for scraper logs from the 2021-05-28

Summary of log messages

LevelCount
Exceptions9
error90
warning24
info44839
debug197226

Summary of changes

TypeAddedUpdated
mep 0 3
dossier 2 95
amendment 28400 0
mep_activity 704 0

Dossier events without known bodies

EventCount
"?!oeil-ANPRO!?"4

Unknown MEPs

EventCount
Estrella Durá1

Log Entries

TimeModuleLevelMessage
2021-05-28T00:33:46.544873mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:46.551321mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.590874mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0255&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.592015mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2066(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.593414mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2062(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.593813mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2073(IMM)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.594201mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2065(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.595554mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.597166mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.603024mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2055(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.603649mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2064(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-28T00:33:48.609268mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.609566mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.615999mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.619476mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:48.620641mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-28T00:33:56.723378dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-05-28T00:34:04.179950dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-05-28T00:34:20.080818dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-05-28T00:34:25.943189dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-05-28T00:34:35.022086dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-05-28T00:34:38.127870dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-05-28T00:35:37.319263dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-05-28T00:35:40.901298dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-05-28T00:36:38.606124dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-05-28T00:36:44.759316dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-05-28T00:36:50.513898dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-05-28T00:36:50.606300dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-05-28T00:36:51.238771dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-05-28T00:37:36.989639dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-05-28T00:37:37.292652dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-05-28T00:37:38.109044dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-05-28T00:38:14.519984dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-05-28T00:38:33.307719dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-05-28T00:39:30.431966dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-05-28T00:40:02.873722dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-05-28T00:40:05.486892dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-05-28T00:40:12.467621dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-05-28T00:40:17.636189dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-05-28T00:40:18.447716dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-05-28T00:40:26.929276dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-05-28T00:40:28.188110dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-05-28T00:40:28.453175dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-05-28T00:40:29.165423dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-05-28T00:40:29.619931dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-05-28T00:40:29.859238dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-05-28T00:40:29.970961dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-05-28T00:40:29.972448dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-05-28T00:40:29.973028dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-05-28T00:40:29.999391dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-05-28T00:40:30.001116dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-05-28T00:40:30.731722dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-05-28T00:40:31.357084dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-05-28T00:40:31.601376dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-05-28T00:40:31.657792dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-05-28T00:40:31.684941dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-05-28T00:40:31.693799dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-05-28T00:40:31.698742dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-05-28T00:40:31.897012dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-05-28T00:40:31.898552dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-05-28T00:40:31.970510dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-05-28T00:40:32.326651dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-05-28T00:40:43.912992dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-28T00:40:43.938556dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-28T00:40:43.987883dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-28T00:40:47.561106dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-05-28T00:40:47.567317dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-05-28T00:41:29.553271dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-05-28T00:41:29.579310dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-05-28T00:41:44.598957dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-05-28T00:41:45.726202dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-28T00:43:55.479169amendmenterror[!] couldn't find ref: Committee on Development
2021-05-28T00:45:21.169858amendmenterror[!] couldn't find ref: Committee on International Trade
2021-05-28T00:45:58.282054amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-05-28T00:45:58.282908amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-05-28T00:46:34.055873amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-05-28T00:46:36.693172amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-05-28T00:46:36.693685amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-05-28T00:46:41.978838dbwarningno mepid found for "Estrella Durá"
2021-05-28T00:48:02.513912mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T00:48:28.168562amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-05-28T00:48:28.171885amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-05-28T00:49:06.781809amendmentwarningno table
Text proposed by the Commission

(4) Concerning projects falling under the category set out in point (1)(d) of Annex II, the
criteria listed in Article 4 shall be evaluated as follows:
(a)                     Level of                    This criterion shall be measured by
                        sustainability              assessing the extent of the grids’ ability to
                                                    connect and transport variable renewable
                                                    energy.
(b)                     Security of supply          This criterion shall be measured by the
                                                    level of losses in distribution and /or
                                                    transmission networks, the percentage
                                                    utilisation (i.e. average loading) of
                                                    electricity network components, the
                                                    availability of network components
                                                    (related to planned and unplanned
                                                    maintenance) and its impact on network
                                                    performances, the duration and frequency
                                                    of interruptions, including climate related
                                                    disruptions.
(c)                     Market integration          This criterion shall be measured by
                                                    assessing the innovative uptake in system
                                                    operation and interconnection, as well as
                                                    the level of integrating other sectors and
                                                    facilitating new business models and
                                                    market structures.
(d)                     Network security,           This criterion shall be measured by
                        flexibility and             assessing the innovative approach to
                        quality of supply           system flexibility, cybersecurity, efficient
                                                    operability between TSO and DSO level,
                                                    the capacity to include demand response,
                                                    storage, energy efficiency measures, the
                                                    cost-efficient use of digital tools and ICT
                                                    for monitoring and control purposes, the
                                                    stability of the electricity system and the
                                                    voltage quality performance.
Amendment

(4) Concerning projects falling under the category set out in point (1)(d) of Annex II, the
criteria listed in Article 4 shall be evaluated as follows:
(a)                     Level of                    This criterion shall be measured by
                        sustainability              assessing the extent of the grids’ ability to
                                                    connect and transport variable renewable

                                                  energy and contribute towards making
                                                  the Union climate neutral by 2050 at the
                                                  latest.
     (b)               Security of supply         This criterion shall be measured by the
                                                  level of losses in distribution and /or
                                                  transmission networks, the percentage
                                                  utilisation (i.e. average loading) of
                                                  electricity network components, the
                                                  availability of network components
                                                  (related to planned and unplanned
                                                  maintenance) and its impact on network
                                                  performances, the duration and frequency
                                                  of interruptions, including climate related
                                                  disruptions.
     (c)               Market integration         This criterion shall be measured by
                                                  assessing the innovative uptake in system
                                                  operation and interconnection, as well as
                                                  the level of integrating other sectors and
                                                  facilitating new business models and
                                                  market structures.
     (d)               Network security,          This criterion shall be measured by
                       flexibility and            assessing the innovative approach to
                       quality of supply          system flexibility, cybersecurity, efficient
                                                  operability between TSO and DSO level,
                                                  the capacity to include demand response,
                                                  storage, energy efficiency measures, the
                                                  cost-efficient use of digital tools and ICT
                                                  for monitoring and control purposes, the
                                                  stability of the electricity system and the
                                                  voltage quality performance.
2021-05-28T00:49:50.003930amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-05-28T00:50:55.231318amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-05-28T00:50:55.239042amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-05-28T00:51:03.669427amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-05-28T00:51:35.759679amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-28T00:51:35.820081amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/LIBE-AM-691441_EN.pdf
2021-05-28T00:51:41.302612amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-28T00:51:43.334182amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-28T00:52:42.101404amendmenterror[!] couldn't find ref: Committee on Petitions
2021-05-28T00:52:42.109767amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-05-28T01:01:34.542477mep_activityerrorfailed to fetch http://www.europarl.europa.eu/meps/en/124739/loadmore-activities/written-explanations/9/?page=10&count=20
2021-05-28T01:08:27.802191mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-05-28T01:08:27.802660mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-05-28T01:18:14.789234mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:25:34.126100mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:25:34.539867mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:28:22.976907mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:29:14.388882mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:32:13.738270mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:32:13.942879mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:38:40.875262mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:44:02.964862mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:47:13.235642mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:48:57.594305mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:50:01.797827mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:50:52.138810mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:52:09.582141mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T01:57:46.186214mep_activityerrorfailed to fetch http://www.europarl.europa.eu/meps/en/197732/loadmore-activities/plenary-speeches/9/?page=1&count=20
2021-05-28T01:59:23.125927mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T02:00:19.703245mep_activitywarningpe, has not expected format: 'Commission'
2021-05-28T02:10:30.193141mep_activitywarningpe, has not expected format: 'Commission'