BETA

Summary for scraper logs from the 2021-05-29

Summary of log messages

LevelCount
Exceptions9
error90
warning23
info45053
debug197729

Summary of changes

TypeAddedUpdated
mep 0 9
dossier 5 62
amendment 28614 0
comagenda 30 1
mep_activity 703 0

Dossier events without known bodies

EventCount
"?!oeil-ANPRO!?"4
TimeModuleLevelMessage
2021-05-29T00:35:07.435944mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2724(DEA)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:07.446812mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:11.531819mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2725(DEA)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:11.534310mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2723(DEA)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:11.538386mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:11.541382mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0255&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:11.542159mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2073(IMM)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:11.544027mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2064(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:11.549148mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0257&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:11.551129mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:11.554070mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:11.556977mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:11.558835mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:11.560610mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:15.672610mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0261&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-29T00:35:15.742352mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-29T00:35:16.197970dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-05-29T00:35:25.943008dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-05-29T00:35:40.387251dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-05-29T00:35:47.440987dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-05-29T00:35:54.874983dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-05-29T00:35:59.076052dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-05-29T00:36:56.808142dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-05-29T00:36:59.694773dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-05-29T00:37:56.495488dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-05-29T00:38:03.386576dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-05-29T00:38:08.377413dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-05-29T00:38:08.381080dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-05-29T00:38:09.242119dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-05-29T00:38:52.518161dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-05-29T00:38:52.978457dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-05-29T00:38:53.178333dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-05-29T00:39:29.017706dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-05-29T00:39:44.384522dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-05-29T00:40:41.289624dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-05-29T00:41:14.711041dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-05-29T00:41:19.628508dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-05-29T00:41:25.068639dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-05-29T00:41:31.977527dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-05-29T00:41:31.989015dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-05-29T00:41:41.204145dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-05-29T00:41:41.815707dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-05-29T00:41:42.748458dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-05-29T00:41:42.751642dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-05-29T00:41:42.757315dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-05-29T00:41:43.252934dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-05-29T00:41:43.352401dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-05-29T00:41:43.478324dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-05-29T00:41:43.483523dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-05-29T00:41:43.597425dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-05-29T00:41:43.638572dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-05-29T00:41:44.137243dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-05-29T00:41:44.376888dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-05-29T00:41:44.382719dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-05-29T00:41:44.426905dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-05-29T00:41:45.067894dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-05-29T00:41:45.153525dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-05-29T00:41:45.219986dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-05-29T00:41:45.234645dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-05-29T00:41:45.374966dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-05-29T00:41:45.558395dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-05-29T00:41:45.982129dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-05-29T00:41:56.475044dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-29T00:41:58.370678dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-29T00:41:58.455117dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-29T00:41:59.994896dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-05-29T00:42:00.434244dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-05-29T00:42:45.704946dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-05-29T00:42:45.997345dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-05-29T00:43:00.892841dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-05-29T00:43:02.130662dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-29T00:44:58.615017amendmenterror[!] couldn't find ref: Committee on Development
2021-05-29T00:45:52.895390amendmenterror[!] couldn't find ref: Committee on International Trade
2021-05-29T00:46:58.223108amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-05-29T00:46:58.223885amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-05-29T00:47:31.974499amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-05-29T00:47:32.075257amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-05-29T00:47:37.275175amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-05-29T00:49:30.454004mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T00:49:31.431046amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-05-29T00:49:31.431616amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-05-29T00:50:04.953213amendmentwarningno table
Text proposed by the Commission

(4) Concerning projects falling under the category set out in point (1)(d) of Annex II, the
criteria listed in Article 4 shall be evaluated as follows:
(a)                     Level of                    This criterion shall be measured by
                        sustainability              assessing the extent of the grids’ ability to
                                                    connect and transport variable renewable
                                                    energy.
(b)                     Security of supply          This criterion shall be measured by the
                                                    level of losses in distribution and /or
                                                    transmission networks, the percentage
                                                    utilisation (i.e. average loading) of
                                                    electricity network components, the
                                                    availability of network components
                                                    (related to planned and unplanned
                                                    maintenance) and its impact on network
                                                    performances, the duration and frequency
                                                    of interruptions, including climate related
                                                    disruptions.
(c)                     Market integration          This criterion shall be measured by
                                                    assessing the innovative uptake in system
                                                    operation and interconnection, as well as
                                                    the level of integrating other sectors and
                                                    facilitating new business models and
                                                    market structures.
(d)                     Network security,           This criterion shall be measured by
                        flexibility and             assessing the innovative approach to
                        quality of supply           system flexibility, cybersecurity, efficient
                                                    operability between TSO and DSO level,
                                                    the capacity to include demand response,
                                                    storage, energy efficiency measures, the
                                                    cost-efficient use of digital tools and ICT
                                                    for monitoring and control purposes, the
                                                    stability of the electricity system and the
                                                    voltage quality performance.
Amendment

(4) Concerning projects falling under the category set out in point (1)(d) of Annex II, the
criteria listed in Article 4 shall be evaluated as follows:
(a)                     Level of                    This criterion shall be measured by
                        sustainability              assessing the extent of the grids’ ability to
                                                    connect and transport variable renewable

                                                  energy and contribute towards making
                                                  the Union climate neutral by 2050 at the
                                                  latest.
     (b)               Security of supply         This criterion shall be measured by the
                                                  level of losses in distribution and /or
                                                  transmission networks, the percentage
                                                  utilisation (i.e. average loading) of
                                                  electricity network components, the
                                                  availability of network components
                                                  (related to planned and unplanned
                                                  maintenance) and its impact on network
                                                  performances, the duration and frequency
                                                  of interruptions, including climate related
                                                  disruptions.
     (c)               Market integration         This criterion shall be measured by
                                                  assessing the innovative uptake in system
                                                  operation and interconnection, as well as
                                                  the level of integrating other sectors and
                                                  facilitating new business models and
                                                  market structures.
     (d)               Network security,          This criterion shall be measured by
                       flexibility and            assessing the innovative approach to
                       quality of supply          system flexibility, cybersecurity, efficient
                                                  operability between TSO and DSO level,
                                                  the capacity to include demand response,
                                                  storage, energy efficiency measures, the
                                                  cost-efficient use of digital tools and ICT
                                                  for monitoring and control purposes, the
                                                  stability of the electricity system and the
                                                  voltage quality performance.
2021-05-29T00:50:48.787093amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-05-29T00:51:53.870673amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-05-29T00:51:53.884787amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-05-29T00:51:56.420279amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-05-29T00:52:28.811953amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-29T00:52:28.819565amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/LIBE-AM-691441_EN.pdf
2021-05-29T00:52:38.308056amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-29T00:52:39.848303amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-29T00:53:30.886521amendmenterror[!] couldn't find ref: Committee on Petitions
2021-05-29T00:53:30.961042amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-05-29T00:55:08.083911mep_activityerrorfailed to fetch http://www.europarl.europa.eu/meps/en/96698/loadmore-activities/written-explanations/9/?page=25&count=20
2021-05-29T01:09:42.294994mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-05-29T01:09:42.297243mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-05-29T01:13:17.982512mep_activityerrorfailed to fetch http://www.europarl.europa.eu/meps/en/124766/loadmore-activities/written-explanations/9/?page=8&count=20
2021-05-29T01:19:32.072315mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:27:03.359641mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:27:03.815967mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:29:45.947204mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:30:44.747441mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:33:36.957673mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:33:37.294206mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:40:05.105413mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:45:27.643083mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:48:44.820340mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:50:48.587844mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:51:35.965995mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:52:21.675258mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T01:53:31.447031mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T02:00:21.220158mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T02:01:09.712644mep_activitywarningpe, has not expected format: 'Commission'
2021-05-29T02:11:32.330415mep_activitywarningpe, has not expected format: 'Commission'