BETA

Summary for scraper logs from the 2021-05-30

Summary of log messages

LevelCount
Exceptions9
error88
warning23
info44934
debug197474

Summary of changes

TypeAddedUpdated
mep 0 6
amendment 28614 0
mep_activity 703 0

Dossier events without known bodies

EventCount
"?!oeil-ANPRO!?"4
TimeModuleLevelMessage
2021-05-30T00:33:26.060949mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2725(DEA)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:26.062513mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2723(DEA)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:26.062751mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0255&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:26.071249mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:26.071789mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:26.072145mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:28.117420mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0257&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:28.146180mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2724(DEA)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:28.151870mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:28.163248mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2064(INI)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:28.219411mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:28.241905mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:30.174071mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=COM(2021)0261&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:30.195181mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2073(IMM)&l=en'} (TypeError("fetch_raw() got an unexpected keyword argument 'json'"))
2021-05-30T00:33:30.214247mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:30.214872mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "", line 3, in raise_from
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/urllib3/connectionpool.py", line 353, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/utils/utils.py", line 241, in fetch_raw
    r=sess.get(url, headers=HEADERS)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='oeil.secure.europarl.europa.eu', port=443): Read timed out. (read timeout=None)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/dossier.py", line 51, in scrape
    root=fetch(url)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 247, in fetch_raw
    return fetch_raw(url, retries-1, ignore=ignore, params=params, json=asjson, binary=binary)
TypeError: fetch_raw() got an unexpected keyword argument 'json'
2021-05-30T00:33:34.130059dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2021-05-30T00:33:42.397330dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2021-05-30T00:33:55.430177dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2021-05-30T00:34:01.615773dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2021-05-30T00:34:09.009897dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2021-05-30T00:34:11.471699dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2021-05-30T00:35:07.808520dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2021-05-30T00:35:11.779971dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2021-05-30T00:36:07.257817dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2021-05-30T00:36:14.874924dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2021-05-30T00:36:20.557065dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2021-05-30T00:36:20.637904dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2021-05-30T00:36:21.571534dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2021-05-30T00:37:04.359637dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2021-05-30T00:37:05.131966dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2021-05-30T00:37:05.461261dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2021-05-30T00:37:42.368376dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2021-05-30T00:37:59.802265dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2021-05-30T00:38:54.692863dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2021-05-30T00:39:26.983640dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2021-05-30T00:39:29.798874dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2021-05-30T00:39:35.631714dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2021-05-30T00:39:40.673788dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2021-05-30T00:39:40.831738dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2021-05-30T00:39:48.297746dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2021-05-30T00:39:50.127099dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2021-05-30T00:39:50.531944dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2021-05-30T00:39:51.597082dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2021-05-30T00:39:51.618856dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2021-05-30T00:39:51.622454dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2021-05-30T00:39:51.666216dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2021-05-30T00:39:51.693724dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2021-05-30T00:39:51.695331dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2021-05-30T00:39:52.003959dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2021-05-30T00:39:52.395922dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2021-05-30T00:39:52.497188dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2021-05-30T00:39:52.503027dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2021-05-30T00:39:53.074270dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2021-05-30T00:39:53.241897dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2021-05-30T00:39:53.341820dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2021-05-30T00:39:53.408265dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2021-05-30T00:39:53.561188dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2021-05-30T00:39:53.653512dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2021-05-30T00:39:53.703956dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2021-05-30T00:39:54.030291dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2850(RSP)&l=en
2021-05-30T00:39:54.048258dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2021-05-30T00:40:05.603210dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-30T00:40:05.677485dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-30T00:40:05.704910dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-30T00:40:08.338907dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2021-05-30T00:40:08.958714dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2021-05-30T00:40:51.093164dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2021-05-30T00:40:51.128960dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2021-05-30T00:41:06.217450dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2021-05-30T00:41:07.210694dossierwarningno body mapping found for "?!oeil-ANPRO!?"
2021-05-30T00:42:45.747752amendmenterror[!] couldn't find ref: Committee on Development
2021-05-30T00:43:47.562540amendmenterror[!] couldn't find ref: Committee on International Trade
2021-05-30T00:44:36.321330amendmenterror[!] couldn't find ref: Committee on Economic and Monetary Affairs
2021-05-30T00:44:36.328310amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ECON-AM-663212_EN.pdf
2021-05-30T00:45:18.797526amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-05-30T00:45:21.126034amendmenterror[!] couldn't find ref: Committee on Employment and Social Affairs
2021-05-30T00:45:21.126536amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/EMPL-AM-680917_EN.pdf
2021-05-30T00:47:19.031815amendmenterror[!] couldn't find ref: Committee on Industry, Research and Energy
2021-05-30T00:47:19.050009amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/ITRE-AM-680881_EN.pdf
2021-05-30T00:47:46.375791amendmentwarningno table
Text proposed by the Commission

(4) Concerning projects falling under the category set out in point (1)(d) of Annex II, the
criteria listed in Article 4 shall be evaluated as follows:
(a)                     Level of                    This criterion shall be measured by
                        sustainability              assessing the extent of the grids’ ability to
                                                    connect and transport variable renewable
                                                    energy.
(b)                     Security of supply          This criterion shall be measured by the
                                                    level of losses in distribution and /or
                                                    transmission networks, the percentage
                                                    utilisation (i.e. average loading) of
                                                    electricity network components, the
                                                    availability of network components
                                                    (related to planned and unplanned
                                                    maintenance) and its impact on network
                                                    performances, the duration and frequency
                                                    of interruptions, including climate related
                                                    disruptions.
(c)                     Market integration          This criterion shall be measured by
                                                    assessing the innovative uptake in system
                                                    operation and interconnection, as well as
                                                    the level of integrating other sectors and
                                                    facilitating new business models and
                                                    market structures.
(d)                     Network security,           This criterion shall be measured by
                        flexibility and             assessing the innovative approach to
                        quality of supply           system flexibility, cybersecurity, efficient
                                                    operability between TSO and DSO level,
                                                    the capacity to include demand response,
                                                    storage, energy efficiency measures, the
                                                    cost-efficient use of digital tools and ICT
                                                    for monitoring and control purposes, the
                                                    stability of the electricity system and the
                                                    voltage quality performance.
Amendment

(4) Concerning projects falling under the category set out in point (1)(d) of Annex II, the
criteria listed in Article 4 shall be evaluated as follows:
(a)                     Level of                    This criterion shall be measured by
                        sustainability              assessing the extent of the grids’ ability to
                                                    connect and transport variable renewable

                                                  energy and contribute towards making
                                                  the Union climate neutral by 2050 at the
                                                  latest.
     (b)               Security of supply         This criterion shall be measured by the
                                                  level of losses in distribution and /or
                                                  transmission networks, the percentage
                                                  utilisation (i.e. average loading) of
                                                  electricity network components, the
                                                  availability of network components
                                                  (related to planned and unplanned
                                                  maintenance) and its impact on network
                                                  performances, the duration and frequency
                                                  of interruptions, including climate related
                                                  disruptions.
     (c)               Market integration         This criterion shall be measured by
                                                  assessing the innovative uptake in system
                                                  operation and interconnection, as well as
                                                  the level of integrating other sectors and
                                                  facilitating new business models and
                                                  market structures.
     (d)               Network security,          This criterion shall be measured by
                       flexibility and            assessing the innovative approach to
                       quality of supply          system flexibility, cybersecurity, efficient
                                                  operability between TSO and DSO level,
                                                  the capacity to include demand response,
                                                  storage, energy efficiency measures, the
                                                  cost-efficient use of digital tools and ICT
                                                  for monitoring and control purposes, the
                                                  stability of the electricity system and the
                                                  voltage quality performance.
2021-05-30T00:47:53.078825mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T00:48:28.439793amendmenterror[!] couldn't find ref: Committee on Agriculture and Rural Development
2021-05-30T00:49:37.654925amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-05-30T00:49:37.656629amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/CULT-AM-680860_EN.pdf
2021-05-30T00:49:46.638178amendmenterror[!] couldn't find ref: Committee on Culture and Education
2021-05-30T00:50:04.228315amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-30T00:50:04.286647amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/LIBE-AM-691441_EN.pdf
2021-05-30T00:50:16.777929amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-30T00:50:16.971108amendmenterror[!] couldn't find ref: Committee on Civil Liberties, Justice and Home Affairs
2021-05-30T00:50:59.406590amendmenterror[!] couldn't find ref: Committee on Petitions
2021-05-30T00:50:59.406884amendmenterrorcouldn't find dossier reference in source pdf: https://www.europarl.europa.eu/doceo/document/PETI-AM-660162_EN.pdf
2021-05-30T01:08:15.452014mgrerrorfailed to execute mep_activity job {'onfinished': {'daisy': True}, 'id': 118859, 'mepname': 'Roberta METSOLA', 'terms': {9}} (HTTPError('404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html'))
2021-05-30T01:08:15.491415mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 68, in consume
    ret = scraper.scrape(**job)
  File "scrapers/mep_activity.py", line 166, in scrape
    refroot = fetch(fullurl)
  File "/home/pt/pt2/utils/utils.py", line 257, in fetch
    xml = fetch_raw(url, retries, ignore, params)
  File "/home/pt/pt2/utils/utils.py", line 251, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/CRE-9-2021-01-21-ITM-025_EN.html
2021-05-30T01:18:25.048692mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:25:53.337807mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:25:53.845733mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:28:41.711944mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:29:36.382740mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:32:29.316785mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:32:29.781848mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:38:58.908670mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:44:21.560496mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:47:28.993787mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:49:16.830906mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:50:24.397019mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:51:08.587284mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:52:24.308594mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T01:59:23.878373mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T02:00:24.953616mep_activitywarningpe, has not expected format: 'Commission'
2021-05-30T02:11:26.991275mep_activitywarningpe, has not expected format: 'Commission'