Ndtyjky

I wrote a script using Twython that uses the Streamer calls. It works fine running under an Anaconda window on my Windows 10 PC. I tested it for 3 days and nights continuously and it never quit.

I just transferred it to a Raspberry Pi 3 where I ran update and upgrade, then copied over my script using Putty to connect to SSH. Raspian OS. When I run the script under Python3, I get the following run time error when the streamer crashes. Note the streamer has a on_error method that should trap the error, but it is completely bypassed and the script terminates. The Pi has a direct Ethernet connection to the router.

Traceback (most recent call last):

  File "/usr/lib/python3/dist-packages/urllib3/response.py", line 186, in 

  read     data = self._fp.read(amt)

  File "/usr/lib/python3.4/http/client.py", line 500, in read

 return super(HTTPResponse, self).read(amt)

  File "/usr/lib/python3.4/http/client.py", line 529, in readinto

  return self._readinto_chunked(b)

  File "/usr/lib/python3.4/http/client.py", line 621, in _readinto_chunked

  n = self._safe_readinto(mvb)

  File "/usr/lib/python3.4/http/client.py", line 680, in _safe_readinto

  raise IncompleteRead(bytes(mvb[0:total_bytes]), len(b))

  http.client.IncompleteRead: IncompleteRead(0 bytes read, 1 more expected)

This does not have anything to do with my actual code, I'm not clear on how to troubleshoot.

UPDATE: after 3 days running on the PC I just got a similar error. So I put the streamer in a Try Except with continue loop and I will see what happens. Apparently this problem has been around with Twython for a long time. I will update again if I learn anything.

UPDATE: I modified the code based on another post, to trap errors missed by the Streamer on_error event, to look like this:

## try to ignore http errors crashing the system

while True:

    try:

        stream.statuses.filter(follow=users, language = 'en')        



    except:

        e = sys.exc_info()[0]  

        print('ERROR:',e ) 

        continue

This ran error free overnight on the PC. Not a single error occurred. I moved the code over to the Raspberry Pi, which is headless and which i run with Putty from the PC, and it runs fine now - EXCEPT, I get an error a few times per hour. The stream restarts and seems to run fine otherwise. Not sure why. The screen looks like this:

Testing 1 2 3 4 5

file updated



Testing again 1 2 3 4

file updated

ERROR: <class 'requests.exceptions.ChunkedEncodingError'>

ERROR: <class 'requests.exceptions.ChunkedEncodingError'>

ERROR: <class 'requests.exceptions.ChunkedEncodingError'>

ERROR: <class 'requests.exceptions.ChunkedEncodingError'>

The HTTP Requests documentation says this about the error:

class ChunkedEncodingError(RequestException):

"""The server declared chunked encoding but sent an invalid chunk."""

So I have to assume there is some internal problem with Twython? Or ?