10224 2016-09-06 09:15:34 +0000 oeqa/utils/sshcontrol.py:SSHProcess decode stdout data fail 2017-04-07 16:38:51 +0000 1 1 10 QA/Testing Runtime Testing general 2.4 x86 Multiple RESOLVED OBSOLETE Medium normal 2.3 M4 1 daweix.wu daweix.wu joshuagloe leonardo.sandoval.gonzalez --- --- Don't know oldest_to_newest 65815 0 daweix.wu 2016-09-06 09:15:34 +0000 Code: while time.time() < endtime and not eof: if select.select([self.process.stdout], [], [], 5)[0] != []: data = os.read(self.process.stdout.fileno(), 1024) if not data: self.process.stdout.close() eof = True else: data = data.decode("utf-8") output += data self.log(data) endtime = time.time() + timeout Errors at ' data = data.decode("utf-8")' UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 1023: unexpected end of data Reproducibility : < 1/10 Possible workaround: data = data.decode("utf-8", 'replace') 65929 1 leonardo.sandoval.gonzalez 2016-09-08 15:04:28 +0000 Can you replicate the problem using one of standard tools (not a sample code)? I want to understand the scenario you were trying to set when you found the problem. 67080 2 daweix.wu 2016-10-09 03:00:54 +0000 Just do some tests with running command likes "python runtest.py -t 192.168.8.111 -m intel-corei7-64 -f testplan/iottest.manifest" , but the reproducibility is very low , so we just met once. Why I listed the sample code since I saw below info. So I assume the possible cause is the 1024 read cache. -------------------------------------------------------- Traceback (most recent call last): File "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/utils/decorators.py", line 97, in wrapped_f return f(*args, **kwargs) File "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/runtime/smack.py", line 580, in test_smack_labels ' '.join([x.rstrip('/') for x in files.split()]), files, files File "iottest/runtest.py", line 67, in run return self.connection.run(cmd, timeout) File "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/utils/sshcontrol.py", line 144, in run return self._internal_run(command, self.defaulttimeout, self.ignore_status) File "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/utils/sshcontrol.py", line 124, in _internal_run status, output = proc.run(command, timeout, logfile=self.logfile) File "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/utils/sshcontrol.py", line 87, in run self._run(command, timeout, logfile) File "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/utils/sshcontrol.py", line 61, in _run data = data.decode("utf-8") UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 1023: unexpected end of data -------------------------------------------------------- 67093 3 leonardo.sandoval.gonzalez 2016-10-10 16:32:21 +0000 (In reply to comment #2) > Just do some tests with running command likes "python runtest.py -t > 192.168.8.111 -m intel-corei7-64 -f testplan/iottest.manifest" , but the > reproducibility is very low , so we just met once. Why I listed the sample > code since I saw below info. So I assume the possible cause is the 1024 read > cache. > -------------------------------------------------------- > Traceback (most recent call last): > File > "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/ > utils/decorators.py", line 97, in wrapped_f > return f(*args, **kwargs) > File > "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/ > runtime/smack.py", line 580, in test_smack_labels > ' '.join([x.rstrip('/') for x in files.split()]), files, files > File "iottest/runtest.py", line 67, in run > return self.connection.run(cmd, timeout) > File > "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/ > utils/sshcontrol.py", line 144, in run > return self._internal_run(command, self.defaulttimeout, > self.ignore_status) > File > "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/ > utils/sshcontrol.py", line 124, in _internal_run > status, output = proc.run(command, timeout, logfile=self.logfile) > File > "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/ > utils/sshcontrol.py", line 87, in run > self._run(command, timeout, logfile) > File > "/home/tester/iotos-tester/workspace/test_beagleboneblack_2/iottest/oeqa/ > utils/sshcontrol.py", line 61, in _run > data = data.decode("utf-8") > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 1023: > unexpected end of data > -------------------------------------------------------- Thanks for the info. It will be tackle before the mentioned milestone. 68876 4 mariano.lopez 2016-12-06 18:01:59 +0000 (In reply to comment #2) > Just do some tests with running command likes "python runtest.py -t > 192.168.8.111 -m intel-corei7-64 -f testplan/iottest.manifest" , but the > reproducibility is very low , so we just met once. Why I listed the sample > code since I saw below info. So I assume the possible cause is the 1024 read > cache. What locale setting are you using in your terminal session? This error means that SSH is not returning UTF-8 encoding. Can you reproduce this error setting your terminal to UTF-8? 69981 5 mariano.lopez 2017-01-20 21:06:39 +0000 I'm still not able to reproduce this. Assigning to submitter to get more information. 70465 6 daweix.wu 2017-02-07 05:22:38 +0000 Not sure about the terminal codec , considering the reproducibility is very low , I am to OK to close this as 'Won't fix'.