12067 2017-09-08 09:11:38 +0000 Random basehash value changes during build 2017-09-25 14:58:52 +0000 1 1 7 Build System, Metadata & Runtime BitBake bitbake unspecified x86 Multiple RESOLVED FIXED Medium+ normal 2.4 M4 1 johannes.schrimpf richard.purdie poky.bs.watcher poky.watcher randy.macleod --- --- No (bug/feature does not impact docs) oldest_to_newest 76681 0 3996 johannes.schrimpf 2017-09-08 09:11:38 +0000 Created attachment 3996 Diff file between hashed data during the build process. While building my image, randomly basehash mismatch errors occur like: ERROR: When reparsing /data/autobuilder/yocto-autobuilder/yocto-worker/var-installation/build/meta-be-swupdate/recipes-be/images/be-installation-image.bb.do_image_ext3, the basehash value changed from 9d50fc4aae9053b633624406ddd8590b to 14138e804a3545c0cea08518d59d4a03. The metadata is not deterministic and this needs to be fixed. I wrote debug information in siggen.py that prints the hashed data in the beginning of the build and when the error occurs, and indeed the data changes. However these changes are only changes in order of some lines/variables, see attached diff file. I went further into debugging the change in the the first part of the diff, which is only change of the line order, and I could track this down to d.getVar(task), which returns the part containing this line. One explanation is that the variable really changes during the build process, but due to the randomly occurrence, my guess is that there may be some part in the code that does not return data in an deterministic way, for example an unordered dict or list. 77008 1 richard.purdie 2017-09-21 08:30:35 +0000 Does http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=69e97240b372c6aaf0a9eab82bc1361a23db996d fix this? 77103 2 richard.purdie 2017-09-25 14:58:52 +0000 I'm going to assume the above change fixes this, please reopen if not. 3996 2017-09-08 09:11:38 +0000 2017-09-08 09:11:38 +0000 Diff file between hashed data during the build process. taskhash.txt text/plain 783 johannes.schrimpf MmEzCj4gCWd6aXAgLWYgLTkgLWMgYmUtc3d1cGRhdGUtaW1hZ2UtdmFyLXNvbS1teDYtJHtEQVRF VElNRX0ucm9vdGZzLmV4dDMgPiBiZS1zd3VwZGF0ZS1pbWFnZS12YXItc29tLW14Ni0ke0RBVEVU SU1FfS5yb290ZnMuZXh0My5nejsgb2VfbWtpbWFnZSBiZS1zd3VwZGF0ZS1pbWFnZS12YXItc29t LW14Ni0ke0RBVEVUSU1FfS5yb290ZnMuZXh0My5neiBnemlwCjVkNQo8IAlnemlwIC1mIC05IC1j IGJlLXN3dXBkYXRlLWltYWdlLXZhci1zb20tbXg2LSR7REFURVRJTUV9LnJvb3Rmcy5leHQzID4g YmUtc3d1cGRhdGUtaW1hZ2UtdmFyLXNvbS1teDYtJHtEQVRFVElNRX0ucm9vdGZzLmV4dDMuZ3o7 IG9lX21raW1hZ2UgYmUtc3d1cGRhdGUtaW1hZ2UtdmFyLXNvbS1teDYtJHtEQVRFVElNRX0ucm9v dGZzLmV4dDMuZ3ogZ3ppcAozMGMzMAo8IGRhdGFkaXIke3ByZWZpeH0vc2hhcmVkb19pbWFnZV9l eHQzW2Zha2Vyb290XTFkb19pbWFnZV9leHQzW3N1YmltYWdlc11leHQzLmd6IGV4dDMuZ3oudS1i b290ZG9jZGlyJHtkYXRhZGlyfS9kb2NleGVjX3ByZWZpeCR7cHJlZml4fWdldF9yb290ZnNfc2l6 ZWRlZiBnZXRfcm9vdGZzX3NpemUoZCk6Ci0tLQo+IGRhdGFkaXIke3ByZWZpeH0vc2hhcmVkb19p bWFnZV9leHQzW2Zha2Vyb290XTFkb19pbWFnZV9leHQzW3N1YmltYWdlc11leHQzLmd6LnUtYm9v dCBleHQzLmd6ZG9jZGlyJHtkYXRhZGlyfS9kb2NleGVjX3ByZWZpeCR7cHJlZml4fWdldF9yb290 ZnNfc2l6ZWRlZiBnZXRfcm9vdGZzX3NpemUoZCk6CjEzMGQxMjkKPCAK