11310 2017-04-07 17:15:17 +0000 host packages wrong for Ubuntu 16? 2017-04-26 18:30:58 +0000 1 1 9 Documentation Quick Start quick-start unspecified x86 Multiple RESOLVED FIXED 26 April 2017: RESOLVED Medium+ normal 2.3 M4 1 pokylinux srifenbark bluelightning brian.avery poky.doc.watcher poky.watcher rebecca.swee.fun.chang sgw srifenbark --- --- Done (doc changes complete) oldest_to_newest 72183 0 pokylinux 2017-04-07 17:15:17 +0000 see: http://www.yoctoproject.org/docs/latest/mega-manual/mega-manual.html#packages sudo apt-get update sudo apt-get install gawk wget git-core diffstat unzip texinfo gcc-multilib [OK] sudo apt-get install build-essential chrpath socat cpio python python3 python3-pip python3-expect E: Unable to locate package python3-expect I guess it should be sudo apt install python3-pexpect sudo apt-get install xz which libsdl1.2-dev xterm Reading package lists... Done Building dependency tree Reading state information... Done E: Unable to locate package xz E: Unable to locate package which sudo apt install xz-utils No idea what's the which package. http://www.yoctoproject.org/docs/latest/mega-manual/mega-manual.html#ubuntu-packages sudo apt-get install gawk wget git-core diffstat unzip texinfo gcc-multilib sudo apt-get install build-essential chrpath socat cpio python python3 python3-pip python3-expect Reading package lists... Done Building dependency tree Reading state information... Done E: Unable to locate package python3-expect same as above sudo apt-get install xz which Reading package lists... Done Building dependency tree Reading state information... Done E: Unable to locate package xz E: Unable to locate package which same as above sudo apt-get install libsdl1.2-dev xterm [OK] sudo apt-get install make xsltproc docbook-utils fop dblatex xmlto [OK] sudo apt-get install python-git [OK] 72184 1 pokylinux 2017-04-07 17:16:54 +0000 cat /etc/issue Ubuntu 16.04 LTS \n \l 72222 2 srifenbark 2017-04-10 18:04:24 +0000 Hi, I recently worked Bug 10854 and worked with Brian Avery on this. I am going to copy him on the bug. This package requirement stuff for the hosts seems to be in constant flux... depending on various distro versions etc. I would like for Brian to look at this bug and your comments before I change stuff. Thanks, Scott 72264 3 brian.avery 2017-04-11 00:28:28 +0000 yipes. either I messed up (possible) or things moved. The broken pkgs should be: python3-pexpect debianutils xz-utils The broken versions were: python3-expect which xz ------ tested on official ubuntu docker contianer ubuntu:16.04 # cat /etc/issue Ubuntu Xenial Xerus (development branch) \n \l 72265 4 srifenbark 2017-04-11 01:19:23 +0000 Brian, I don't know which distros this correction applies to (Ubuntu....all?) So, I am cutting and pasting the four "Essentials" packages that are listed right now in the YP Reference Manual. It would really help me clear this up if you could edit this comment with some substitutions for each of these distros. Please tell me exactly how each of these should be. Thanks, Scott ================================================ This is for Ubuntu (see http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#ubuntu-packages) Essentials: Packages needed to build an image on a headless system: $ sudo apt-get install gawk wget git-core diffstat unzip texinfo \ gcc-multilib build-essential chrpath socat cpio python python3 \ python3-pip python3-expect xz which ================================================ This is for Fedora (see http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#fedora-packages) Essentials: Packages needed to build an image for a headless system: $ sudo dnf install gawk make wget tar bzip2 gzip python3 unzip perl \ patch diffutils diffstat git cpp gcc gcc-c++ glibc-devel texinfo \ chrpath ccache perl-Data-Dumper perl-Text-ParseWords \ perl-Thread-Queue perl-bignum socat findutils which file cpio \ python python3-pip python3-expect xz which ================================================ This is for OpenSUSE (see http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#opensuse-packages) Essentials: Packages needed to build an image for a headless system: $ sudo zypper install python gcc gcc-c++ git chrpath make wget \ python-xml diffstat makeinfo python-curses patch socat python3 \ python3-curses tar python3-pip python3-expect xz which =============================================== This is for CentOS (see http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#centos-packages) Essentials: Packages needed to build an image for a headless system: $ sudo yum install -y epel-release $ sudo yum makecache $ sudo yum install gawk make wget tar bzip2 gzip python unzip perl \ patch diffutils diffstat git cpp gcc gcc-c++ glibc-devel texinfo \ chrpath socat perl-Data-Dumper perl-Text-ParseWords perl-Thread-Queue \ python34-pip xz which SDL-devel xterm 72274 5 pokylinux 2017-04-11 09:15:44 +0000 I can confirm that for Ubuntu 16 those install: $ sudo apt-get install gawk wget git-core diffstat unzip texinfo \ gcc-multilib build-essential chrpath socat cpio python python3 \ python3-pip python3-pexpect xz-utils debianutils instead of $ sudo apt-get install gawk wget git-core diffstat unzip texinfo \ gcc-multilib build-essential chrpath socat cpio python python3 \ python3-pip python3-expect xz which 72275 6 pokylinux 2017-04-11 09:20:57 +0000 BTW in order to get bitbake core-image-minimal -g -u depexp to work with Morty on Ubuntu 16 I had to add: sudo apt-get install -y libgtk-3-0 libgtk-3-bin libgtk-3-common libgtk-3-dev python3-gi 72294 7 brian.avery 2017-04-11 15:03:33 +0000 yep, the "essentials" are just to make images. 72318 8 srifenbark 2017-04-11 19:04:49 +0000 Brian, What about Comment 4? Can you give me some feedback on those lists to be sure I am changing the right packages? Also, for Robert's Comment 5... those packages do not appear anywhere. What distros and groupings would those apply to? thanks, Scott 72326 9 brian.avery 2017-04-11 20:25:09 +0000 Rebecca, could you ask someone on the team to go through each of these and verify? Easiest approach: run the std distro container for each of the os's scott has below do the apt-get/dnf/zypper/yum install that scott lists. - make sure they all install. $useradd -m tester $su - tester $ git clone git://git.yoctoproject.org/poky $ ./poky/oe-init-buildenv $ bitbake core-image-minimal - check that it works. testimage still has issues inside a container, so don't worry about that right now ty!! 72334 10 brian.avery 2017-04-11 20:41:59 +0000 Scott, my Comment 3 correction was from a quick test on the ubuntu-16.04 container. I asked Rebecca's team for help to verify the matrix. 72365 11 rebecca.swee.fun.chang 2017-04-12 00:43:15 +0000 PG team will take over the verification. I will post the progress over here after the checking. 72367 12 rebecca.swee.fun.chang 2017-04-12 04:58:24 +0000 We have ran tests for all 4 distros, python3-expect was not found in all the package management repos. Without installing python3-expect, bitbake image build still can be executed flawlessly. So python3-expect should not be inside the essential list since it is not discoverable and not needed. 72379 13 bluelightning 2017-04-12 09:56:24 +0000 I believe pexpect was added because the code to support testimage on real hardware uses it in order to interact with the bootloader. That isn't functionality that everyone will use, but it does still exist. 72384 14 srifenbark 2017-04-12 15:04:05 +0000 Ok - I am going to remove "python3-expect" from the list of the essentials for Ubuntu, Fedora, and OpenSUSE. Leaving all else alone unless I hear further. Scott 72497 15 srifenbark 2017-04-13 20:45:13 +0000 Hi, See http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#required-packages-for-the-host-development-system in the ref-manual and http://www.yoctoproject.org/docs/2.3/yocto-project-qs/yocto-project-qs.html#packages in the QS for the latest rendition of this stuff. Thanks, Scott 72511 16 rebecca.swee.fun.chang 2017-04-14 04:05:13 +0000 Reviewed doc changes. 72520 17 srifenbark 2017-04-14 14:51:10 +0000 Hi, Since the docs have been reviewed with no comments, I am assuming the changes and the state of the packages are good. I am marking the bug as RESOLVED and setting the doc flag to "done". Scott 72538 18 brian.avery 2017-04-17 16:57:08 +0000 Sadly nope. Rebecca, apt-get install python3-pexpect works on ubuntu 16.04, for example. And dnf install python3-pexpect works on fedora:24. The names change periodically, which is what is causing this to be soo frustrating. As Paul mentioned, python expect is being used to talk to the real hardware in testing. At the top of the Poky tree, if you do $ grep -rH expect . | egrep import you will see: ./meta-yocto-bsp/lib/oeqa/controllers/grubtarget.py:import pexpect ./meta-yocto-bsp/lib/oeqa/controllers/edgeroutertarget.py:import pexpect ./meta-yocto-bsp/lib/oeqa/controllers/beaglebonetarget.py:import pexpect 72539 19 srifenbark 2017-04-17 17:12:00 +0000 Ok - thanks for reopening the bug. I will need some instruction on what we want for packages and for what distributions they apply. Scott 72681 20 srifenbark 2017-04-19 21:27:53 +0000 Brian, I am changing the owner to you because I NEEDINFO for this bug. Need someone to give me the definitive packages for the four distros. Thanks, Scott 72688 21 brian.avery 2017-04-19 22:36:34 +0000 adding saul, Rebecca did you all have a chance to follow up on this? 72690 22 rebecca.swee.fun.chang 2017-04-20 00:45:00 +0000 (In reply to comment #21) > adding saul, > Rebecca did you all have a chance to follow up on this? I will follow up on this. I have just synced up with Saul, PG team will take the next step on checking "python3-pexpect" and find out its replacement on all 4 distros and report out. 72692 23 rebecca.swee.fun.chang 2017-04-20 02:52:31 +0000 For Ubuntu 16.04, OpenSUSE, Fedora: python3-pexpect is working. The broken pkg was python3-expect. CentOS: We are able to install pexpect package with yum. python3-pexpect was not found for CentOS. 72695 24 3741 brian.avery 2017-04-20 03:03:25 +0000 Created attachment 3741 script to test install for different distros 72696 25 brian.avery 2017-04-20 03:06:08 +0000 I ended up writing a script to test installs (attached) Here;s the results: DEBIAN_HOST_PACKAGES_ESSENTIAL="gawk wget git-core diffstat unzip texinfo gcc-multilib \ build-essential chrpath socat cpio python python3 python3-pip python3-pexpect\ xz-utils debianutils" | UBUNTU_HOST_PACKAGES_ESSENTIAL="gawk wget git-core diffstat unzip texinfo gcc-multilib \ build-essential chrpath socat cpio python python3 python3-pip python3-pexpect\ xz-utils debianutils" | FEDORA_HOST_PACKAGES_ESSENTIAL="gawk make wget tar bzip2 gzip python3 unzip perl patch \ diffutils diffstat git cpp gcc gcc-c++ glibc-devel texinfo chrpath \ ccache perl-Data-Dumper perl-Text-ParseWords perl-Thread-Queue perl-bignum socat python3-pexpect \ findutils which file cpio python python3-pip xz which" | OPENSUSE_HOST_PACKAGES_ESSENTIAL="python gcc gcc-c++ git chrpath make wget python-xml \ diffstat makeinfo python-curses patch socat python3 python3-curses tar python3-pip python3-pexpect \ xz which" | CENTOS_HOST_PACKAGES_ESSENTIAL="gawk make wget tar bzip2 gzip python unzip perl patch \ diffutils diffstat git cpp gcc gcc-c++ glibc-devel texinfo chrpath socat \ perl-Data-Dumper perl-Text-ParseWords perl-Thread-Queue python34-pip xz \ which" | ----- I also see python3 expect not being available in centos-7 . didn't test building any images as that is more complex to set up... -- Reassigning back to scott. is ok? 72728 26 srifenbark 2017-04-20 14:59:49 +0000 Hi, Thanks for the effort testing these out. See http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#required-packages-for-the-host-development-system for the link into the ref-manual. Essentially, they stayed the same except for adding "python3-pexpect" into Ubuntu/Debian, Fedora, and OpenSUSE. See http://www.yoctoproject.org/docs/2.3/yocto-project-qs/yocto-project-qs.html#packages for the same in the QS Manual. I am setting the bug to IN PROGRESS REVIEW again. Thanks, Scott 72831 27 pokylinux 2017-04-25 15:02:59 +0000 Just started testing on the pyro branch and the first error I get is: ERROR: The following required tools (as specified by HOSTTOOLS) appear to be unavailable in PATH, please install them in order to proceed: ping ---- Package ping is a virtual package provided by: inetutils-ping 2:1.9.4-1build1 iputils-ping 3:20121221-5ubuntu2 You should explicitly select one to install. ----- sudo apt insatll iputils-ping fixes the problem on Ubuntu 16.x 72832 28 pokylinux 2017-04-25 15:03:59 +0000 sudo apt install iputils-ping 72833 29 srifenbark 2017-04-25 15:22:25 +0000 Hi Robert, See http://www.yoctoproject.org/docs/2.3/ref-manual/ref-manual.html#ubuntu-packages for the change for Ubuntu/Debian in the ref-manual. See http://www.yoctoproject.org/docs/2.3/yocto-project-qs/yocto-project-qs.html#packages for the same change in the YP Quick Start. Let me know of any other failing stuff regarding packages for Pyro. Thanks, Scott 72839 30 pokylinux 2017-04-25 16:39:55 +0000 Hi Scott, I am happy with what's in your latest links. Thanks! Regards, Robert 72868 31 srifenbark 2017-04-26 18:30:58 +0000 Thanks Robert. Setting to RESOLVED and putting the doc flag to "done." Scott 3741 2017-04-20 03:03:25 +0000 2017-04-20 03:03:25 +0000 script to test install for different distros TestDistros.sh application/octet-stream 2719 brian.avery IyEvL2Jpbi9iYXNoCgpERUJJQU5fSE9TVF9PUEVSQVRJT05TPSJhcHQtZ2V0IHVwZGF0ZSAteSAi CkRFQklBTl9IT1NUX1BBQ0tBR0VSPSJhcHQtZ2V0IGluc3RhbGwgLXkgIgpERUJJQU5fSE9TVF9Q QUNLQUdFU19FU1NFTlRJQUw9Imdhd2sgd2dldCBnaXQtY29yZSBkaWZmc3RhdCB1bnppcCB0ZXhp bmZvIGdjYy1tdWx0aWxpYiBcCiAgICAgYnVpbGQtZXNzZW50aWFsIGNocnBhdGggc29jYXQgY3Bp byBweXRob24gcHl0aG9uMyBweXRob24zLXBpcCBweXRob24zLXBleHBlY3RcCiAgICAgeHotdXRp bHMgZGViaWFudXRpbHMiCgpVQlVOVFVfSE9TVF9PUEVSQVRJT05TPSJhcHQtZ2V0IHVwZGF0ZSAt eSAgICIKVUJVTlRVX0hPU1RfUEFDS0FHRVI9ImFwdC1nZXQgaW5zdGFsbCAteSAgIgpVQlVOVFVf SE9TVF9QQUNLQUdFU19FU1NFTlRJQUw9Imdhd2sgd2dldCBnaXQtY29yZSBkaWZmc3RhdCB1bnpp cCB0ZXhpbmZvIGdjYy1tdWx0aWxpYiBcCiAgICAgYnVpbGQtZXNzZW50aWFsIGNocnBhdGggc29j YXQgY3BpbyBweXRob24gcHl0aG9uMyBweXRob24zLXBpcCBweXRob24zLXBleHBlY3RcCiAgICAg eHotdXRpbHMgZGViaWFudXRpbHMiCgojIHBsYWNlaG9sZGVyIGZvciBlYXNlIG9mIHVzZQpGRURP UkFfSE9TVF9PUEVSQVRJT05TPSJ0cnVlIgpGRURPUkFfSE9TVF9QQUNLQUdFUj0iZG5mIGluc3Rh bGwgLXkgICIKRkVET1JBX0hPU1RfUEFDS0FHRVNfRVNTRU5USUFMPSJnYXdrIG1ha2Ugd2dldCB0 YXIgYnppcDIgZ3ppcCBweXRob24zIHVuemlwIHBlcmwgcGF0Y2ggXAogICAgIGRpZmZ1dGlscyBk aWZmc3RhdCBnaXQgY3BwIGdjYyBnY2MtYysrIGdsaWJjLWRldmVsIHRleGluZm8gY2hycGF0aCBc CiAgICAgY2NhY2hlIHBlcmwtRGF0YS1EdW1wZXIgcGVybC1UZXh0LVBhcnNlV29yZHMgcGVybC1U aHJlYWQtUXVldWUgcGVybC1iaWdudW0gc29jYXQgcHl0aG9uMy1wZXhwZWN0IFwKICAgICBmaW5k dXRpbHMgd2hpY2ggZmlsZSBjcGlvIHB5dGhvbiBweXRob24zLXBpcCB4eiB3aGljaCIKCiMgcGxh Y2Vob2xkZXIgZm9yIGVhc2Ugb2YgdXNlCk9QRU5TVVNFX0hPU1RfT1BFUkFUSU9OUz0idHJ1ZSIK T1BFTlNVU0VfSE9TVF9QQUNLQUdFUj0ienlwcGVyIGluc3RhbGwgLXkgICIKT1BFTlNVU0VfSE9T VF9QQUNLQUdFU19FU1NFTlRJQUw9InB5dGhvbiBnY2MgZ2NjLWMrKyBnaXQgY2hycGF0aCBtYWtl IHdnZXQgcHl0aG9uLXhtbCBcCiAgICAgZGlmZnN0YXQgbWFrZWluZm8gcHl0aG9uLWN1cnNlcyBw YXRjaCBzb2NhdCBweXRob24zIHB5dGhvbjMtY3Vyc2VzIHRhciBweXRob24zLXBpcCBweXRob24z LXBleHBlY3QgXAogICAgIHh6IHdoaWNoIgoKQ0VOVE9TX0hPU1RfT1BFUkFUSU9OUz0ieXVtIGlu c3RsbCAteSAgZXBlbC1yZWxlYXNlO3l1bSBtYWtlY2FjaGUgLXEiCkNFTlRPU19IT1NUX1BBQ0tB R0VSPSJ5dW0gaW5zdGFsbCAteSAgIgpDRU5UT1NfSE9TVF9QQUNLQUdFU19FU1NFTlRJQUw9Imdh d2sgbWFrZSB3Z2V0IHRhciBiemlwMiBnemlwIHB5dGhvbiB1bnppcCBwZXJsIHBhdGNoIFwKICAg ICBkaWZmdXRpbHMgZGlmZnN0YXQgZ2l0IGNwcCBnY2MgZ2NjLWMrKyBnbGliYy1kZXZlbCB0ZXhp bmZvIGNocnBhdGggc29jYXQgXAogICAgIHBlcmwtRGF0YS1EdW1wZXIgcGVybC1UZXh0LVBhcnNl V29yZHMgcGVybC1UaHJlYWQtUXVldWUgcHl0aG9uMzQtcGlwIHh6IFwKICAgICB3aGljaCIKCgpE SVNUUk9TX1JFQUw9InVidW50dS0xNS4wNCAgXAogICAgICAgICAgICB1YnVudHUtMTYuMDQgIFwK ICAgICAgICAgICAgdWJ1bnR1LTE2LjEwICBcCiAgICAgICAgICAgIGZlZG9yYS0yNCAgXAogICAg ICAgICAgICBmZWRvcmEtMjUgIFwKICAgICAgICAgICAgY2VudG9zLTcgIFwKICAgICAgICAgICAg ZGViaWFuLTggIFwKICAgICAgICAgICAgb3BlbnN1c2UtNDIuMSAgXAogICAgICAgICAgICBvcGVu c3VzZS00Mi4yICAiCgoKCmZvciBpIGluICRESVNUUk9TOyBkbwogICAgZWNobyAiV29ya2luZyBv biAkaSIKICAgIERJU1RSTz0ke2klJS0qfQogICAgVkVSU0lPTj0ke2kjKi19CiAgICAjZWNobyAi dmVyc2lvbj0kVkVSU0lPTiIKICAgIERMSVNUVj0ke0RJU1RST15efV9IT1NUX1BBQ0tBR0VTX0VT U0VOVElBTAogICAgRE9QU1Y9JHtESVNUUk9eXn1fSE9TVF9PUEVSQVRJT05TCiAgICBEUEtHVj0k e0RJU1RST15efV9IT1NUX1BBQ0tBR0VSCiAgICBldmFsIERMSVNUPVwkJERMSVNUVgogICAgIyB0 aGlzIGhhcyB0aGUgbGlzdCBvZiBwY2thZ2VzIHRvIGluc3RhbGwKICAgICNlY2hvICRETElTVAog ICAgZXZhbCBET1BTPVwkJERPUFNWCiAgICBldmFsIERQS0c9XCQkRFBLR1YKICAgIGVjaG8gInB1 bGxpbmcgaW1hZ2Ugd2l0aCBjbWQgPSBkb2NrZXIgcHVsbCAke0RJU1RST306JHtWRVJTSU9OfSIK ICAgIGRvY2tlciBwdWxsICR7RElTVFJPfToke1ZFUlNJT059IHx8IGVjaG8gIiRpOiBkb2NrZXIg cHVsbCAgJHtESVNUUk99OiR7VkVSU0lPTn0gIEZBSUxFRCIKICAgIGVjaG8gImluc3RhbGxpbmcg d2l0aCBjbWQgPSBkb2NrZXIgcnVuIC10IC0tcm0gJHtESVNUUk99OiR7VkVSU0lPTn0gYmFzaCAt YyBcIiRET1BTOyREUEtHICRETElTVFwiICIKICAgIGRvY2tlciBydW4gLXQgLS1ybSAke0RJU1RS T306JHtWRVJTSU9OfSBiYXNoIC1jICIkRE9QUzskRFBLRyAkRExJU1QiIHx8IGVjaG8gIiRpOiBk b2NrZXIgb3BzIGFuZCBpbnN0YWxsIGxpc3QgRkFJTEVEIgpkb25lCg==