4394 2013-04-23 08:24:33 +0000 Intel Data Plane Development Kit (DPDK) support 2014-07-22 12:53:11 +0000 1 1 7 Build System, Metadata & Runtime BSPs bsps-meta-intel 1.5 x86 x86 RESOLVED FIXED Medium enhancement 1.7 1 terence.chiang wei.sern.chan boon.leong.ong dvhart gshastri jessica.zhang rebecca.swee.fun.chang ross.burton tom.zanussi wei.sern.chan --- --- Don't know oldest_to_newest 32509 0 terence.chiang 2013-04-23 08:24:33 +0000 Packet processing on the latest Intel processors is now an increasingly viable option due to continued improvements in multi-core architectures combined with the latest packet processing software enhancements provided by the Intel® Data Plane Development Kit (Intel® DPDK). Huge performance boosts achieved by this hardware/software combination is making Intel® architecture increasingly attractive as a packet processing solution. Additionally, by consolidating packet processing with other workloads on a Intel® multi-core processor, it is possible to reduce hardware costs, simplify the application development environment, and reduce time to market—with all the factors combining to reduce overall total cost of ownership. There is a demanding request for DPDK support in Yocto Project Intel BSP release. With that support, it will be easier for system integrator and device maker to create a POC for network devices. for more information: http://www.intel.com/content/www/us/en/intelligent-systems/intel-technology/packet-processing-is-enhanced-with-software-from-intel-dpdk.html 32528 1 tom.zanussi 2013-04-23 13:30:22 +0000 DPDK recipes are already available from ISG - see the romley and crystalforest BSPs READMEs: III. Enabling Intel DPDK Technology =================================== There are recipes available for the 'Intel Data Plane Development Kit Technology components for use with this BSP. Please contact your Intel Field Sales Representative or visit Intel Embedded Design Center (www.intel.com/p/en_US/embedded/designcenter) for instructions on how to locate and use these recipes. Also, WindRiver was demo'ing DPDK at the Yocto booth at ELC 2013. So, the support is already implemented somewhere, perhaps we can leverage it. 32534 2 tom.zanussi 2013-04-23 14:45:16 +0000 Though there doesn't seem to be any obvious location to find the Yocto DPDK support at the www.intel.com/p/en_US/embedded/designcenter link - I guess you really do have to contact your Intel Field Sales representative to get it. 32535 3 terence.chiang 2013-04-23 15:00:49 +0000 Intel DPDK download link is http://www.intel.com/content/www/us/en/intelligent-systems/intel-technology/dpdk-source-code.html After unzip that, there is no YP recipes but source only. I will check with field team on this. 32548 4 kishore.k.bodke 2013-04-23 17:26:59 +0000 Terence, There is no location for the DPDK Yocto recipes. The location mentioned here is only for the DPDK sources. You need to contact Lynch, Michael A to get the Yocto DPDK recipes. Tom, What should be the status for these kind of bug? Since the recipes are not yet public and is only under NDA, can I make this bug status as resolved? Thanks Kishore. 32551 5 tom.zanussi 2013-04-23 18:13:32 +0000 (In reply to comment #4) > Terence, > > There is no location for the DPDK Yocto recipes. > The location mentioned here is only for the DPDK sources. > You need to contact Lynch, Michael A to get the Yocto DPDK recipes. > > Tom, > > What should be the status for these kind of bug? > Since the recipes are not yet public and is only under NDA, can I make this > bug status as resolved? > I'm not sure I understand why the recipes would be under NDA if the DPDK itself is publicly available. 32552 6 kishore.k.bodke 2013-04-23 18:16:17 +0000 The latest DPDK is 1.3 which is not public yet and so the Yocto recipes. 32553 7 tom.zanussi 2013-04-23 18:30:17 +0000 (In reply to comment #6) > The latest DPDK is 1.3 which is not public yet and so the Yocto recipes. The current romley and crystalforest BSPs explicitly state that there is Yocto support for the DPDK, and that the recipes are available if you 'visit Intel Embedded Design Center (www.intel.com/p/en_US/embedded/designcenter) for instructions on how to locate and use these recipes.'. So Terence or anyone else should be able to do just that, but there doesn't seem to be enough information to do that, so at minimum please supply that information. It would also make sense to add that more detailed information to the BSP READMEs. As for the recipes for the new 1.3 version that you mention, I guess it would be up to Terence as the one requesting the feature to decide what to do about it i.e. is the currently-released DPDK enough for his needs. If so, he might want to close this as resolved, or if not, he might want to wait for the 1.3 support from ISG, or get it on the schedule for someone else to implement, or get it from WindRiver, if they have what he needs. 32563 8 terence.chiang 2013-04-24 07:29:41 +0000 Before I closed this bug. Let me check with Lynch, Michael A on the release cretira whether it is under NDA or public avaialbe. We need make it clear in the README. For DPDK 1.3 release, i can understand it might be under CNDA. But for the DPDK 1.2.3 (http://www.intel.com/content/www/us/en/intelligent-systems/intel-technology/dpdk-source-code.html) which is already public avaiable in source code format but the YP recipes is not avaialbe. I will provide my feedback after checking with Michael. Having said that we might still need to have DPDK 1.3 release in YP recipes format for YP 1.5 release as a feature. I will work with Michael on the release format (CNDA or other license). thanks. 32635 9 dvhart 2013-04-25 14:39:30 +0000 Just categorizing to get it off the bug triage list, leaving it to Terence to close per his final comment. 32870 10 tom.zanussi 2013-05-03 13:04:34 +0000 So the current status of this is that Terence is OK waiting for 1.3 support, which will become available when 1.4 releases, which will not become publicly available until 1.5 releases. There actually is currently no 1.2 recipe so the BSP READMEs are simply wrong and misleading to users, and 1.3 isn't expected tomorrow or even next week, so we need to remove that text from the READMEs until there is something available. Kishore, can you please submit a patch for that? The DPDK group uses a previous-to-current methodology for releasing, which the Yocto recipes should have no problem accommodating - we can keep the last several iterations of the DPDK recipes available like we do for the kernel, and users can select them using PREFERRED_VERSION. We can also make the recipe for the currently closed version available (1.4 in the current scenario) since the recipe itself isn't under NDA; the recipe can define a LICENSE_FLAGS string that if not set will simply skip the recipe as fif it wasn't available. The customer can then download the NDA binaries and enable the recipe locally using the LICENSE_FLAGS_WHITELIST setting. We should also have a validation framework in place for each release, and the Yocto team should also have at least one hardware platform we can independently test and verify. Currently we have jasperforest - will that be good enough for testing, or should we order new hardware? Also, Terence, in addition to having a validation framework, it would also be very helpful to have as many details as possible as to how the customers are actually using the DPDK - it would be nice to be able to have a setup that we could demonstrate similar use-cases, for both testing and demo purposes. 32889 11 terence.chiang 2013-05-06 06:33:12 +0000 (In reply to comment #10) We will have a meeting with DPDK team to understand DPDK release plan and its scheule. So for the README, we need to update that information. DPDK is released with sample applications that OxM use those applications for valdation and testing performance. > Also, Terence, in addition to having a validation framework, it would also > be very helpful to have as many details as possible as to how the customers > are actually using the DPDK - it would be nice to be able to have a setup > that we could demonstrate similar use-cases, for both testing and demo > purposes. 33090 12 kishore.k.bodke 2013-05-14 17:45:09 +0000 CY and his team are having discussions with the DPDK team. Since Boon Leong is leading this effort, I will let him decide and update the README to reflect the outcome of the meeting. Thanks Kishore. 42397 13 boon.leong.ong 2014-04-08 15:45:28 +0000 Following 2014/03 discussion with Intel DPDK team, Intel is contributing its Intel DPDK work into git://dpdk.org/dpdk. ISG target to create recipe to support move in YP1.7 time frame. So, I am moving this to YP1.7. 43512 14 ross.burton 2014-05-22 16:13:00 +0000 Taking this out of NEEDINFO as Boon seems to have this under control. 43549 15 1974 gshastri 2014-05-23 08:49:42 +0000 Created attachment 1974 dpdk-firstdraft-recipe 43550 16 gshastri 2014-05-23 08:51:19 +0000 Hi, I have created first draft recipe and verified in my environment. It is working fine and giving me desired output. Please find it attached here (https://bugzilla.yoctoproject.org/attachment.cgi?id=1974) Let me know if it is good to go in main line. 43551 17 ross.burton 2014-05-23 08:55:19 +0000 Please can you send that as a patch to the meta-intel list? 43552 18 gshastri 2014-05-23 09:28:44 +0000 Dear Ross, (In reply to comment #17) > Please can you send that as a patch to the meta-intel list? Done the same as a patch format and sent to meta-intel mailing list. Thank you. 43636 19 boon.leong.ong 2014-05-29 02:46:16 +0000 Assigned to Wei Sern for review. He will start the review process next week 44217 20 wei.sern.chan 2014-06-27 01:57:09 +0000 Hi Gaurang Shastri, Reviewed meta-intel mailing list, you sent the patch file as attachment to meta-intel@yoctoproject.org. Then Tom asked you to re-send your patch in text format. Can you re-send those patch in text format ? By the way, since Intel DPDK development team is contributing to git://dpdk.org/dpdk. So ISG team decided to create Yocto recipe and which is targeting on DPDK 1.6.0 and finally upstream it to meta-intel. We are almost there so hopefully you can see the recipe creation next week or so. Since then we are doing the similiar stuff, if you're comfortable with your schedule, I would suggest is better to wait for our recipe landed on meta-intel git and then you can do upgrade/enhance from there. 44618 21 ross.burton 2014-07-22 12:53:11 +0000 Merged into meta-intel as of c249763d3cb92bd06742b7986f08cf844ddb1d51. 1974 2014-05-23 08:49:42 +0000 2014-05-23 08:53:45 +0000 dpdk-firstdraft-recipe dpdk_1.6.0r2.bb text/plain 3292 gshastri REVTQ1JJUFRJT04gPSAiSW50ZWwocikgRGF0YSBQbGFuZSBEZXZlbG9wbWVudCBLaXQiCkhPTUVQ QUdFID0gImh0dHA6Ly9kcGRrLm9yZyIKTElDRU5TRSA9ICJCU0QgJiBMR1BMdjIgJiBHUEx2MiIK TElDX0ZJTEVTX0NIS1NVTSA9ICJmaWxlOi8vTElDRU5TRS5HUEw7bWQ1PTc1MTQxOTI2MGFhOTU0 NDk5ZjdhYmFhYmFhODgyYmJlIgoKU1JDX1VSSSA9ICJodHRwOi8vZHBkay5vcmcvYnJvd3NlL2Rw ZGsvc25hcHNob3QvZHBkay0ke1BWfS50YXIuZ3ogXAoiCgpTUkNfVVJJW21kNXN1bV0gPSAiZjQw NmQwMjczMjBmYzhlNzI0YmZmMjBkYjUzOTdjYmIiClNSQ19VUklbc2hhMjU2c3VtXSA9ICJlNzJm ZGViY2Y4YTg5OWZjNThlNjBjOWI2NDkzYjc0NTc1NzZlZWNlNjBiMDhkZWE2YWVlOTZjOTA4N2Rm NGIyIgoKREVQRU5EUyA9ICJ2aXJ0dWFsL2tlcm5lbCBsaW51eC1saWJjLWhlYWRlcnMiCgpTID0g IiR7V09SS0RJUn0vZHBkay0ke1BWfSIKCmluaGVyaXQgbW9kdWxlCgpQQUNLQUdFUyA9ICIke1BO fS1jb3JlLXJ1bnRpbWUgJHtQTn0tY29yZS1zdGF0aWMgJHtQTn0tY29yZS1kZXZlbCIKCmV4cG9y dCB0YXJnZXQ9ImJ1aWxkIgpleHBvcnQgZGVzdGRpcj0iJHtEfSR7cHJlZml4fSIKZXhwb3J0IGRh dGFkaXIxPSIke2RhdGFkaXJ9LyR7UE59IgpleHBvcnQgbW9kZGlyPSIvbGliL21vZHVsZXMvJHtL RVJORUxfVkVSU0lPTn0vZXh0cmEiCmV4cG9ydCBtYWNoaW5lPSJkZWZhdWx0IgoKZXhwb3J0IFJU RV9TREsgPSAiJHtTfSIKZXhwb3J0IFJURV9TUkNESVIgPSAiJHtSVEVfU0RLfSIKZXhwb3J0IFJU RV9PVVRQVVQgPSAiJHtSVEVfU0RLfS8ke3RhcmdldH0iCgpkb19jb21waWxlICgpIHsKICAgIG1h a2UgTz0ke3RhcmdldH0gVD0ke1RBUkdFVF9BUkNIfS1kZWZhdWx0LWxpbnV4YXBwLWdjYyBjb25m aWcKCiAgICBzZWQgLXJpICdzLChSVEVfTUFDSElORT0pLiosXDEke21hY2hpbmV9LCcgJHt0YXJn ZXR9Ly5jb25maWcKICAgIHNlZCAtcmkgJ3MsKFJURV9BUFBfVEVTVD0pLiosXDFuLCcgICAgICAg ICAke3RhcmdldH0vLmNvbmZpZwogICAgc2VkIC1yaSAncywoUlRFX0JVSUxEX1NIQVJFRF9MSUI9 KS4qLFwxeSwnICR7dGFyZ2V0fS8uY29uZmlnCgogICAgY2QgJHtSVEVfT1VUUFVUfQogICAgc2Vk IC1yaSAncywvdXNyYnVpbGQsYnVpbGQsJyBNYWtlZmlsZQogICAgc2VkIC1yaSAncywvdXNyLCwn IE1ha2VmaWxlCiAgICB1bnNldCBMREZMQUdTIFRBUkdFVF9MREZMQUdTIEJVSUxEX0xERkxBR1MK ICAgIG9lX3J1bm1ha2UgS1NSQz0ke1NUQUdJTkdfS0VSTkVMX0RJUn0gQ0ZMQUdTPScke0NGTEFH U30nIHByZWZpeD0nJyBcCiAgICAgICAgRVhUUkFfTERGTEFHUz0nJyBMREZMQUdTPScnIExETElC Uz0nJyBDUk9TUz0nJHtDUk9TU19DT01QSUxFfScgVj0xCiAgICBjcCBsaWIvKi5zbyAke1JURV9P VVRQVVR9CgogICAgc2VkIC1yaSAncywoUlRFX0JVSUxEX1NIQVJFRF9MSUI9KS4qLFwxbiwnICR7 UlRFX09VVFBVVH0vLmNvbmZpZwogICAgb2VfcnVubWFrZSBLU1JDPSR7U1RBR0lOR19LRVJORUxf RElSfSBDRkxBR1M9JyR7Q0ZMQUdTfScgcHJlZml4PScnIFwKICAgICAgICBFWFRSQV9MREZMQUdT PScnIExERkxBR1M9JycgTERMSUJTPScnIENST1NTPScke0NST1NTX0NPTVBJTEV9JyBWPTEKfQoK ZG9faW5zdGFsbCAoKSB7CiAgICB1bnNldCBMREZMQUdTIFRBUkdFVF9MREZMQUdTIEJVSUxEX0xE RkxBR1MKICAgIG1ha2UgTz0ke3RhcmdldH0gREVTVERJUj0ke2Rlc3RkaXJ9CiAgICBta2RpciAt cCAke0R9JHttb2RkaXJ9CiAgICBtdiAke2Rlc3RkaXJ9LyR7dGFyZ2V0fS9rbW9kLyoua28gICR7 RH0ke21vZGRpcn0vCiAgICBybWRpciAke2Rlc3RkaXJ9LyR7dGFyZ2V0fS9rbW9kCiAgICBta2Rp ciAtcCAke0R9JHtzYmluZGlyfQogICAgbG4gLXMgJHtkYXRhZGlyMX0vdG9vbHMvaWdiX3Vpb19i aW5kLnB5ICR7RH0ke3NiaW5kaXJ9L2lnYl91aW9fYmluZAogICAgbWtkaXIgLXAgJHtEfSR7Ymlu ZGlyfQogICAgbXYgJHtkZXN0ZGlyfS8ke3RhcmdldH0vYXBwL3Rlc3RwbWQgJHtEfSR7YmluZGly fS8KICAgIHJtZGlyICR7ZGVzdGRpcn0vJHt0YXJnZXR9L2FwcAogICAgbXYgJHtkZXN0ZGlyfS8k e3RhcmdldH0vaW5jbHVkZSAgICAke0R9JHtpbmNsdWRlZGlyfS8KICAgIG12ICR7ZGVzdGRpcn0v JHt0YXJnZXR9L2xpYiAgICAgICAgJHtEfSR7bGliZGlyfQogICAgbXYgJHtkZXN0ZGlyfS8ke3Rh cmdldH0vKi5zbyAgICAgICAke0R9JHtsaWJkaXJ9CiAgICBta2RpciAtcCAke0R9JHtkYXRhZGly MX0KICAgIG12ICR7ZGVzdGRpcn0vJHt0YXJnZXR9Ly5jb25maWcgICAgJHtEfSR7ZGF0YWRpcjF9 L2NvbmZpZwogICAgbXYgJHtkZXN0ZGlyfS8ke3RhcmdldH0gICAgICAgICAgICAke0R9JHtkYXRh ZGlyMX0KICAgIG12ICR7ZGVzdGRpcn0vbWsgICAgICAgICAgICAgICAgICAgJHtEfSR7ZGF0YWRp cjF9CiAgICBjcCAtYSBleGFtcGxlcyAgICAgICAgICAgICAgJHtEfSR7ZGF0YWRpcjF9CiAgICBj cCAtYSB0b29scyAgICAgICAgICAgICAgICAgJHtEfSR7ZGF0YWRpcjF9CiAgICBsbiAtcyAke2Rh dGFkaXJ9L2NvbmZpZyAgICAgJHtEfSR7ZGF0YWRpcjF9LyR7dGFyZ2V0fS8uY29uZmlnCiAgICBs biAtcyAke2luY2x1ZGVkaXJ9ICAgICAgICAgJHtEfSR7ZGF0YWRpcjF9LyR7dGFyZ2V0fS9pbmNs dWRlCiAgICBsbiAtcyAke2xpYmRpcn0gICAgICAgICAgICAgJHtEfSR7ZGF0YWRpcjF9LyR7dGFy Z2V0fS9saWIKfQoKRklMRVNfJHtQTn0tY29yZS1ydW50aW1lID0gIiR7ZGF0YWRpcjF9ICR7ZGF0 YWRpcjF9L2NvbmZpZyBcCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAke2RhdGFkaXIxfS90 b29scyAke21vZGRpcn0vKiBcCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAke3NiaW5kaXJ9 LyogJHtiaW5kaXJ9LyogXAogICAgICAgICAgICAgICAgICAgICAgICAgICAgJHtsaWJkaXJ9Lyou c28iCgpGSUxFU18ke1BOfS1jb3JlLXN0YXRpYyA9ICIke2xpYmRpcn0vKi5hIgoKRklMRVNfJHtQ Tn0tY29yZS1kZXZlbCA9ICIke2luY2x1ZGVkaXJ9LyogJHtkYXRhZGlyMX0vbWsgXAogICAgICAg ICAgICAgICAgICAgICAgICAgICR7ZGF0YWRpcjF9LyR7dGFyZ2V0fSBcCiAgICAgICAgICAgICAg ICAgICAgICAgICAgJHtkYXRhZGlyMX0vZXhhbXBsZXMiCgpJTlNBTkVfU0tJUF8ke1BOfS1jb3Jl LXJ1bnRpbWUgPSAibGRmbGFncyIKSU5TQU5FX1NLSVBfJHtQTn0tY29yZS1zdGF0aWMgPSAic3Rh dGljZGV2IgpJTkhJQklUX1BBQ0tBR0VfREVCVUdfU1BMSVQgPSAiMSIKCg==