Bug 11431

nodejs-native isn't part of oe-core, you need to add a layer which includes nodejs (such as meta-nodejs or meta-oe) before devtool can correctly handle nodejs recipes.

Since nodejs-native is not part of oe-core yet, we can revisit this later if it moves into oe-core at some in the future.

still issue not solved, so reopened

The Test Case instructions need to be updated to add the meta-oe layer, as nodejs recipe [1] will likely not be moved into oe-core.

[1] http://layers.openembedded.org/layerindex/recipe/4427/

Test case will be updated.

 We will wait for test case to be updated.
 we have marked the test case 1610 as failed for release 2.3.4.rc1.

 We will wait for test case to be updated.
 we have marked the test case 1610 as failed for release 2.6 M1 rc1

We will wait for test case to be updated.
we have marked the test case 1610 as failed for release 2.6 M2 rc1

Test case has been updated and verified to be working on the releases 2.6 M2 rc1 and 2.5.1.rc1.

Issue is reproducible with 2.4.4RC1 release with suggested work around as mentioned below, Issue is not seen 2.6 M2 rc1 release with same work around:

Steps to Reproduce:
1. Initiate your Crops-esdk environment as it says in wiki https://github.com/crops/docker-win-mac-docs/wiki 
2. source environment-setup-i586-poky-linux 
3. run command which devtool 
4. 4a) git clone git://git.openembedded.org/meta-openembedded in layers/build directory 
4b) Add meta-openembedded/meta-oe in bblayer.conf as mentioned below: 
${SDKBASEMETAPATH}/layers/build/meta-openembedded/meta-oe \ 
4c) devtool add "npm://registry.npmjs.org;name=npm;version=2.2.0" 

Logs are attached for the same :
sdkuser@c18c715ca295:/workdir$ ls
bitbake-cookerdaemon.log conf layers sstate-cache version-core2-64-poky-linux
buildtools downloads preparing_build_system.log sysroots workspace
cache environment-setup-core2-64-poky-linux site-config-core2-64-poky-linux tmp
sdkuser@c18c715ca295:/workdir$ source environment-setup-core2-64-poky-linux
SDK environment now set up; additionally you may now run devtool to perform development tasks.
Run devtool --help for further details.
sdkuser@c18c715ca295:/workdir$ devtool add "npm://registry.npmjs.org;name=npm;version=2.2.0"
NOTE: Starting bitbake server...
ERROR: Unable to start bitbake server
ERROR: Last 10 lines of server log for this session (/workdir/bitbake-cookerdaemon.log):
self.cooker = bb.cooker.BBCooker(self.configuration, self.featureset)
File "/workdir/layers/build/bitbake/lib/bb/cooker.py", line 197, in _init_
self.initConfigurationData()
File "/workdir/layers/build/bitbake/lib/bb/cooker.py", line 356, in initConfigurationData
self.databuilder.parseBaseConfiguration()
File "/workdir/layers/build/bitbake/lib/bb/cookerdata.py", line 316, in parseBaseConfiguration
raise bb.BBHandledException
bb.BBHandledException
ERROR: Layer openembedded-layer is not compatible with the core layer which only supports these series: rocko (layer is compatible with thud)
ERROR: Layer openembedded-layer is not compatible with the core layer which only supports these series: rocko (layer is compatible with thud)

ERROR: Unable to start bitbake server
ERROR: Last 10 lines of server log for this session (/workdir/bitbake-cookerdaemon.log):
self.cooker = bb.cooker.BBCooker(self.configuration, self.featureset)
File "/workdir/layers/build/bitbake/lib/bb/cooker.py", line 197, in _init_
self.initConfigurationData()
File "/workdir/layers/build/bitbake/lib/bb/cooker.py", line 356, in initConfigurationData
self.databuilder.parseBaseConfiguration()
File "/workdir/layers/build/bitbake/lib/bb/cookerdata.py", line 316, in parseBaseConfiguration
raise bb.BBHandledException
bb.BBHandledException
ERROR: Layer openembedded-layer is not compatible with the core layer which only supports these series: rocko (layer is compatible with thud)
ERROR: Layer openembedded-layer is not compatible with the core layer which only supports these series: rocko (layer is compatible with thud)

sdkuser@c18c715ca295:/workdir$

(In reply to comment #10)
> Issue is reproducible with 2.4.4RC1 release with suggested work around as
> mentioned below, Issue is not seen 2.6 M2 rc1 release with same work around:
> 
> Steps to Reproduce:
> 1. Initiate your Crops-esdk environment as it says in wiki
> https://github.com/crops/docker-win-mac-docs/wiki 
> 2. source environment-setup-i586-poky-linux 
> 3. run command which devtool 
> 4. 4a) git clone git://git.openembedded.org/meta-openembedded in
> layers/build directory 
> 4b) Add meta-openembedded/meta-oe in bblayer.conf as mentioned below: 
> ${SDKBASEMETAPATH}/layers/build/meta-openembedded/meta-oe \ 

If you're trying out rocko, you should checkout rocko layer ... Please retry.

After checkout rocko layer, below mentioned step is getting passed 
step 4 c)devtool add "npm://registry.npmjs.org;name=npm;version=2.2.0"  

but  "devtool build npm" is getting failed as mentioned in attached logs:

Please find the logs for the same :
 
sdkuser@ff591c534f30:/workdir$ devtool build npm
NOTE: Starting bitbake server...
Loading cache: 100% |###################################################################################################################################| Time: 0:00:01
Loaded 2029 entries from dependency cache.
Parsing recipes: 100% |#################################################################################################################################| Time: 0:00:00
Parsing of 1431 .bb files complete (1430 cached, 1 parsed). 2030 targets, 53 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies
Initialising tasks: 100% |##############################################################################################################################| Time: 0:00:01
Checking sstate mirror object availability: 100% |######################################################################################################| Time: 0:00:01
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
NOTE: npm: compiling from external source tree /workdir/workspace/sources/npm
ERROR: npm-2.2.0-r0 do_compile: Function failed: do_compile (log file is located at /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/temp/log.do_compile.55881)
ERROR: Logfile of failure stored in: /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/temp/log.do_compile.55881
Log data follows:
| DEBUG: Executing python function externalsrc_compile_prefunc
| NOTE: npm: compiling from external source tree /workdir/workspace/sources/npm
| DEBUG: Python function externalsrc_compile_prefunc finished
| DEBUG: Executing shell function do_compile
| npm ERR! As of npm@5, the npm cache self-heals from corruption issues and data extracted from the cache is guaranteed to be valid. If you want to make sure everything is consistent, use 'npm cache verify' instead.
| npm ERR!
| npm ERR! If you're sure you want to delete the entire cache, rerun this command with --force.
|
| npm ERR! A complete log of this run can be found in:
| npm ERR!     /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/npm_cache/_logs/2018-11-22T08_33_22_260Z-debug.log
| WARNING: exit code 1 from a shell command.
| ERROR: Function failed: do_compile (log file is located at /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/temp/log.do_compile.55881)
ERROR: Task (/workdir/workspace/recipes/npm/npm_2.2.0.bb:do_compile) failed with exit code '1'
NOTE: Tasks Summary: Attempted 446 tasks of which 270 didn't need to be rerun and 1 failed.
NOTE: The errors for this build are stored in /workdir/tmp/log/error-report/error_report_20181122082037.txt
You can send the errors to a reports server by running:
  send-error-report /workdir/tmp/log/error-report/error_report_20181122082037.txt [-s server]
NOTE: The contents of these logs will be posted in public if you use the above command with the default server. Please ensure you remove any identifying or proprietary information when prompted before sending.

Summary: 1 task failed:
  /workdir/workspace/recipes/npm/npm_2.2.0.bb:do_compile
Summary: There was 1 ERROR message shown, returning a non-zero exit code.
sdkuser@ff591c534f30:/workdir$

(In reply to comment #12)
> After checkout rocko layer, below mentioned step is getting passed 
> step 4 c)devtool add "npm://registry.npmjs.org;name=npm;version=2.2.0"  
> 
> but  "devtool build npm" is getting failed as mentioned in attached logs:
> 
> Please find the logs for the same :
>  
> sdkuser@ff591c534f30:/workdir$ devtool build npm
> NOTE: Starting bitbake server...
> Loading cache: 100%
> |############################################################################
> #######################################################| Time: 0:00:01
> Loaded 2029 entries from dependency cache.
> Parsing recipes: 100%
> |############################################################################
> #####################################################| Time: 0:00:00
> Parsing of 1431 .bb files complete (1430 cached, 1 parsed). 2030 targets, 53
> skipped, 0 masked, 0 errors.
> NOTE: Resolving any missing task queue dependencies
> Initialising tasks: 100%
> |############################################################################
> ##################################################| Time: 0:00:01
> Checking sstate mirror object availability: 100%
> |############################################################################
> ##########################| Time: 0:00:01
> NOTE: Executing SetScene Tasks
> NOTE: Executing RunQueue Tasks
> NOTE: npm: compiling from external source tree /workdir/workspace/sources/npm
> ERROR: npm-2.2.0-r0 do_compile: Function failed: do_compile (log file is
> located at
> /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/temp/log.do_compile.55881)
> ERROR: Logfile of failure stored in:
> /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/temp/log.do_compile.55881
> Log data follows:
> | DEBUG: Executing python function externalsrc_compile_prefunc
> | NOTE: npm: compiling from external source tree
> /workdir/workspace/sources/npm
> | DEBUG: Python function externalsrc_compile_prefunc finished
> | DEBUG: Executing shell function do_compile
> | npm ERR! As of npm@5, the npm cache self-heals from corruption issues and
> data extracted from the cache is guaranteed to be valid. If you want to make
> sure everything is consistent, use 'npm cache verify' instead.
> | npm ERR!
> | npm ERR! If you're sure you want to delete the entire cache, rerun this
> command with --force.
> |
> | npm ERR! A complete log of this run can be found in:
> | npm ERR!    
> /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/npm_cache/_logs/2018-11-
> 22T08_33_22_260Z-debug.log
> | WARNING: exit code 1 from a shell command.
> | ERROR: Function failed: do_compile (log file is located at
> /workdir/tmp/work/core2-64-poky-linux/npm/2.2.0-r0/temp/log.do_compile.55881)

This is a different issue ... We need this commit to be backported:

https://git.yoctoproject.org/cgit/cgit.cgi/poky/commit?id=d38e1e2c2ea4646b34ea6282d3d7620df5b0374b

Armin, can you please include this in rocko?

backported to stable/rocko-nmut for build test before requesting a merge

its in stable/rocko-next. waiting for merging to proper

(In reply to comment #15)
> its in stable/rocko-next. waiting for merging to proper

Looks like this was never merged. Also not sure why this was marked for 2.7/2.6 ... 

Can this be merged in rocko? If not, since this was not reproducible in 2.6, can this be closed?

I don't see the problem as indicated above and rocko isn't maintained anymore.