<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>7663</bug_id>
          
          <creation_ts>2015-04-27 13:23:32 +0000</creation_ts>
          <short_desc>Layer index failing to update due to too many open files</short_desc>
          <delta_ts>2016-11-03 07:10:54 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>6</classification_id>
          <classification>Yocto Project Subprojects</classification>
          <product>Layer Index</product>
          <component>Layer Index</component>
          <version>unspecified</version>
          <rep_platform>All</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>VERIFIED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>High</priority>
          <bug_severity>major</bug_severity>
          <target_milestone>1.9 M1</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Paul Eggleton">bluelightning</reporter>
          <assigned_to name="Paul Eggleton">bluelightning</assigned_to>
          <cc>belen.barros.pena</cc>
    
    <cc>brian.avery</cc>
          
          <qa_contact name="Alexandru Georgescu">alexandru.c.georgescu</qa_contact>
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>50517</commentid>
    <comment_count>0</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2015-04-27 13:23:32 +0000</bug_when>
    <thetext>The layer index update script is tripping over this every time it runs:

-------------- snip --------------
Traceback (most recent call last):
  File &quot;/var/www/html/layerindex/layerindex/update.py&quot;, line 304, in main
  File &quot;/usr/local/lib/python2.7/dist-packages/git/repo/base.py&quot;, line 420, in iter_commits
  File &quot;/usr/local/lib/python2.7/dist-packages/git/objects/commit.py&quot;, line 192, in iter_items
  File &quot;/usr/local/lib/python2.7/dist-packages/git/cmd.py&quot;, line 219, in &lt;lambda&gt;
  File &quot;/usr/local/lib/python2.7/dist-packages/git/cmd.py&quot;, line 430, in _call_process
  File &quot;/usr/local/lib/python2.7/dist-packages/git/cmd.py&quot;, line 309, in execute
  File &quot;/usr/lib/python2.7/subprocess.py&quot;, line 679, in __init__
  File &quot;/usr/lib/python2.7/subprocess.py&quot;, line 1135, in _execute_child
  File &quot;/usr/lib/python2.7/subprocess.py&quot;, line 1091, in pipe_cloexec
OSError: [Errno 24] Too many open files
-------------- snip --------------

This may be related to the fact that we aren&apos;t processing any events generated during parsing and thus these are stacking up in memory; perhaps there are open file handles associated with these as well.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>50518</commentid>
    <comment_count>1</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2015-04-27 13:32:44 +0000</bug_when>
    <thetext>I should mention that this is not a new issue, it&apos;s been happening for some time now and is only getting worse as the database has grown in size.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>50829</commentid>
    <comment_count>2</comment_count>
    <who name="Aníbal Limón">anibal.limon</who>
    <bug_when>2015-05-06 16:04:00 +0000</bug_when>
    <thetext>It seems an known issue [1] and it&apos;s fixed since v0.3.5, i think with an upgrade should be enough to solve the problem the current version is 1.0.1 [2].


[1] https://github.com/gitpython-developers/GitPython/issues/60
[2] https://pypi.python.org/pypi/GitPython/1.0.1</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>51682</commentid>
    <comment_count>3</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2015-06-14 23:18:27 +0000</bug_when>
    <thetext>I had a look into this since we were not only leaking file handles, but also memory. I&apos;ve applied the following fix:

http://git.yoctoproject.org/cgit/cgit.cgi/layerindex-web/commit/?id=f4b45258589185fd8bb7f220470a72650dc792f8

After this everything should now be working much better - at least a refresh can now be run successfully. I&apos;ll mark this as fixed for now, if we see the problem again we can reopen.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>51697</commentid>
    <comment_count>4</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2015-06-15 09:26:22 +0000</bug_when>
    <thetext>An additional fix for the fix for compatibility with daisy and earlier:

http://git.yoctoproject.org/cgit/cgit.cgi/layerindex-web/commit/?id=40f1d51de67645506cbe7becb625cbcaeaa9f716</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53345</commentid>
    <comment_count>5</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2015-08-24 09:35:55 +0000</bug_when>
    <thetext>(In reply to comment #4)
&gt; An additional fix for the fix for compatibility with daisy and earlier:
&gt; 
&gt; http://git.yoctoproject.org/cgit/cgit.cgi/layerindex-web/commit/
&gt; ?id=40f1d51de67645506cbe7becb625cbcaeaa9f716

Seems that the issue is fixed after Paul&apos;s confirmation.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>