Latest nightly hangs after running a few minutes, uses excessive RAM

Discussions
1

I’m not sure how to approach reporting this problem, as I can’t exactly do data gathering while the problem is occurring.

At some point while Komodo IDE runs, it seems to lose it’s mind. The UI will hang, and the ram consumption skyrockets, taking everything available (around 16GB in my case).

I have no projects open, and only a single PHP file open in the editor.

I’ve tried to induce the crash reporter dialog as described at https://github.com/Komodo/KomodoEdit/issues/2424, which does indeed crash Komodo, but when I report, the dialog indicates “there was a problem sending your report”.

I have tried safe mode, and there was no perceivable difference.

I can fairly reliably replicate this crash on my workstation. It’s been preventing me from getting real work done most of today. :frowning:

Build info:

Komodo IDE, version 10.2.3, build 89902, platform linux-x86_64.
Built on Wed Jul 12 00:24:15 2017.

LSB info:

No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial

I’m using XFCE 4.12, provided by Xubuntu Desktop.

I can provide any additional information or troubleshooting that’s needed.

2

What prompted you to use 10.2.3? Was this issue occurring in 10.2.2 as well?
Though the nightly should work on all platforms, it is intended for an OSX problem and you shouldn’t need to upgrade in theory.

Can you try running 10.2.2 again and see if the issue persists? You can install them side by side in different directories on Linux. You’ll only be able to run one at a time though.

Also, snag your logs from ~/.komodoide/pystderr.log and share them here when Komodo has crashed.

  • Carey
3

I had switched to the nightly to address https://github.com/Komodo/KomodoEdit/issues/2360 a while back and never switched back, to both help give feedback on other things (like this) and get previews of things coming down the pipe for the rest of my team.

When testing this morning, it appeared that just opening Komodo 10.2.2 triggers what appears to be the memory leak, with no projects open.

To further troubleshoot, I renamed the .activestate and .komodoide folders to see if that would resolve the problem. This didn’t appear to fix the problem.

What I do notice when the problem, Komodo lights up the processor on the machine (fans kick on, at which point I fire up htop to see what’s going on. It’s usually Komodo running a core at 100%, and the load dancing between cores), and the RAM leak happens.

pystderror, after triggering the crash as outlined in #2424:

[2017-07-21 08:10:11,455] [INFO] Startup: Welcome to Komodo IDE 10.2.2 build 89895 (platform linux-x86_64, running on Linux 4.4.0-83-generic version #106-Ubuntu SMP Mon Jun 26 17:54:43 UTC 2017)
[2017-07-21 08:10:11,455] [INFO] Startup: /usr/bin/python built on Fri Apr 28 17:38:33 2017
[2017-07-21 08:10:11,506] [INFO] koInitService: Setting LC_CTYPE to utf-8
[2017-07-21 08:10:11,736] [WARNING] console-logger: mutating the [[Prototype]] of an object will cause your code to run very slowly; instead create the object with the correct initial [[Prototype]] value using Object.create (1) in resource://gre/modules/Preferences.jsm:381
[2017-07-21 08:10:12,396] [WARNING] root: ko.logging has been converted to a CommonJS module; use require("ko/logging") instead (since Komodo 9.0.0a1).
    @chrome://komodo/content/komodo.js:15:1

[2017-07-21 08:10:14,618] [ERROR] console-logger: bad script XDR magic number (0) in :0
Traceback (most recent call last):
  File "", line 0, in 

[2017-07-21 08:10:15,265] [WARNING] keybindings: [Ctrl+0] was used for 'cmd_goToQuickBookmark_0', overriding to use 'cmd_fontZoomReset'
[2017-07-21 08:10:16,341] [INFO] koInitService: Adding pre startup service for 'koFileStatusService': '@activestate.com/koFileStatusService;1'
[2017-07-21 08:10:16,909] [INFO] elastic_tabstops: Elastic tabstops loaded.
[2017-07-21 08:10:17,311] [INFO] komodospellchecker: Spell checker loaded.
[2017-07-21 08:10:17,311] [INFO] komodospellchecker: Using dictionary en-US
[2017-07-21 08:10:19,876] [WARNING] console-logger: mutating the [[Prototype]] of an object will cause your code to run very slowly; instead create the object with the correct initial [[Prototype]] value using Object.create (1) in file:///home/eellis/Komodo-IDE-10/lib/mozilla/components/koamAddonManager.js:138
[2017-07-21 08:10:20,662] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:20,663] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:20,663] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:20,666] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:20,667] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:20,668] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:20,737] [INFO] koInitService: Adding pre startup service for 'KoMemoryReporter': '@activestate.com/koMemoryReporter;1'
[2017-07-21 08:10:20,791] [INFO] koInitService: Adding pre startup service for 'koCommandmentService': '@activestate.com/koCommandmentService;1'
[2017-07-21 08:10:20,829] [INFO] koInitService: Adding pre startup service for 'koDBGPManager': '@activestate.com/koDBGPManager;1'
[2017-07-21 08:10:24,939] [ERROR] koToolbox2: Couldn't load json data for path /home/eellis/.komodoide/10.2/tools/Tutorials/Getting_Started.komodotool
Traceback (most recent call last):
  File "/home/eellis/Komodo-IDE-10/lib/mozilla/python/komodo/koToolbox2.py", line 1716, in _testAndAddItem
    data = json.load(fp, encoding="utf-8")
  File "/home/eellis/Komodo-IDE-10/lib/python/lib/python2.7/json/__init__.py", line 290, in load
    **kw)
  File "/home/eellis/Komodo-IDE-10/lib/python/lib/python2.7/json/__init__.py", line 351, in loads
    return cls(encoding=encoding, **kw).decode(s)
  File "/home/eellis/Komodo-IDE-10/lib/python/lib/python2.7/json/decoder.py", line 366, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/home/eellis/Komodo-IDE-10/lib/python/lib/python2.7/json/decoder.py", line 384, in raw_decode
    raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
[2017-07-21 08:10:25,549] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:25,550] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:25,550] [WARNING] console-logger: XUL box for tab element contained an inline #text child, forcing all its children to be wrapped in a block. (1) in chrome://unittest/content/views/panel.xul:0
[2017-07-21 08:10:29,426] [ERROR] codeintel.komodo.KoCodeIntelManager: failed to get langAppInfo.version for language JavaScript
[2017-07-21 08:10:43,198] [ERROR] koScopeDocs-Py: Could not find cix for ext
[2017-07-21 08:10:43,338] [ERROR] koScopeDocs-Py: Could not find cix for html5

Build info:

Komodo IDE, version 10.2.2, build 89895, platform linux-x86_64.
Built on Fri Apr 28 17:38:33 2017.

4

Upon further testing, it appears to only trigger when I’m in a specific folder… I suspect codeintel may be freaking out over the contents of said folder, as in the root it has some PHP, and in one of the sub folders there are a couple of copies of Redmine (different versions), a non-trivial Ruby application.

Removing those subfolders seems to have remedied the problem I was having. I apologize for taking up time.

5

@jellisii, I’d say this was time well spent. Thanks for letting us know what you found. It’ll help other users in the future.

Did you find the code intel options, per language, that allows you to exclude directories from being scanned or did you just move your project?

  • Carey
6

Moved the offending subfolder, as it was data generated by the code, not code itself.

7

Sounds like a perfect case for the excludes pref.

8

@jellisii so this happened on both 10.2.2 and the 10.2.3 nightly, correct?

9

Correct.

10

Great, thanks for clarifying :slight_smile: