Sqlite3 install and run issues

[jsalwen]

I am no longer able to get Botpress to run. In order to submit PR botpress/botpress#309 using async / await, I updated nodejs. Previously, I had a much older version.

• Now, I can create a new bot: 'bp init bot-name`
• I can start the bot: bp start

But is I try to install botpress-messenger or botpress-slack, I get the sqlite3 error
see #120

foo-bot>bp install botpress-messenger
[botpress]       please wait, we are trying to install your new modules...
[botpress]       Installing modules: botpress-messenger
[botpress]       ERR npm
[botpress]       ERR WARN botpress-messenger@2.2.9 requires a peer of botpress@>= 0.1 but none is installed. You must install peer dependencies yourself.
npm WARN react-audio-player@0.5.0 requires a peer of react@15.x but none is installed. You must install peer dependencies yourself.
npm WARN react-audio-player@0.5.0 requires a peer of react-dom@15.x but none is installed. You must install peer dependencies yourself.
npm WARN react-player@0.18.0 requires a peer of react@* but none is installed. You must install peer dependencies yourself.
npm WARN foo-bot4@0.0.1 No description
npm WARN foo-bot4@0.0.1 No repository field.
npm WARN foo-bot4@0.0.1 license should be a valid SPDX license expression


[botpress]       ERR npm ERR! path c:\projects\foo-bot\node_modules\sqlite3\node_modules\node-pre-gyp\node_modules\mkdirp\node_modules\minimist
npm ERR! code ENOENT
npm ERR! errno -4058
npm ERR! syscall rename
npm ERR! enoent ENOENT: no such file or directory, rename 'c:\projects\foo-bot\node_modules\sqlite3\node_modules\node-pre-gyp\node_modules\mkdirp\node_modules\minimist' -> 'c:\projects\foo-bot\node_modules\sqlite3\node_modules\node-pre-gyp\node_modules\mkdirp\node_modules\.minimist.DELETE'
npm ERR! enoent This is related to npm not being able to find a file.
npm ERR! enoent

[botpress]       ERR
npm ERR! A complete log of this run can be found in:
npm ERR!     C:\Users\me\AppData\Roaming\npm-cache\_logs\2017-12-20T00_01_18_935Z-debug.log

[botpress]       ERR An error occurred during modules installation.
Unhandled rejection undefined

At this point, nothing works. I can't run bp start

foo-bot>bp start
[botpress]       ERR Cannot find module 'c:\projects\foo-bot\node_modules\botpress'
[botpress]       ERR Error: Cannot find module 'c:\projects\foo-bot\node_modules\botpress'
    at Function.Module._resolveFilename (module.js:470:15)
    at Function.Module._load (module.js:418:25)
    at Module.require (module.js:498:17)
    at require (internal/module.js:20:19)
    at Command.module.exports.module.exports (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\lib\node.bundle.js:1863:31)
    at Command.listener (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\node_modules\commander\index.js:315:8)
    at emitTwo (events.js:106:13)
    at Command.emit (events.js:194:7)
    at Command.parseArgs (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\node_modules\commander\index.js:653:12)
    at Command.parse (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\node_modules\commander\index.js:475:21)
    at Object.<anonymous> (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\lib\node.bundle.js:1613:120)
    at __webpack_require__ (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\lib\node.bundle.js:21:30)
    at Object.CLI (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\lib\node.bundle.js:1541:10)
    at Object.<anonymous> (C:\Users\me\AppData\Roaming\npm\node_modules\botpress\bin\botpress:3:34)
    at Module._compile (module.js:571:32)
    at Object.Module._extensions..js (module.js:580:10)
[botpress]       ERR (fatal) Could not load the local version of botpress
[botpress]       Hint: 1) have you used `botpress init` to create a new bot the proper way?
[botpress]       Hint: 2) Do you have read and write permissions on the current directory?
[botpress]       -------------
[botpress]       If none of the above works, this might be a bug in botpress. Please contact the Botpress Team on gitter and provide the printed error above.

The root of this appears to be related to sqlite3, but it is an issue for botpress, so I think we need to find a fix. It is looking like a show stopper for me.

I completely uninstalled node and tried a couple of different installs, but I am getting the same issues.

• OS: Windows 10
• Check that you are using node version >= 7.10.1 and 8.9.3
• Search the documentation

Please also fill in these fields:

---

Botpress version: 1.1.10

[jsalwen]

@elliott-beach @slvnperron any suggestions?

[slvnperron]

@jsalwen Which version of node are you using? SQLite is broken on many versions / OS. SQLite works well under node version 8.0 for darwin x86_64, perhaps worth trying 8.0 ?

[slvnperron]

I am thinking we should remove SQLite as a Botpress dependency and make the driver swappable, i.e. have a botpress-db-sqlite and botpress-db-postgres module instead.

[jsalwen]

@slvnperron I tried node versions 7.10.1 and 8.9.3. What version of 8.x are you using?

[jsalwen]

@slvnperron I updated sqlite3 to ^3.1.13 in my local botpress, and it seemed to fix it.

There was a PR to fix the node-pre-gyp issue with not passing parameters.. mapbox/node-pre-gyp#301
It was an issue with newer versions of npm: https://github.com/mapbox/node-pre-gyp/pull/301/files#diff-180360612c6b8c4ed830919bbb4dd459R31

[jsalwen]

I am no longer having issues starting with version 1.1.11 with sqlite3 version 3.1.13

[saitaiky]

@jsalwen Could you tell me where I can change the sqlite3 to ^3.1.13? I can't find my botpress folder at the global environment in my Mac..

[jsalwen]

@saitai0802 you can install the latest version of Botpress. The current version on npm is 1.1.12 so it will have the updated version of sqlite3

npm update -g botpress

[saitaiky]

@jsalwen Thank you for your reply!

When I run the npm install -g botpress installation command, this below line kept popping non-stop:
gyp WARN EACCES user "root" does not have permission to access the dev dir "/usr/lib/node_modules/botpress/node_modules/sqlite3/.node-gyp/8.9.4"

After I terminate that installation then run
npm update -g botpress
botpress init

It shows up installation error then terminated my installation.. do you have any idea what happened?
npm ERR! path /vagrant/botpress-sandbox/myproject/node_modules/sqlite3/node_modules/verror/node_modules/assert-plus/package.json.1217345269 npm ERR! code ENOENT npm ERR! errno -2 npm ERR! syscall open npm ERR! enoent ENOENT: no such file or directory, open '/vagrant/botpress-sandbox/myproject/node_modules/sqlite3/node_modules/verror/node_modules/assert-plus/package.json.1217345269' npm ERR! enoent This is related to npm not being able to find a file. npm ERR! enoent

[saitaiky]

Seems the problem is lots of people can't even install sqlite3 correctly... TryGhost/node-sqlite3#866
If there any workaround for case?

[salehinRafi]

@saitai0802 it happens to me a few days back. I try above solution as well but still, the problem persists.
This is what I did to solve:

1. run npm outdated inside the project folder (will show old version even already run command npm update -g botpress)
2. Directly update using npm update inside the folder will solve the issues for me.

[epaminond]

Since issue seems to be solved, closing this.