Be sure to report any Grakn boot up issues!


#1

We’ve seen several issues popped up on our discussion channel with regard to Grakn boot up.

While we are working on improving the stability, it would be great if anyone experiencing such issues to create a topic here.

Please ensure that you include the following details:

  1. Grakn version
  2. Your operating system
  3. Whether it is Grakn distribution that you download, installed from brew, or Docker
  4. The step which you did
  5. The current state of Grakn, by running these commands:
  • ls -la /tmp/*.pid
  • ps -ef | grep redis-server
  • jps (if this command is installed on the system. usually is, when you are on Oracle JDK)
  1. The logs. If they’re quite long, maybe try only posting the last 200 lines of each
  • tail -n 200 $GRAKN_HOME/logs/cassandra.log
  • tail -n 200 $GRAKN_HOME/logs/grakn.log
  • tail -n 200 /tmp/grakn-queue.log

Starting Queue........FAILED! [all success on another two computer]
Starting Grakn… FAILED
Please report any error "java.lang.RuntimeException: Couldn’t get PID of Grakn. Received '"
Grakn server status error after changing default Visualiser port [0.18.0][RESOLVED]
Starting Engine...........FAILED
#2

#6

Hi Samuel,

Can you create your own topic for this issue?

In the new topic, please also include the following information:

cat ./conf/grakn.properties| grep server.host
and

cat ./conf/grakn.properties| grep server.port

Thanks!


#7

oops. I will not be able to add more information… I have reinstalled everything :frowning: I will create a new topic with what I have.


#8

UPDATE: My issue was solved. The cause was a wrong JAVA_HOME environment variable.

  1. Grakn version

1.0

  1. Your operating system

Ubuntu 16.04 LTS

Whether it is Grakn distribution that you download, installed from brew, or Docker

Download from grakn.ai

The step which you did

  • download 1.0
  • unzip
  • cd into folder
  • ./grakn server start

Grakn responded:

> tomen@viech-ubuntu:~/Applications/grakn-dist-1.0.0$ ./grakn server start
> =============================================================================
>       ________  _____     _______  __    __  __    __      _______  ___
>      |   __   ||   _  \  |   _   ||  |  /  /|  \  |  |    |   _   ||   |
>      |  |  |__||  | |  | |  | |  ||  | /  / |   \ |  |    |  | |  ||   |
>      |  | ____ |  |_| /  |  |_|  ||  |/  /  |    \|  |    |  |_|  ||   |
>      |  ||_   ||   _  \  |   _   ||   _  \  |   _    |    |   _   ||   |
>      |  |__|  ||  | \  \ |  | |  ||  | \  \ |  | \   | __ |  | |  ||   |
>      |________||__|  \__\|__| |__||__|  \__\|__|  \__||__||__| |__||___|
> 
>                           Grakn: The Database For AI
> =============================================================================
> 
> Starting Storage...FAILED!
> Unable to start Storage
> Please run 'grakn server status' or check the logs located under 'logs' directory.

The current state of Grakn, by running these commands:

tomen@viech-ubuntu:~/Applications/grakn-dist-1.0.0$ ls -la /tmp/*.pid
ls: cannot access '/tmp/*.pid': No such file or directory
tomen@viech-ubuntu:~/Applications/grakn-dist-1.0.0$ ps -ef | grep redis-server
tomen     4597  3894  0 19:32 pts/2    00:00:00 grep --color=auto redis-server
tomen@viech-ubuntu:~/Applications/grakn-dist-1.0.0$ jps
4600 sun.tools.jps.Jps

The logs. If they’re quite long, maybe try only posting the last 200 lines of each

The commands were off, because they assume $GRAKN_HOME, which is not defined as per the installation instructions. I fixed them.

logs/cassandra.log does not exist.

logs/grakn.log shows:

2018-02-04 19:23:42,259 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: /home/tomen/Applications/grakn-dist-1.0.0
2018-02-04 19:23:42,266 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: /home/tomen/Applications/grakn-dist-1.0.0/conf/grakn.properties

/tmp/grakn-queue.log does not exist.


#9

Grakn Version: 1.0

OS: Arch Linux (4.14.16-1-MANJARO)

GRAKN Distribution: 1.0 release downloaded from https://grakn.ai/download/latest

Steps: ./grakn server start

Output:
Starting Storage........................FAILED! Unable to start Storage Please run 'grakn server status' or check the logs located under 'logs' directory.

State:
-rw-r–r-- 1 user user 5 8 feb 14:02 /tmp/grakn-storage.pid
user 14551 1714 0 14:05 pts/0 00:00:00 grep --color redis-server
14745 Jps

grakn.log:
2018-02-08 13:43:41,656 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/user/grakn 2018-02-08 13:43:41,660 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/user/grakn/conf/grakn.properties

Other logs do not exist

JAVA_HOME is set to: /usr/lib/jvm/java-8-openjdk

Any ideas what may be the cause? I used Beta builds of GRAKN on the same environment some months ago with no problems.

Thanks.


Grakn server startup issue after update to 1.2.0
not able to start grakn on unix
#10

#11

./grakn server start:

Starting Storage....................FAILED!
Unable to start Storage. 
Process exited with code 0: 'OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000f2200000, 232783872, 0) failed; error='Cannot allocate memory' (errno=12)
'
An error has occurred during boot-up. Please run 'grakn server status' or check the logs located under the 'logs' directory.
null

Grakn version: 1.3.0
Downloaded from grakn.ai
Operating system: Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux

ls -la /tmp/*.pid

-rw-r--r-- 1 root root 5 Aug 20 10:55 /tmp/grakn-storage.pid

ps -ef | grep redis-server

root     14504 13963  0 10:03 ?        00:00:05 ./services/redis/redis-server-linux 172.17.0.2:6379
nickm    20351 13387  0 11:04 pts/0    00:00:00 grep redis-server

(no jps command)

tail -n 200 logs/cassandra.log

No such file.

tail -n 200 logs/grakn.log

2018-08-20 10:55:27,142 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: /home/nickm/grakn-dist-1.3.0
2018-08-20 10:55:27,149 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: /home/nickm/grakn-dist-1.3.0/conf/grakn.properties
2018-08-20 10:55:27,195 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: /home/nickm/grakn-dist-1.3.0
2018-08-20 10:55:27,195 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: /home/nickm/grakn-dist-1.3.0/conf/grakn.properties
2018-08-20 10:55:27,196 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: /home/nickm/grakn-dist-1.3.0
2018-08-20 10:55:27,196 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: /home/nickm/grakn-dist-1.3.0/conf/grakn.properties
2018-08-20 10:55:27,714 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: /home/nickm/grakn-dist-1.3.0
2018-08-20 10:55:27,714 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: /home/nickm/grakn-dist-1.3.0/conf/grakn.properties
2018-08-20 10:56:29,195 [main] ERROR ai.grakn.engine.bootup.GraknBootup - An error has occurred during boot-up. Please run 'grakn server status' or check the logs located under the 'logs' directory.
ai.grakn.engine.bootup.BootupException: null
    at ai.grakn.engine.bootup.StorageBootup.start(StorageBootup.java:162)
    at ai.grakn.engine.bootup.StorageBootup.startIfNotRunning(StorageBootup.java:79)
    at ai.grakn.engine.bootup.GraknBootup.serverStart(GraknBootup.java:190)
    at ai.grakn.engine.bootup.GraknBootup.server(GraknBootup.java:143)
    at ai.grakn.engine.bootup.GraknBootup.run(GraknBootup.java:130)
    at ai.grakn.engine.bootup.GraknBootup.main(GraknBootup.java:71)

tail -n 200 /tmp/grakn-queue.log

No such file.

echo $JAVA_HOME

/usr/lib/jvm/java-8-openjdk-amd64/

Further info

Tried with grakn 1.2.0 under same environment. Logs show same result: configuration file / project directory in use.

Cheers,
Nick


#12

The error message seems to indicate that Cassandra had failed to start due to memory issue: “Process exited with code 0: 'OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000f2200000, 232783872, 0) failed; error=‘Cannot allocate memory’ (errno=12)”. Do you at least have 2GB of free memory?

Can you do a free -hm to see how much memory do you have in your system? Is this a docker instance, a VM, or a bare-metal machine?

PS: @cyclecycle as mentioned above, please create a new topic rather than posting a comment in this one for the next time. Thanks!


#13

@ganesh, thanks a lot. This does appear to be due to insufficient memory (on a VM).

Running locally now and not getting this error, but still running into issues. Will create a new topic.

edit: seem to be up and running locally, after configuring java paths correctly, which I thought I had done before but apparently not. :stuck_out_tongue:


#14

Hi, I am trying to install Grakn on an Ubuntu OS but getting error. Please find below the details.

  1. Grakn Version: 1.3

  2. Operating System: Ubuntu 16.04.4 LTS(xenial)

  3. Grakn distribution downloaded from Grakn Website

  4. Downloaded 1.3 from Grakn site —> unzip —> cd into folder --> ./grakn server start
    Grakn’s response -
    ubuntu$ ./grakn server start
    ====================================================================================================


    | __ || _ \ | _ || | / /| \ | | | _ || _ || _ \ | |
    | | ||| | | | | | | || | / / | \ | | | | ||| | | || | | | | |
    | | ____ | |
    | / | |
    | || |/ / | | | | | | | | || |
    | / | |
    ___
    | ||_ || _ \ | _ || _ \ | _ | | | __ | | | || _ \ | |
    | |__| || | \ \ | | | || | \ \ | | \ | | |
    | || |
    | || | \ \ | |
    __
    |||| __|| |||| _|__| _| |||||__| _|______|

                                      THE KNOWLEDGE GRAPH
    

====================================================================================================

Starting Storage…SUCCESS
Starting Queue…FAILED!
Unable to start Queue. Process exited with code 0: ‘’
An error has occurred during boot-up. Please run ‘grakn server status’ or check the logs located under the ‘logs’ directory.
null

  1. The current state of Grakn, by running these commands:

ubuntu$ ls -la /tmp/*.pid
-rw-rw-r-- 1 ubuntu ubuntu 5 Sep 24 08:02 /tmp/grakn-storage.pid
ubuntu$ ps -ef | grep redis-server
redis 14993 1 0 Aug08 ? 01:16:04 /usr/bin/redis-server 127.0.0.1:6379
ubuntu 47458 129362 0 08:12 pts/2 00:00:00 grep --color=auto redis-server
ubuntu$ jps
100576 Bootstrap
37302 CassandraDaemon
47608 Jps
6. The logs. If they’re quite long, maybe try only posting the last 200 lines of each
ubuntu$ tail -n 200 $GRAKN_HOME/logs/cassandra.log
tail: cannot open ‘/logs/cassandra.log’ for reading: No such file or directory
ubuntu$ tail -n 200 $GRAKN_HOME/logs/grakn.log
tail: cannot open ‘/logs/grakn.log’ for reading: No such file or directory
ubuntu$ tail -n 200 /tmp/grakn-queue.log
tail: cannot open ‘/tmp/grakn-queue.log’ for reading: No such file or directory


#15

Hey @omshanti, are you trying to run Grakn 1.3 or perhaps 1.4? Also could you please report what’s in logs/grakn.log file?


#16

Hi @marco,

Thanks for looking into it.

I am trying to run Grakn 1.3. Please find below the details from logs/grakn.log file:

2018-09-24 08:01:42,929 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:01:42,933 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:01:42,959 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:01:42,959 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:01:53,753 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:01:53,756 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:01:53,783 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:01:53,783 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:21,702 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:02:21,705 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:21,732 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:02:21,732 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:30,259 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:02:30,263 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:30,290 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:02:30,290 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:30,291 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:02:30,291 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:30,596 [main] INFO ai.grakn.engine.GraknConfig - Project directory in use: /home/ubuntu/Grakn/grakn-dist-1.3.0
2018-09-24 08:02:30,596 [main] INFO ai.grakn.engine.GraknConfig - Configuration file in use: /home/ubuntu/Grakn/grakn-dist-1.3.0/conf/grakn.properties
2018-09-24 08:02:44,371 [main] ERROR ai.grakn.engine.bootup.GraknBootup - An error has occurred during boot-up. Please run ‘grakn server status’ or check the logs located under the ‘logs’ directory.
ai.grakn.engine.bootup.BootupException: null
at ai.grakn.engine.bootup.QueueBootup.start(QueueBootup.java:131)
at ai.grakn.engine.bootup.QueueBootup.startIfNotRunning(QueueBootup.java:68)
at ai.grakn.engine.bootup.GraknBootup.serverStart(GraknBootup.java:191)
at ai.grakn.engine.bootup.GraknBootup.server(GraknBootup.java:143)
at ai.grakn.engine.bootup.GraknBootup.run(GraknBootup.java:130)
at ai.grakn.engine.bootup.GraknBootup.main(GraknBootup.java:71)


#17

Ok, not a lot of useful info here, could you please try to download the latest version of Grakn? We have worked on some bootup issue and this problem you’re having might be solved.

Here the link to download it: https://grakn.ai/download#core

Let us know!


#18

Ok. Let me try the latest version and will revert, if I still face any issue.


#19

Hi @marco,

While i install new version, in the meantime just wanted to know your views on below.

What if an Ubuntu server already has a redit server(standalone one, NOT part of Grakn) installed and running on port 6379, and then we try to install Grakn over it. I believe since Grakn also tries to run redit server on port 6379 it will lead to boot up issues! I think this is what happening in my case. We already have a Redit server running for some important and critical functions in Prod on port 6379. Now, when we try to run Grakn, it leads to bootup problem and there is a message that gets recorded in logs/grakn-queue.log file:

37620:M 24 Sep 08:02:34.365 # Creating Server TCP listening socket 127.0.0.1:6379: bind: Address already in use

Can you please help.


#20

Hi @omshanti,

the new version of Grakn does not use Redis anymore,
the queue system is now completely embedded in the Grakn process
so you should not have any of the problems you’ve mentioned.

Let us know if your problems are solved


#21

The new version worked! Excellent! Thanks!


#22

What about boot ‘down’ issues? On 1.4.0, grakn server stop sometimes never succeeds in stopping engine (some ASCII art removed):

12:01 $ grakn server stop
...

                                     THE KNOWLEDGE GRAPH



Stopping Engine.....................................................................................................................................................

This just goes forever, in the logs I see this:

2018-09-24 12:02:00,402 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: 
/Users/nathanjohnson/src/grakn-core-1.4.0
2018-09-24 12:02:00,406 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: 
/Users/nathanjohnson/src/grakn-core-1.4.0/conf/grakn.properties
2018-09-24 12:02:00,408 [main] INFO  ai.grakn.engine.GraknConfig - Project directory in use: 
/Users/nathanjohnson/src/grakn-core-1.4.0
2018-09-24 12:02:00,408 [main] INFO  ai.grakn.engine.GraknConfig - Configuration file in use: 
/Users/nathanjohnson/src/grakn-core-1.4.0/conf/grakn.properties

I had to kill the ai.grakn.engine.bootup.GraknCassandra and ai.grakn.engine.bootup.Grakn processes to take the server down. A restart and stop was then successful.


#23

We are aware of such issues!
In general the cause of this is that Grakn doesn’t like to stop when it has transactions still open. Transactions could be open via any number of mechanisms, including the Graql console, using client Java/NodeJS/Python and additionally using Workbase. Try closing any transactions you can, exit any Graql consoles, close Workbase and then asking Grakn to stop!