Advanced Platform-layer Commands

Search…
This page documents a list of advanced Linux commands that simplify platform operations that are performed often during debugging, especially on high availability (HA) clusters. Only the TigerGraph platform owner - the Linux user created during installation has access to the commands on this page.  
Users are advised to use these commands only at the guidance and recommendation of TigerGraph support.  
Connection between nodes
Connect to another node via SSH
1
$ gssh <node_name>
Copied!
This command allows you to connect to another node in your cluster via SSH. 
Example:
1
# Originally on m1
2
[[email protected] ~]$ gssh m3
3
Last login: Fri Apr 23 18:24:27 2021
4
# Now connected to m3 via ssh
5
[[[email protected] ~]$ 
Copied!
Loading data
Offline loading
1
$ gautoloading.sh (-g <graph_name> -j <loading_job_name> | path_to_config_file)
Copied!
With huge data volumes, data loading can be time-consuming. If you find yourself often loading huge volumes of data into an empty graph, and your data volume is so large that your loading jobs are taking hours to complete, you might consider using offline loading to speed up data loading. 
In order to use offline loading, all the filename variables in the loading job must take an initial path value. After creating the loading job and ensuring that all the data files are referenced correctly in the loading job, use the options -g and -j to specify the graph and loading job to run. During offline loading, your database is focused on loading data and will not be able to handle requests and queries.
Offline loading deletes all existing graph data before it starts. Back up your data before using offline loading. 
Options
-g <graph_name>: Name of the graph whose loading job to run
-j <loading_job_name>: Name of the loading job to run 
Example
The following command runs the loading job load_ldbc_snb on the graph ldbc_snb:
1
$ gautoloading.sh -g ldbc_snb -j load_ldbc_snb
Copied!
You can also provide the graph name and the loading job name with a config file written in Bash:
~/example_config
1
# the name of the graph for the initial loading
2
GRAPH_NAME="tpc_graph"
3
​
4
# the name of loading jobs separated by white space
5
LOADING_JOBS=("load_test")
Copied!
Once you have the config file, you can run gautoloading.sh with the config file instead of the -g and -j options:
1
$ gautoloading.sh ~/example_config
Copied!
File operations
Copy files on the specified nodes
1
$ gscp <all|component_name|node_list> <source_path> <target_dir>
Copied!
This command allows you to copy files from the current node to target folders on multiple nodes at the same time. The file or directory on the current node specified by the source path will be copied into the target folder on every node. If the target folder does not exist at the path given, the target folder will be created automatically. You can also specify multiple source files or directories, in which case, the source paths need to be absolute paths, put in quotes, and separated by space. 
You can specify the nodes where you want the copy operation to occur in the following ways:
gscp all <source_path> <target_dir> will execute the command on all nodes
gscp <component_name> <source_path> <target_dir> will execute the command on nodes where the component you specified is running
gscp <node_list> <source_path> <target_dir> will execute the command on the nodes you specify in the node list
Example
Single source
Multiple sources
1
$ gscp all /tmp/gscp_test /tmp/gscp_test_folder
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
​
5
### Connecting to remote server 172.31.88.179 ...
6
​
7
### Connecting to remote server 172.31.91.208 ...
8
​
9
// A copy of gscp_test is on every node
10
$ grun all 'ls /tmp/gscp_text_folder'
11
​
12
### Connecting to local  server 172.31.91.54 ...
13
gscp_test
14
​
15
### Connecting to remote server 172.31.88.179 ...
16
gscp_test
17
​
18
### Connecting to remote server 172.31.91.208 ...
19
gscp_test
20
​
21
// Copy file to the target folder only on nodes where GPE is running
22
$ gscp gpe /tmp/gscp_test1 /tmp/gscp_test_folder
23
​
24
// Copy file to a specified list of nodes
25
$ gscp m1,m2 /tmp/gscp_test3 /tmp/gscp_test_folder
Copied!
1
$ gscp all "/tmp/gscp_test1 /tmp/gscp_test2" /tmp/gscp_test_folder
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
​
5
### Connecting to remote server 172.31.88.179 ...
6
​
7
### Connecting to remote server 172.31.91.208 ...
8
​
9
// Copies of both files are on every node
10
$ grun all 'ls /tmp/gscp_text_folder'
11
​
12
### Connecting to local  server 172.31.91.54 ...
13
gscp_test1 gscp_test2
14
​
15
### Connecting to remote server 172.31.88.179 ...
16
gscp_test1 gscp_test2
17
​
18
### Connecting to remote server 172.31.91.208 ...
19
gscp_test1 gscp_test2
Copied!
Download file from another node
1
$ gfetch <all|component_name|node_list> <source_path> <target_dir>
Copied!
This command downloads a file or directory from every specified node to the target directory on the current node. 
Example
1
$ gfetch all ~/test.txt ~/test_folder
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
​
5
### Connecting to remote server 172.31.88.179 ...
6
​
7
### Connecting to remote server 172.31.91.208 ...
8
scp: /home/tigergraph/test.txt: No such file or directory
9
​
10
// Nothing is downloaded if the file does not exist on a node
11
$ ls ~/test_folder
12
test.txt_m1  test.txt_m2  
Copied!
Run commands on multiple nodes
Run commands sequentially
1
$ grun <all|component_name|node_list> '<command>'
Copied!
This command allows you to run commands on a specified list of nodes in your cluster one by one, and the output from every node will be visible to the terminal. grun will wait for the command to finish running on one node before executing the command on the next node.
You can specify which nodes to run commands on in the following ways:
grun all '<command>' will execute the command on all nodes
grun <component_name> '<command>' will execute the command on nodes where the component you specified is running
grun <node_list> '<command>' will execute the commands on the nodes you specify in the node list
Example
All nodes
By component name
By node list
1
grun all 'echo "hello world"'
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
hello world
5
​
6
### Connecting to remote server 172.31.88.179 ...
7
hello world
8
​
9
### Connecting to remote server 172.31.91.208 ...
10
hello world
Copied!
1
# Run 'echo "hello world"' on every node where GPE is running
2
grun gpe 'echo "hello world"'
3
​
4
### Connecting to local  server 172.31.91.54 ...
5
hello world
6
​
7
### Connecting to remote server 172.31.88.179 ...
8
hello world
9
​
10
### Connecting to remote server 172.31.91.208 ...
11
hello world
Copied!
1
grun m1,m3 'echo "hello world"'
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
hello world
5
​
6
### Connecting to remote server 172.31.91.208 ...
7
hello world
Copied!
Run commands in parallel
1
$ grun_p <all|component_name|node_list> '<command>'
Copied!
This command allows you to run commands on a specified list of nodes in your cluster in parallel, and the output will be visible to the terminal where the grun_p command was run. You can specify the nodes to run commands on in the following ways:
grun_p all '<command>' will execute the command on all nodes
grun_p <component_name> '<command>' will execute the command on nodes where the component you specified is running
grun_p <node_list> '<command>' will execute the commands on the nodes you specify in the node list. The list of nodes should be separated by a comma, e.g.: m1,m2
All nodes 
By component
By node list
1
$ grun_p all 'echo "hello world"'
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
​
5
### Connecting to remote server 172.31.88.179 ...
6
​
7
### Connecting to remote server 172.31.91.208 ...
8
​
9
### ---- (m1)_172.31.91.54 ---0--
10
hello world
11
​
12
### ---- (m2)_172.31.88.179 ---0--
13
hello world
14
​
15
### ---- (m3)_172.31.91.208 ---0--
16
hello world
Copied!
1
$ grun_p gpe 'echo "hello world"'
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
​
5
### Connecting to remote server 172.31.88.179 ...
6
​
7
### Connecting to remote server 172.31.91.208 ...
8
​
9
### ---- (m1)_172.31.91.54 ---0--
10
hello world
11
​
12
### ---- (m2)_172.31.88.179 ---0--
13
hello world
14
​
15
### ---- (m3)_172.31.91.208 ---0--
16
hello world
Copied!
1
$ grun_p m1,m3 'echo "hello world"'
2
​
3
### Connecting to local  server 172.31.91.54 ...
4
​
5
### Connecting to remote server 172.31.91.208 ...
6
​
7
### ---- (m1)_172.31.91.54 ---0--
8
hello world
9
​
10
### ---- (m3)_172.31.91.208 ---0--
11
hello world
Copied!
Display cluster information
Show current node IP
1
$ gmyip
Copied!
This command returns the private IP address of your current node. 
Example:
1
$ gmyip
2
172.31.93.187 # Current node IP address 
Copied!
Show current node number and servers
1
$ ghostname
Copied!
This command returns your current node number as well as all servers that are running on the current node. 
Example
In this example, m1 is the current node number, and ADMIN#1, admin#1 etc. are all servers that are running on m1.
1
$ ghostname
2
​
3
m1 ADMIN#1 admin#1 CTRL#1 ctrl#1 DICT#1 dict#1 ETCD#1 etcd#1 EXE_1 exe_1 GPE_1#1 gpe_1#1 GSE_1#1 gse_1#1 GSQL#1 gsql#1 GUI#1 gui#1 IFM#1 ifm#1 KAFKA#1 kafka#1 KAFKACONN#1 kafkaconn#1 KAFKASTRM-LL_1 kafkastrm-ll_1 NGINX#1 nginx#1 RESTPP#1 restpp#1 TS3_1 ts3_1 TS3SERV#1 ts3serv#1 ZK#1 zk#1
Copied!
Show deployment information
1
$ gssh
Copied!
The gssh command, when used without arguments, outputs information about server deployments in your cluster. The output contains the names and IP addresses of every node. For each node, the output shows the full list of servers that are running on the node. For each server, the output shows the full list of the nodes that the server is running on. 
Example
1
$ gssh
2
​
3
Usage: gssh m1|gpe_1#1|gse1_1#1|...
4
Usage: ----------------Available hosts--------------
5
Host *
6
    IdentityFile /home/tigergraph/.ssh/tigergraph_rsa
7
    Port 22
8
​
9
Host m1 ADMIN#1 admin#1 CTRL#1 ctrl#1 DICT#1 dict#1 ETCD#1 etcd#1 EXE_1 exe_1 GPE_1#1 gpe_1#1 GSE_1#1 gse_1#1 GSQL#1 gsql#1 GUI#1 gui#1 IFM#1 ifm#1 KAFKA#1 kafka#1 KAFKACONN#1 kafkaconn#1 KAFKASTRM-LL_1 kafkastrm-ll_1 NGINX#1 nginx#1 RESTPP#1 restpp#1 TS3_1 ts3_1 TS3SERV#1 ts3serv#1 ZK#1 zk#1
10
    HostName 172.31.91.54
11
​
12
Host m2 ADMIN#2 admin#2 CTRL#2 ctrl#2 DICT#2 dict#2 ETCD#2 etcd#2 EXE_2 exe_2 GPE_2#1 gpe_2#1 GSE_2#1 gse_2#1 GSQL#2 gsql#2 GUI#2 gui#2 IFM#2 ifm#2 KAFKA#2 kafka#2 KAFKACONN#2 kafkaconn#2 KAFKASTRM-LL_2 kafkastrm-ll_2 NGINX#2 nginx#2 RESTPP#2 restpp#2 TS3_2 ts3_2 ZK#2 zk#2
13
    HostName 172.31.88.179
14
​
15
Host m3 ADMIN#3 admin#3 CTRL#3 ctrl#3 DICT#3 dict#3 ETCD#3 etcd#3 EXE_3 exe_3 GPE_3#1 gpe_3#1 GSE_3#1 gse_3#1 GSQL#3 gsql#3 GUI#3 gui#3 IFM#3 ifm#3 KAFKA#3 kafka#3 KAFKACONN#3 kafkaconn#3 KAFKASTRM-LL_3 kafkastrm-ll_3 NGINX#3 nginx#3 RESTPP#3 restpp#3 TS3_3 ts3_3 ZK#3 zk#3
16
    HostName 172.31.91.208
17
​
18
#cluster.nodes: m1:172.31.91.54,m2:172.31.88.179,m3:172.31.91.208
19
#admin.servers: m1,m2,m3
20
#ctrl.servers: m1,m2,m3
21
#dict.servers: m1,m2,m3
22
#etcd.servers: m1,m2,m3
23
#exe.servers: m1,m2,m3
24
#gpe.servers: m1,m2,m3
25
#gse.servers: m1,m2,m3
26
#gsql.servers: m1,m2,m3
27
#gui.servers: m1,m2,m3
28
#ifm.servers: m1,m2,m3
29
#kafka.servers: m1,m2,m3
30
#kafkaconn.servers: m1,m2,m3
31
#kafkastrm-ll.servers: m1,m2,m3
32
#nginx.servers: m1,m2,m3
33
#restpp.servers: m1,m2,m3
34
#ts3.servers: m1,m2,m3
35
#ts3serv.servers: m1
36
#zk.servers: m1,m2,m3
37
#log.root: /home/tigergraph/tigergraph/log
38
#app.root: /home/tigergraph/tigergraph/app/3.1.1
39
#data.root: /home/tigergraph/tigergraph/data
Copied!
Show graph status
1
$ gstatusgraph
Copied!
This command returns the size of your data, the number of existing vertices and edges, as well as the number of deleted and skipped vertices on every node in your cluster. If you are running TigerGraph on a single node, it will return the same information that one node. 
Single-node example
1
$ gstatusgraph
2
=== graph ===
3
[GRAPH  ] Graph was loaded (/home/tigergraph/tigergraph/data/gstore/0/part/):
4
[m1     ] Partition size: 437MiB, IDS size: 103MiB, Vertex count: 3181724, Edge count: 34512076, NumOfDeletedVertices: 0 NumOfSkippedVertices: 0
5
[WARN   ] Above vertex and edge counts are for internal use which show approximate topology size of the local graph partition. Use DML to get the correct graph topology information
Copied!
Cluster example
1
$ gstatusgraph
2
=== graph ===
3
[GRAPH  ] Graph was loaded (/home/tigergraph/tigergraph/data/gstore/0/part/):
4
[m1     ] Partition size: 246MiB, IDS size: 31MiB, Vertex count: 1152822, Edge count: 10908545, NumOfDeletedVertices: 0 NumOfSkippedVertices: 0
5
[m2     ] Partition size: 248MiB, IDS size: 31MiB, Vertex count: 1157325, Edge count: 11004342, NumOfDeletedVertices: 0 NumOfSkippedVertices: 0
6
[m3     ] Partition size: 225MiB, IDS size: 29MiB, Vertex count: 1049883, Edge count: 10009479, NumOfDeletedVertices: 0 NumOfSkippedVertices: 0
7
[WARN   ] Above vertex and edge counts are for internal use which show approximate topology size of the local graph partition. Use DML to get the correct graph topology information
Copied!