SciDB installation (Zero-to-SciDB in Two Minutes)

Improve this doc

Folks, you have been asking for an easy way to install SciDB for a while now.

Well, here you go :) Now you can go from “zero to SciDB in under two minutes”!

If you face any issues with SciDB installation, file an issue here.

The SciDB installer script

What this script does:

  1. Deploys a vanilla install of SciDB 18.1 community edition on a Unix machine
  2. Starts SciDB with 4 instances

The following script has been tested on

  • Centos 7
  • Ubuntu 14.04
  • RHEL 6
wget https://downloads.paradigm4.com/community/18.1/install-scidb-ce.sh
chmod a+x install-scidb-ce.sh
sudo ./install-scidb-ce.sh

Then

# add /opt/scidb/18.1/bin to PATH 
cat > ~/.scidbrc <<EOF
export SCIDB_VER=18.1
export PATH=/opt/scidb/\$SCIDB_VER/bin:/opt/scidb/\$SCIDB_VER/share/scidb:\$PATH
EOF

cat >> ~/.bashrc  <<EOF
source ~/.scidbrc
EOF

# source the new changes (or open a new terminal)
source ~/.bashrc

# then run the following command
iquery -aq "list('instances')"
#{No} name,port,instance_id,online_since,instance_path
#{0} '127.0.0.1',1239,0,'2018-02-02 20:41:27','/home/ubuntu/scidb_data/0/0'
#{1} '127.0.0.1',1240,1,'2018-02-02 20:41:27','/home/ubuntu/scidb_data/0/1'
#{2} '127.0.0.1',1241,2,'2018-02-02 20:41:27','/home/ubuntu/scidb_data/0/2'
#{3} '127.0.0.1',1242,3,'2018-02-02 20:41:27','/home/ubuntu/scidb_data/0/3'

Please let us know if you find any issues while running this script.

Install Additional Libraries

We provide an easy one-stop package that installs and launches shim for R and Python connectivity, plus a few additional P4 plugins:

wget -O - https://paradigm4.github.io/extra-scidb-libs/install.sh | sudo sh

After this you can use iquery to load the libraries. SciDB rememembers loaded libraries until you re-initialize the database. This only needs to be done once after installation:

iquery -aq "load_library('accelerated_io_tools')"
iquery -aq "load_library('equi_join')"
iquery -aq "load_library('grouped_aggregate')"
iquery -aq "load_library('superfunpack')"
iquery -aq "load_library('stream')"

You can now connect from R or Python

For example:

pip install scidb-py
python
import scidbpy
db = scidbpy.connect()
db.list('instances')[:]

Custom gists

Below is a public gist that does all the above for RHEL 6