for clustering cheat sheet

7 downloads 240 Views 88KB Size Report
Create and edit a profile file. 3. Create a cluster ... Upload and execute a script on the cluster ... acluster conda cr
FOR CLUSTERING CHEAT SHEET

See full clustering documentation for Anaconda http://docs.continuum.io/anaconda-cluster

TIP: Get help for any command with acluster commandname --help

QUICK INSTALL FOR ANACONDA CLUSTERING 1. Install client for Anaconda Cloud 2. Login to your existing Anaconda Cloud account 3. Install Anaconda cluster on your local machine 4. Initialize Anaconda Cluster

conda install anaconda-client anaconda login conda install anaconda-cluster -c anaconda-cluster acluster

CREATE A CLUSTER 1. Edit the providers file 2. Create and edit a profile file 3. Create a cluster

~/.acluster/providers.yaml ~/.acluster/profiles.d/profile_name.yaml acluster create cluster_name -p profile_name

* View sample profiles in the ~/.acluster/profiles.d/ directory on your local machine, edit with settings for your cluster.

CLUSTER COMMANDS Run a command on the cluster Execute remote conda commands on the cluster Create a cluster Destroy a cluster Execute a Salt module on the cluster Download a file from the cluster Display the most recently executed commands Information about the cluster client installation Install plugin(s) on the cluster List clusters, profiles, or providers Open the UI for a plugin in a browser Default provisioning of a cluster Upload a file to the cluster Restart a plugin or service on the cluster SSH into the cluster nodes Get the status of a plugin or service on the cluster Stop a plugin or service on the cluster Upload and execute a script on the cluster Sync formulas with the cluster

acluster cmd acluster conda acluster create acluster destroy acluster function acluster get acluster history acluster info acluster install acluster list acluster open acluster provision acluster put acluster restart acluster ssh acluster status acluster stop acluster submit acluster sync

CLUSTER REMOTE CONDA COMMANDS List conda packages installed on the cluster Install conda package(s) on the cluster Update conda package(s) on the cluster Remove conda package(s) on the cluster Create a new conda environment on the cluster Push a local conda environment to the cluster Display information about the conda installation on the cluster Set the default conda environment on the cluster Get the default conda environment on the cluster

acluster conda list acluster conda install acluster conda update acluster conda remove acluster conda create acluster conda push acluster conda info acluster conda setenv acluster conda defaultenv

EXAMPLE REMOTE CONDA COMMANDS Install conda packages on the cluster Show conda environments on the cluster List conda packages installed on the cluster Push a local conda environment to the cluster Create a new conda environment on the cluster Set the default conda environment on the cluster

acluster conda install numpy scipy pandas numba acluster conda info -e acluster conda list acluster conda push environment.yml acluster conda create -n py34 python=3.4 pandas acluster conda setenv py34

EXAMPLE CLUSTER MANAGEMENT COMMANDS Create a new cluster List running clusters Install plugins on the cluster SSH into the head node of the cluster Upload a file to all of the cluster nodes Run a command on all of the cluster nodes Upload and execute a script on the cluster

acluster create cluster_name -p profile_name acluster list acluster install spark-yarn notebook acluster ssh acluster put data.hdf5 /home/ubuntu/data.hdf5 -a acluster cmd �sudo apt-get install ...� acluster submit spark_script.py

MORE RESOURCES Support Training Consulting

http://bit.ly/anacondasupport http://bit.ly/continuumtraining http://bit.ly/continuumconsulting

Join the #AnacondaCrew! Connect with other talented, like-minded data scientists and developers while contributing to the open source movement. https://continuum.io/community