Acessing Amazon Web Services (AWS)¶
For our activities, we will split into 20 groups. Each group will have their own cloud computing instance with which they can build and run JEDI. We currently use Amazon Web Services (AWS) to provide our cloud computing instances. For those familiar with AWS, these compute instances through AWS’s Elastic Compute Cloud (EC2) service.
Though you can access the cloud instances directly through ssh if you wish, we have set up a web interface to each of the nodes by means of
Jupyter lab. We recommend that you use the web interface because this provides a number of attractive features, including the ability to navigate the directory tree, open new terminals, transfer files, and most importantly, to display graphics.
Important: The AWS EC2 instances (and their associated JupyterLab URLs) will only be active in the afternoons during the week of the Academy. We will create the instances on Monday so the links below will not work before then. Then, each night of the Academy (Monday-Thursday), we will shut the instances down overnight as a cost-saving measure. However, all data will be saved so you can pick up the next day precisely where you left off. Then, after our last activity on Thursday afternoon, we will permanently terminate all instances.
Note
If you ever wish to leave your node up longer (for example, one evening to work from your hotel), just make arrangments with a JEDI Master (Mark).
So, to participate in the activities, you will need three things:
- Your group number
- A URL to access your AWS instance through the JupyterLab web interface (see table)
- A password
A JEDI master will assign you a group number and give you the password. Write these down. They will be the same every day and you will need them for every activity. Once you know your group number, you can access your URL by selecting the appropriate link in the following table. You should bookmark this link because, again, it will not change - it will be yours for the entire Academy.
| Group | GitHub user name | ip address | JupyterLab URL |
|---|---|---|---|
| 1 | jedi-ac01 | 100.25.230.215 | http://100.25.230.215:8080 |
| 2 | jedi-ac02 | 18.204.252.6 | http://18.204.252.6:8080 |
| 3 | jedi-ac03 | 3.229.143.230 | http://3.229.143.230:8080 |
| 4 | jedi-ac04 | 3.232.126.225 | http://3.232.126.225:8080 |
| 5 | jedi-ac05 | 34.193.128.154 | http://34.193.128.154:8080 |
| 6 | jedi-ac06 | 34.205.14.12 | http://34.205.14.12:8080 |
| 7 | jedi-ac07 | 34.205.79.62 | http://34.205.79.62:8080 |
| 8 | jedi-ac08 | 34.207.25.98 | http://34.207.25.98:8080 |
| 9 | jedi-ac09 | 34.227.128.200 | http://34.227.128.200:8080 |
| 10 | jedi-ac10 | 34.230.185.162 | http://34.230.185.162:8080 |
| 11 | jedi-ac11 | 34.236.1.39 | http://34.236.1.39:8080 |
| 12 | jedi-ac12 | 34.237.225.237 | http://34.237.225.237:8080 |
| 13 | jedi-ac13 | 52.4.109.166 | http://52.4.109.166:8080 |
| 14 | jedi-ac14 | 52.44.144.17 | http://52.44.144.17:8080 |
| 15 | jedi-ac15 | 52.44.206.130 | http://52.44.206.130:8080 |
| 16 | jedi-ac16 | 52.5.111.195 | http://52.5.111.195:8080 |
| 17 | jedi-ac17 | 52.7.74.85 | http://52.7.74.85:8080 |
| 18 | jedi-ac18 | 52.73.184.193 | http://52.73.184.193:8080 |
| 19 | jedi-ac19 | 52.86.190.231 | http://52.86.190.231:8080 |
| 20 | jedi-ac20 | 54.209.197.101 | http://54.209.197.101:8080 |
Note
Write down your group number and your password. Bookmark your Jupyter URL. Making a mistake here will mean that you will be working in the work space of another group.
Now, to log into your cloud computing instance, merely select the appropriate URL from the Table above and enter the password at the prompt.
You should now see the default JupyterLab interface, which includes a directory tree displayed as an interactive (i.e. clickable) menu on the left and a large display area. At the top of the display area you should see several tabs. One is labeled Console 1. This is a Jupyter python console, capable of interpreting python commands. Another tab is labeled ubuntu with a local ip address. This is an ssh terminal, running bash. From here you have access to the linux command line. This is where we will be doing most of our work.
For more tips on how to work with the Jupyter interface, see Activity A on Monday.
If you are unable to link to the web interface, you can access the node directly through ssh, as mentioned above. To follow this method, you first need to acquire the academy-virginia.pem file from a JEDI master which contains an ssh key for authentication. Then you should use the -Y option to ssh to set up X forwarding as follows (remember that your username is ubuntu):
ssh -i academy-virginia.pem -Y ubuntu@<ip-address>
Then you can use the display application to display image files over the internet. Or, you can scp the files to your local machine (using the same pem file for authentication) and view them locally.
…
Contact Mark Miesch (miesch@ucar.edu) if you have any problems or questions.