Templates

Our course project template can be found here, or on Anvil:

/anvil/projects/tdm/etc/project_template.ipynb

Students in TDM 101000, 20100, 30100, and 40100 can use and modify this as a template as needed, for all project submissions. This template is a starting point for all projects.

Most of the time, this template will be used with the f2022-s2023 or f2022-s2023-r kernel. By default, the f2022-s2023 kernel runs Python code and f2022-s2023-r kernel runs R code. To run other types of code, see below. Any format or template related questions should be asked in Piazza.

Running R code using the f2022-s2023 kernel

%%R

myDF <- read.csv("/anvil/projects/tdm/data/flights/subset/2005.csv")
head(myDF$Origin)

As you can see, any cell that begins with %%R will run the R code in that cell. If a cell does not begin with %%R, it will be assumed that the code is Python code, and run accordingly.

Running SQL queries using the f2022-s2023 kernel

  1. First, you need to establish a connection with the database. If this is a sqlite database, you can use the following command.

    %sql sqlite:///my_db.db
# or
%sql sqlite:////absolute/path/to/my_db.db
# like this
%sql sqlite:////anvil/projects/tdm/data/movies_and_tv/imdb.db

    Otherwise, if this is a mysql database, you can use the following command.

    %sql mariadb+pymysql://username:[email protected]_url.com/my_database

  2. Next, we can run SQL queries, in a new cell, as shown with the following example, in which we show the first 5 lines of the titles table.

    %%sql

SELECT * FROM titles LIMIT 5;

As you can see, any cell that begins with %%sql will run the SQL query in that cell. If a cell does not begin with %%sql, it will be assumed that the code is Python code, and run accordingly.

Running bash code using the f2022-s2023 kernel

To run bash code, in a new cell, run the following.

%%bash

ls -la

As you can see, any cell that begins with %%bash will run the bash code in that cell. If a cell does not begin with %%bash, it will be assumed that the code is Python code, and run accordingly.

Code cells that start with % or %% are sometimes referred to as magic cells. To see a list of available magics, run %lsmagic in a cell.

The commands listed in the "line" section are run with a single % and can be mixed with other code. For example, the following cell contains (in order) some Python code, uses a single line magic, followed by some more Python code.

import pandas as pd

%time myDF = pd.read_parquet("/anvil/projects/tdm/data/whin/weather.parquet")

myDF.head()

The commands listed in the "cell" section are run with a double %% and apply to the entire cell, rather than just a single line. For example, %%bash is an example of a cell magic.

You can read more about some of the available magics in the official documentation.

Including an image in your notebook

To include an image in your notebook, use the following Python code.

from IPython import display
display.Image("/anvil/projects/tdm/data/woodstock.png")

Here, /anvil/projects/tdm/data/woodstock.png is the path to the image you would like to include.

If you choose to include an image using a Markdown cell, and the ![](…​) syntax, please note that while the notebook will render properly in our ondemand.anvil.rcac.purdue.edu environment, it will not load properly in any other environment where that image is not available. For this reason it is critical to include images using the method shown here.