After the installation of Python packages, we can load these packages for coding later. To load these packages, we use command import. WebFeatureService is the function we use in OWSLib.

Load the packages and additional functions:

from owslib.wfs import WebFeatureService
import geopandas
import folium
import io

Add another line of code

Click +Code button, and then a new code cell is added to the environment. You can then copy and paste the import command above and execute it.

Add a text cell

Click +Text button, and then a text cell is added to the environment. In a text cell, you may like to add some textual explanation of the code. You need to use the Markdown format for text editing.

Please find out more in this Markdown Guide. The left hand side is the textual input and the right hand side displays the final appearance in the notebook.

When you finish editing and move to the next cell, it will automatically jump out of the editing mode, and appear on the right-hand side.

4. Interact with the ADP

a. Setup connection parameters

To connect to the ADP you need to let Python know the address of the ADP and your credentials.

Please replace yourName and yourPassword in the code block below with your ADP username and password. If you don’t have ADP credentials, please generate your credentials via ADP Access Dashboard.

WFS_USERNAME = 'yourName'
WFS_PASSWORD= 'yourPassword'
WFS_URL='https://adp.aurin.org.au/geoserver/wfs'

Create a new adp_client, using the below code to connect to the ADP, which is itself a Web Feature Service (WFS).

adp_client = WebFeatureService(url=WFS_URL,username=WFS_USERNAME, password=WFS_PASSWORD, version='2.0.0')

b. List available datasets

We can view the WFS operations.

# (Optional) Check what operations are available
[operation.name for operation in adp_client.operations]

Output:

['GetCapabilities',
'DescribeFeatureType',
'GetFeature',
'GetPropertyValue',
'ListStoredQueries',
'DescribeStoredQueries',
'CreateStoredQuery',
'DropStoredQuery',
'LockFeature',
'GetFeatureWithLock',
'Transaction',
'ImplementsBasicWFS',
'ImplementsTransactionalWFS',
'ImplementsLockingWFS',
'KVPEncoding',
'XMLEncoding',
'SOAPEncoding',
'ImplementsInheritance',
'ImplementsRemoteResolve',
'ImplementsResultPaging',
'ImplementsStandardJoins',
'ImplementsSpatialJoins',
'ImplementsTemporalJoins',
'ImplementsFeatureVersioning',
'ManageStoredQueries',
'PagingIsTransactionSafe',
'QueryExpressions']

We can view information about the dataset name and title of the first 10 datasets:

contents = list(adp_client.contents)
contents[:10]

Output:

['datasource-NSW_Govt_DPE-UoM_AURIN_DB:nsw_srlup_additional_rural_2014',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:aus_2016_aust',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:gccsa_2011_aust',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:gccsa_2016_aust',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:mb_2016_aust',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:mb_2011_act',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:mb_2011_nsw',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:mb_2011_nt',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:mb_2011_ot',
'datasource-AU_Govt_ABS-UoM_AURIN_DB_GeoLevel:mb_2011_qld']

c. Download data

You can search the AURIN Data Catalogue to find datasets you would like to download.

For example, if you are interested in a dataset describing the locations of fire stations in Victoria, enter “fire station” and click search. Browse the results and select VIC DELWP – Vicmap Features of Interest – Country Fire Authority (CFA) Fire Stations (Points) and view its description, including its metadata table.

To download that dataset into Python, find and copy its ADP ID from the metadata table, in this case, it is datasource-VIC_Govt_DELWP-VIC_Govt_DELWP:datavic_VMFEAT_CFA_FIRE_STATION. Then create the following query, pasting the ADP ID into the type name variable. The GetFeature() operation returns a selection of features from the data source. Then we save it to the variable called response.

response = adp_client.getfeature(typename='datasource-VIC_Govt_DELWP-VIC_Govt_DELWP:datavic_VMFEAT_CFA_FIRE_STATION')

Next, save the variable response to a file named data_fire.gml. This file is in gml format. If you’d like to download the dataset, please store it in a safe and secure environment.

out = open('data_fire.gml', 'wb')
out.write(response.read())
out.close()

d.  View data

After downloading the information, we can use the function geopandas.read_file to load the data in a DataFrame.

Use the head() function to see fire stations on a map as individual point locations:

data_fire = geopandas.read_file('data_fire.gml')
data_fire.head()

Now you will see information about the fire stations in tabular format:

e.  Visualise data

Static map

You can now visualise the fire stations on a map as individual point locations by using the plot() command.

data_fire.plot()

Output:

Interactive map

Here we set up an interactive map to view the fire station dataset. The function folium.map creates an interactive map.

### ----- Define the basemap: Center: Australia ---- ###
Map_aurin = folium.Map(location=[-23.43046024417681, 133.6034805654919],zoom_start=4,tiles='cartodbpositron')
### ----- Select Name and Geometry ---- ###
map_data = data_fire[['NAME','geometry']]
### ----- Create a JSON with the information ------ ###
layer = map_data.to_json()
### --- Geojson -- ### 
folium.GeoJson(layer,name='geojson').add_to(Map_aurin)
### --- Show the map --- ###
Map_aurin

Output:

f. Download data in other formats

The ADP support other data formats, such as GeoJSON, CSV, etc. For a full list of different formats and their syntax for coding, please check here. We choose the GeoJson format for demonstration.

GeoJSON format, download data and visualisation. outputFormat='application/json' helps to specify GeoJSON format.

response = adp_client.getfeature(typename='datasource-VIC_Govt_DELWP-VIC_Govt_DELWP:datavic_VMFEAT_CFA_FIRE_STATION',outputFormat='application/json')
out = open('data_fire.geojson', 'wb')
out.write(response.read())
out.close()
data_fire = geopandas.read_file('data_fire.geojson')

g. Filter data by bounding box

The ADP supports spatial queries that permit filtering your data in a particular spatial area. For example, you can filter the data by bounding box (BBOX). By adding the BBOX, instead of downloading entire datasets, which can be very large and irrelevant to your project, you can download data according to your area of interest. Here we show an example to use the Melbourne CBD as the area of interest. The BBOX is a function from shapely.geometry.

The BBOX parameter allows you to search for features that are contained (or partially contained) inside a box of user-defined coordinates. The format of the BBOX parameter is bbox=a1,b1,a2,b2,[crs] where a1, b1, a2, and b2 represent the coordinate values. The shapely.geometry.box() function makes a rectangular polygon from the provided BBOX parameters.

We recommend using BBox finder to create your BBOX using a base map. Click the rectangle icon and draw a rectangle using your mouse to cover the Melbourne CBD area or any other areas you are interested in.

Now you can see the selected rectangle is covered in pink. You may check if it is the right area you’d like to collect data from. Copy the BBOX coordinates from the highlighted area, and replace the coordinates after the code min_x,min_y,max_x,max_y =.

You also need to replace yourName and yourPassword in the code block below with your ADP username and password. If you don’t have ADP credentials, please generate your credentials via the ADP Access Dashboard.

###### ------ Libraries ------- ####
from owslib.wfs import WebFeatureService
import geopandas as gpd
from shapely.geometry import box
import io
import folium
##### ----- Credentials ------ #####
WFS_USERNAME = 'yourName'
WFS_PASSWORD= 'yourPassword'
VERSION = '2.0.0'
WFS_URL='https://adp.aurin.org.au/geoserver/wfs'
adp_client = WebFeatureService(url=WFS_URL,
    username=WFS_USERNAME,
    password=WFS_PASSWORD,
    version=VERSION)

#### ------ Select the data set ----- #####
ADP_ID = 'datasource-OSM-UoM_AURIN_DB:osm_lines_2017'

### ------ Copy vector from http://bboxfinder.com/ ---- #####
min_x,min_y,max_x,max_y = 144.951425,-37.821684,144.976358,-37.806563

# Create the polygon using Shapely
box_shape = box(minx=min_x, miny=min_y, maxx=max_x, maxy=max_y)
Box_shape = gpd.GeoDataFrame({'box': 'Box','geometry': [box_shape]})
#### ------ Request data for Melbourne CBD ----- ####
response = adp_client.getfeature(typename = ADP_ID,bbox=(min_x, min_y, max_x, max_y))

#### ---- Read data from server ----- ####
features_data = gpd.read_file(io.BytesIO(response.read()))
#### ---- Storage data ----- ####
features_data.to_pickle('data_osm.gml')

### ----- Define the basemap: Center: Australia ---- ###
Map_aurin = folium.Map(location=[box_shape.centroid.coords[0][1],box_shape.centroid.coords[0][0]],zoom_start=15,tiles='cartodbpositron')
### ----- Select Name and Geometry ---- ###
### ----- Create a JSON with the information ------ ###
map_data = features_data[['gml_id','geometry']]
### ---- Features box ----- ###
layer = map_data.to_json()
### ---- Shape box ---- ###
box = Box_shape.to_json()
### --- Geojson -- ###
folium.GeoJson(layer,name='features').add_to(Map_aurin)
folium.GeoJson(box,name='box',style_function = lambda x: {'fillColor': 'yellow'}).add_to(Map_aurin)

### --- Show the map --- ###
Map_aurin

Output: