Introduction

OS MasterMap® Water Network Layer offers one of the world’s most detailed, heighted water networks, showing the flow and precise course of every river, stream, lake and canal in Great Britain.

The tool included in the UK Data Loader will load the data from the source files, in zipped GML format, into a geodatabase.

Using the tool

Locate the OS MasterMap Water Network Layer Toolset and run the script called “Load OSMM Water Network Layer Data”.

Enter the location of your source data. Select the folder which contains the gz files from the Ordnance Survey. The tool will also search sub-folders for files to process. The tool will process the first order number it detects in that location. The data in a single order is not required to be contiguous. If you have multiple orders that you wish to combine, then you should process them separately and use the out of the box tools to append one dataset with the other.

Select the Existing Destination Workspace where the data is to be loaded. You can select either a file geodatabase or an enterprise geodatabase connection.

Select where to store the log file that will be created.

There is the option to designate a prefix for the feature class names.

What does the tool do?

How it loads the data

The tool gathers a list of the files to process from the folder. It will then create a table in the destination which lists the files and their current processed status.

Each file is then sent to the Spatial ETL tool which will extract the feature into the relevant feature classes in your destination.

Once complete the file will be marked as processed and the next passed to the tool.

After all files are processed the tool will add an index to each feature class based on the TOID field and remove any duplicates.

Handling errors

If one of the files fails it will be marked as such, the load rolled back to the end of the previous file and the next file passed into the tool. At the end of the load all failed files will be retried. If the file subsequently fails to load again the log file should be checked for further details on why the load failed and reported to technical support for assistance.

If for any reason the process is interrupted during a load, if the tool is run again with the same parameters it will pick up from the last completed file and proceed to load all of the remaining files until complete.

How long will it take to process the data?

The table below gives indicative times for how long it will take to process different sizes of data.

Area Total number of features Hardware Processing time
GB 8,192,026 Intel i7

4 Cores

16GB RAM

 

19 Hours