FOR375
INTRODUCTION TO GEOGRAPHIC
INFORMATION SYSTEMS (GIS) II:
GEOPROCESSING, GEODATABASES AND
ARCGIS USAGE
SPRING 2016
Lecture 6 – Intro to GIS II: Geoprocessing, Geodatabases and ArcGIS usage
OVERVIEW
• ArcGIS – reiteration of software overview
•
ArcMap, ArcCatalog, ArcToolbox
• ArcToolBox and geoprocessing: using algorithms to process
geographic data
• Relational databases: Storing attribute (and possibly
geometric) data in an organized, relational model structure.
• Geodatabase format: storing geometric and attribute data
together
•
Model development: chaining together processes
ARCGIS
•
ArcGIS is developed by the Environmental Systems Research
Institute (ESRI) in California
•
ESRI is the world leader in the $1.1 billion GIS software market
•
ArcGIS was traditionally referred to as Arc/Info
•
Most popular GIS software in the US GIS market
•
Available for many computing platforms such as PCs and
servers and under an number of operating systems such as
Widows and UNIX/Linux.
ARCGIS DESKTOP MAKEUP
ArcGIS Desktop 10.3
ArcGIS Desktop consists of three main software packages that work together and
are accessible from within each other:
§ ArcMap – Map creation and analysis
§ ArcCatalog – Data organization, metadata
§ ArcToolbox – Geoprocessing
§ Extensions - additional packages that are installed to give additional functionality
(spatial statistics, 3D analyst)
ARCCATALOG
ArcCatalog helps you organize and manage all of your
GIS information (maps, globes, datasets, models,
metadata, services, and so on). It includes tools to:
§ Browse and find geographic information.
§ Record, view, and manage metadata.
§ Define geodatabase schemas and designs.
§ Administer an ArcGIS Server.
§ Search for and discover GIS data on local networks and the
Web.
GIS users use ArcCatalog to organize, find, and use GIS data as well as to
document their data holdings using standards-based metadata.
ARCMAP
•
ArcMap is the central application in ArcGIS Desktop. It is the GIS
application used for all map-based tasks, including cartography,
map analysis, and editing. In this application, you work with
maps.
•
Maps have a page layout containing a geographic window, or a
data frame, with a series of layers, legends, scalebars, North
arrows, and other elements.
•
ArcMap offers different ways to view a map's geographic data
and layout views in which you can perform a broad range of
advanced GIS tasks.
CAD
Conversion
Projections
GDB
ARCTOOLBOX:
WHAT IS
GEOPROCESSING?
Database
The use of methods and
processes to examine
geospatial information
Spatial analysis
Data management
WHAT IS GEOPROCESSING USED FOR?
§ Data processing/ data automation: Creation, Preparation, Conversion,
Management
§ Data analysis/spatial modeling: Suitability, Sensitivity, Capacity, Risk
§ Habitat modeling
§ Fire analysis
§ Watershed analysis
§ Forest Inventory Mapping
ACCESSING GEOPROCESSING TOOLS
§ Geoprocessing is carried out
using tools stored in ArcToolbox
§ A dockable window available in
ArcMap, ArcCatalog
Tools run processes
Opens ArcToolbox
ARCTOOLBOX USAGE
•
ArcToolbox provides access to geoprocessing
•
ArcToolbox is a dockable window in ArcCatalog
or ArcMap
•
Comprises a set of Tools
•
Tools support all data types (shapefiles, gdb,
raster)
•
Multi- step workflow available via Modelbuilder
and/or scripting
•
Command line interface also available for
traditionalists and/or power users
INSIDE ARCTOOLBOX
Toolbox
Toolset
1. Toolbox: Container
for toolsets and tools
§
Note: cannot have a
toolbox within a toolbox
Tools
2. Toolset: Logical container of tools and other
toolsets
3. Tool: Single geoprocessing
operation (includes dialogs, models,
and scripts)
TOOLS WORK WITH MANY DATA TYPES
Often there are different tools for different data types:
§ For shapefiles and geodatabase features classes
§ Another for coverages
§ Another for raster datasets
And they have the same name!
§ For example, there is a separate Clip tool for each of these input data types
§ Similarly, there is a separate Define tool for each of these input data types
TOOLS WITH THE SAME NAME
Some tools have the same
name
Clips a coverage
§ Must distinguish between
these tools in scripts
§ Be sure to get the correct
tool for the data type you
are processing
Clips a feature c lass
Clips a raster
SYSTEM (ESRI PROVIDED) TOOLBOXES
All tools are organized into toolboxes
System toolboxes
are provided by ESRI. Number
depends on
§ License level
§ Extensions licensed
and you can create your own toolboxes
(and tools)
2
Command line
THE
GEOPROCESSING
FRAMEWORK:
FOUR WAYS TO
RUN TOOLS
1
3
Models
Dialog
4
Scripts
4
ArcObjects
15
SUPPORTED DATA TYPES
Coverage
The tools work with many data types
Geodatabase
Tables
Shapefile
Layer file
CAD
Behavior
Raster
Geoprocessing
Arc/Info (coverage model)
History of ESRI GIS data file formats
Versions 1-­7 from 1980 – 1999
Arc Macro Language (AML)
ArcGIS (geodatabase model)
Version 8.0, …, 10 from 2000 –
Python scripting ArcView (shapefile model)
Versions 1-­3 from 1994 – 1999
Avenue scripting language
USING GEODATABASES
A spatial and attribute data
container
§ Relational database management system (RDBMS)
§ Maintains data integrity
§ Apply Rules and Behavior
§ .gdb extension
Native data format for ArcGIS
An ArcGIS geodatabase is a collection of geographic datasets of various types held in a common file system folder, a Microsoft Access database, or a multiuser relational database ( such as Oracle, Microsoft SQL Server, PostgreSQL, Informix, or IBM DB2). Relational Database -­ A method of structuring data as collections of tables that are logically associated to each other by shared attributes. Any data element can be found in a relation by knowing the name of the table, the attribute (column) name, and the value of the primary key. MORE ON GEODATABASES
• A geodatabase holds datasets, tying
together the spatial features with
attributes.
• The geodatabase can also
contain topology information, and can
model behavior of features, such as
road intersections, with rules on how
features relate to one another.
MORE ON GEODATABASES (CON’D)
•
Geodatabases can contain feature classes which
are a set of features, represented with points,
lines, or polygons. With shapefiles, each file can
only handle one type of feature. A geodatabase
can store multiple feature classes or type of
features within one geodatabase file.
•
Geodatabases in ArcGIS can be stored in three
different ways - as a file geodatabase, a personal
geodatabase, or an Enterprise geodatabase.
FIRST GENERATION STORAGE/LINKING: BEFORE
GEODATABASES
•Tabular/Spatial data is linked outside the database
•Links occur using unique IDs….Parcel Numbers
•Storage is still in separate locations
AS400
Database
Access Database
Tabular Data
Spatial Data
SECOND GENERATION STORAGE/LINKING
GEODATABASES
Tabular/Spatial data is
stored/linked in a single
location!!
Tabular Data
Spatial Data
GEODATABASE
FEATURES
Contains tables, feature classes,
feature datasets, topology rules, etc.
Feature Dataset
Topology
Feature Classes
Tables
Geodatabase
Feature data set
Geometric network
Feature class
Relationship class
Table
GEODATABASE
ELEMENTS
Annotation class
BENEFITS OF A GEODATABASE
• Spatial & attribute data integrity
• Intelligent Behavior
• Centralized Data Storage
• Increased Performance
• Advanced Analysis Capabilities
• Multi-user editing (Enterprise format)
3 TYPES OF GEODATABASES
• Personal Geodatabase
•
•
Stand alone PC, MS Access database
Supports individual and small groups on moderate size datasets up to 2 GB
• File Geodatabase
•
•
All files stored in a filesystem
Can have geodb size of up to 1 TB
• Enterprise Geodatabase
•
•
•
•
Exists on underlying RDBMS through Spatial Database Engine (SDE) e.g. SQL
Server
Usually runs on a dedicated server
Supports many users and massive datasets
Supports raster datasets
ENTERPRISE GEODATABASES
GIS
SDE
View/Analyze
Interpreter
Personal
§ Access
Multi-user
§ SDE/Direct DB Connection
SQL
Data
Storage
ENTERPRISE GEODATABASES
GIS
View/Analyze
SQL
Direct DB
Connection
Personal
§ Access
Multi-user
§ Direct DB Connection
Data
Storage
THE PERSONAL GEODATABASE
Stores spatial and tabular data in an
Access database format
Sets the stage for future geodatabase
migration
FILE GEODATABASE
• Size limit is 1 TB (awesome)
• Can be stored in a file system
• Is portable
UNDER THE HOOD OF ARCGIS
• ArcGIS is written in C++ but
is accessible via Python,
and allows extension of
geoprocessing tools using
python libraries.
• Python can be used on
Mac/windows/linux, and is
very powerful for
manipulating data
Python Scripting for ArcGIS
Paul A. Zandbergen
Linked on
http://webpages.uidaho.edu/erichs/for375.html
PYTHON AND ARCGIS
Applications of Python in ArcGIS:
1) Automate workflows
2) Batch process data
3) Manipulate data tables, geometry, and map docs
4) Use functions accessible only by scripts
ADVANTAGES OF PYTHON
Advantages of Python:
1) Open source
2) Cross‐platform
3) Object‐oriented
• A data structure that combines data with a set of
methods for accessing and managing those data
WHAT YOU SHOULD KNOW
• What is geoprocessing? Why is it useful?
• What are the main components of ArcGIS Desktop?
• What is a geodatabase?
• Describe the components of a geodatabase. Features, feature
classes, elements
• What are the two main types of geodatabases within the ArcGIS
environment? (File/Personal, and Enterprise)