Applied Informatics in Natural Resources and Environment Study Notes"` quotes. Use `str()` to convert numbers to strings for concatenation. * **Mathematics:** * `7 / 3` results in `2` (Integer division). * `7 / 3.0` results in `2.33333333333` (Float division). * Modulo operator `%` returns the remainder (e.g., `17 % 4` is `1`). * **Variables:** Dynamic assignment (type is determined at assignment, e.g., `x = 17` is int). * **Naming:** Letters, digits, underscores; cannot start with a digit. Use underscores to separate words for readability (e.g., `temp_count`). ## Control Flow and Loops * **Indentation:** Python uses $$4$$ spaces to define blocks (no curly braces `{}`). * **For Loops:** Iterates over sequences (lists, strings). * `range(start, stop, step)` function creates lists (e.g., `range(5)` is $$0, 1, 2, 3, 4$$). * **Else in For:** Runs if the loop completes without a `break`. * **While Loops:** Repeats as long as a condition is true. * **Break/Continue:** `break` exits the loop; `continue` skips to the next iteration. ## arcpy Tools for Natural Resources * **FeatureToPoint:** `arcpy.FeatureToPoint_management(in_features, out_feature_class)` * **FeatureToPolygon:** `arcpy.FeatureToPolygon_management(in_features, out_feature_class)` * **Buffer Tool:** `arcpy.Buffer_analysis(in_features, out_feature_class, buffer_distance_or_field)` * **Intersect Tool:** `arcpy.Intersect_analysis(in_features, out_feature_class, {join_attributes}, {cluster_tolerance}, {output_type})` * **Merge Tool:** `arcpy.Merge_management(inputs, output)` * **Fuzzy Overlay:** `outFzyOverlay = FuzzyOverlay(["image1", "image2"], "AND")`

General Introduction to Geoinformatics and Modeling

Overview of Geoinformatics Technology

Geographic Information Systems (GIS)
  • Evolution of Definitions: GIS definitions have shifted from specific computer systems for single applications to a generalized set of hardware and software tools used to facilitate the use of geographic information for analysis, data modeling, and problem-solving.
  • Core Elements of GIS: The three most vital factors in a GIS are input data, a high-tech computer system, and spatial data analysis capabilities.
  • Functional Perspectives (Tran Băng Tâm, 2006):     * Functional Definition: A system consisting of 4 subsystems: data input, data management, data analysis, and data output.     * Algorithmic Definition: A collection of algorithms using algebraic and geometric calculation methods (simple to complex) and measurement operations for data processing.     * Data Structure Definition: A system comprising Vector and Raster data structures.     * Technological Definition: Information technology for storing, analyzing, and presenting spatial and non-spatial information. It is a complete set of methods and means for using and storing geographic objects.     * Decision Support System Definition: Based on its functions for inputting and storing data in highly linked synchronous databases and its powerful analysis tools, GIS is a decision support system, particularly in the management and planning of resources and the environment.
  • Historical Development:     * Spatial Analysis Origins: Roots date back to 18321832 when Charles Picquet mapped a cholera outbreak in 4848 districts of Paris.     * 1960s Revolution: Significant development began with the advent of computers and concepts of quantitative geography (ESRI, 20202020).     * Scholarly Formalization: The US National Center for Geographic Information and Analysis formalized research in spatial analysis and visualization.     * Pioneering Systems: Roger Tomlinson initiated and planned the Canada Geographic Information System in 19631963, the world's first computerized GIS, to manage national land use. Tomlinson coined the term "Geographic Information System" in his 19681968 publication, "A Geographical Information System for Regional Planning."
  • Five Basic Components of GIS:     1. Hardware: Includes computers, network configurations, workstations, and peripherals for data input/output/storage (CPU, printers, plotters, DVD/CD drives, scanners).     2. Software: Provides tools for data input, manipulation, DBMS, query support, analysis, visualization, and graphical interfaces. Distinct from CAD due to its ability to store and analyze attribute data linked to geographic objects. The first commercial GIS was ARC/INFO by ESRI in 19811981. Current common software: ArcGIS, MapInfo, QGIS, GRASS GIS.     3. Data: The most important component. Includes Spatial Data (points, lines, polygons) and Non-Spatial/Attribute Data.         * Vector Structure: Objects stored via coordinate systems.         * Raster Structure: Data presented as a grid of uniform squares called Pixels (typical for satellite imagery and scanned maps).     4. People: Includes designers, builders, operators, maintainers, data providers, and users. Details: GIS providers, data providers, application developers, system analysts, system administrators, and end-users (who perform data construction, input, processing, querying, and sharing).     5. Methods: Techniques and operations used to input, manage, analyze, and display spatial data, including digitization, database construction, spatial analysis, map building, and metadata creation.
Remote Sensing (RS)
  • Definition: The science and art of obtaining information about an object, area, or phenomenon through the analysis of data acquired by a device that is not in contact with the subject. Simple modern understanding: acquisition and analysis of satellite, aerial, or Unmanned Aerial Vehicle (UAV) data.
  • Basic Principles: Uses electromagnetic energy reflected or radiated from objects. Measuring and analyzing spectral reflectance allows for qualitative and quantitative identification for monitoring resources.
  • Sensing Equipment:     * Sensors: Cameras or scanners.     * Platforms: Satellites, space shuttles, aircraft, balloons, and UAVs.
  • Seven Components of RS Acquisition and Processing:     1. Energy Source: Requires illumination or radiation of electromagnetic energy toward Earth objects (Passive systems use the sun; Active systems use their own power).     2. Atmospheric Transmission: Energy travels through the atmosphere, which affects spectral distribution depending on wavelength.     3. Energy Interaction with Objects: Reflection or radiation occurs upon contact with Earth's surface objects.     4. Detection by Sensor: Sensors on platforms record the reflected/radiated energy.     5. Transmission, Reception, and Processing: Data is transmitted to ground stations and processed into images.     6. Image Interpretation: Extracted via human eye or digital methods.     7. Application: Mapping, natural resource management, wildlife habitat protection, land use/cover change monitoring, urbanization, and crop damage assessment.
  • Classification of Remote Sensing:     * By Signal Source:         * Active RS: Uses man-made energy (e.g., RADAR - Radio Detection And Ranging; LiDAR - Light Detection And Ranging).         * Passive RS: Uses natural solar radiation reflected by Earth's surfaces.     * By Orbit Characteristics:         * Geostationary Satellites: Operate at high altitudes (approx. 36,000 km36,000\,km), stationary relative to Earth's rotation over the equator. Used mainly for meteorology and communications (e.g., GOES, METEOSAT, GMS, INSAT).         * Polar (or Near-Polar) Orbit Satellites: Planes are perpendicular to the equator. Designed to capture images of a region at the same local time with fixed "Repeat Cycles" (e.g., IKONOS: 1414 days; LANDSAT: 1616 days; MOS: 1717 days; SPOT: 2626 days).     * By Spectral Range:         * Visible and Infrared RS (0.5 μm0.5\,\mu m peak solar radiation).         * Thermal Infrared RS (10 μm10\,\mu m peak radiation from objects at normal temperatures).         * Microwave RS (wavelengths from 1 cm1\,cm to several tens of centimeters). Active microwave includes Radar.
  • Image Interpretation Methods:     * Visual Interpretation: Uses the human eye and aids (computer, magnifying glass, stereoscope) based on 88 keys: Size, Shape, Shadow, Tone/Blackness, Color, Texture, Distribution/Pattern, and Mutual Relationship/Context.     * Digital Interpretation: Fundamental in modern RS. Steps: Data input, restoration/correction, transformation, classification, and output.     * Spectral Recognition: Uses spectral signatures (combination of digital values across spectral channels) for each pixel.     * Spatial Recognition: Classifies pixels based on spatial relationships with neighbors (texture, proximity, context).     * Temporal Recognition: Uses time-series data to identify features (e.g., distinguishing a newly sown field from wasteland by observing its greening over time).
  • Multi-spectral Classification Methods:     * Supervised Classification: Human identifies representative "training samples" (Interpretation Keys) to guide algorithms in labeling pixels.     * Unsupervised Classification: Data is automatically grouped into natural "clusters." The interpreter then labels these spectral groups using ground-truth reference data.
Global Positioning System (GPS)
  • Overview: Developed and operated by the US Department of Defense since 19941994. Preceded by the TRANSIT system (19601960).
  • Structure: Network of 2424 satellites in 66 circular orbits at an altitude of 20,200 km20,200\,km with a period of 1212 hours. This ensures at least 44 satellites are visible from any point on Earth at any time.
  • Current Status (as of Aug 2020): 7575 launched, 3131 active, 99 reserved, 33 testing, 3030 retired, and 22 failed during launch.
  • Global Navigation Satellite System (GNSS): A collective term including GPS (US), Galileo (EU), GLONASS (Russia), BeiDou (China), and NavIC (India).
  • Basic Structure of the GPS System:     1. Space Segment: Satellites in orbits inclined 55o55^o to the equator. Orbits labeled A through F. Blocks range from Block I, II, II-A, II-R, II-RM, to II-F. Weights are approx. 1600 kg1600\,kg at launch (800 kg800\,kg on orbit) for later blocks. Lifetimes vary from 7.57.5 to 1515 years.     2. Control Segment: Maintains system operation (OCS). Consists of 11 Master Control Station (MCS) at Colorado Springs, several Monitor Stations (MS) distributed globally (Hawaii, Ascension Islands, Diego Garcia, Kwajalein), and Ground Control Stations (GCS). MS stations use atomic clocks to measure pseudo-ranges constantly. GCS uses S-band (2−4 GHz2-4\,GHz) to upload ephemeris and clock data to satellites.     3. User Segment: GPS receivers. High-tech equipment available as hand-held, car-mounted, or multi-system (GNSS) receivers. Modern receivers are multi-channel (hundreds of channels). Supports techniques like RTK (Real Time Kinematic), DGPS (Differential GPS), and WADGPS (Wide Area DGPS), as well as augmentation systems like GBAS and SBAS.
  • GPS Positioning Principles:     * Absolute Positioning: Measures the distance to satellites by comparing the time a signal is sent from the satellite (synchronized clock) to the time it is received. 4 satellites provide a unique solution (X,Y,Z,X, Y, Z, and time correction). Accuracy is approx. 20−30 m20-30\,m.     * Relative Positioning: Uses at least 22 receivers simultaneously to eliminate common errors (orbital, clock, atmospheric). Achieves centimeter-level accuracy.         * Static GPS: Fixed receivers for long periods (1 cm1\,cm accuracy; used for geodetic networks).         * Kinematic GPS: One base station and one/multiple rovers. Includes DGPS (meter to decimeter) and RTK (centimeter level using radio links for real-time calculation).

Concepts and Process of Modeling

Definition and Architecture of a Model

  • Origin: Latin "modellus," meaning a man-made style representing reality.
  • Purpose: A tool to study complex or large-scale natural phenomena to find rules and properties. It is a simplified structure—image, object, equation, or software—of reality.
  • Modeling: Applying basic knowledge and experience to simulate natural processes to achieve goals.
  • Utility: "All models are wrong, but some are useful" (George Box, 19761976).
  • Three Main Components:     1. Input: Database values processed by the model.     2. Processing: Calculation, analysis, and evaluation steps.     3. Output: Graphs, maps, tables, or evaluation reports.
  • The 3A Framework (Le Anh Tuan, 2008):     * Application: Goals and importance in practice (e.g., simulating evaporation or soil erosion).     * Algorithm: Technical approach/math equations/parameters.     * Architecture: Type of computer processing/software platforms used.

The Modeling Process (Six Steps)

  1. Data Collection: Initial data and boundary/initial conditions (topography, basin size, land use, soil properties, meteorology, pollution sources, environmental variables like pH, dissolved oxygen, COD, etc.).
  2. Conceptual Model Building: Creating a cause-effect flowchart or schematic to simplify reality.
  3. Analytical or Numerical Model Establishment: Core part using parameters (weighting coefficients) and variables (physical/geometric quantities like time, velocity, area). Uses algorithms to solve relationships and produce results.
  4. Model Calibration: Adjusting parameters so results match measured real-world data with minimum error.
  5. Model Validation: Testing calibrated parameters against a different set of real data (usually a shorter time period) to ensure accuracy across different conditions.
  6. Prediction or Optimization:     * Prediction: Extending results to future scenarios (e.g., Climate Change scenarios for decades/centuries, pollution dispersion).     * Optimization: Selecting extremum (max/min) values to decide on the best plan.

Models in Natural Resources and Environment

  • Climate Models: Simulate interaction of atmosphere, ocean, land, and ice (NCAR, Princeton GFDL, Hadley Center UK, Max Planck Germany).
  • Mike Model Suite (DHI - Danish Hydraulics Institute): Broad applications in basin management, river water quality, flood, salinity intrusion, and coastal studies (MIKE 11, 21, FLOOD, SHE, NAM).
  • SWAT (Soil and Water Assessment Tool): Developed by USDA. Predicts impacts of land management on water, sediment, and chemical yields in large complex basins.
  • CLUMondo (Netherlands): Simulates land-use change based on quantitative relationships to build planning scenarios.
  • WMM (Watershed Management Model): Estimates annual/seasonal pollution loads from various sources in a river basin.
  • Others: HSPF, SWMM, WASP.

Building Natural Resource and Environmental Databases

Database Management Systems (DBMS)

  • Definition: Software designed to manage a database, supporting storage, modification, deletion, and searching. Examples: MySQL, Oracle, PostgreSQL, SQL Server, DB2, Infomix.
  • Benefits: Interface provision to hide physical structure complexity, support for common languages (DDL - Data Definition Language, DML - Data Manipulation Language, SQL - Structured Query Language), and security/integrity mechanisms.
  • Core Components: DDL, DML, Query Language, Report Writer, Graphics Generator, Host Language Interface, Procedure Language, and Data Dictionary.

Detailed Workflow for Building Databases

  1. Review and Analysis of Data Content:     * Classify data (standardized vs. non-standardized).     * Analyze objects: identify Management Objects (ĐTQL), relations, required scanning documents (paper vs. digital), and metadata frames.     * Products: Inventory reports, sample datasets, and ĐTQL conversion reports.
  2. Database Model Design:     * Design data catalog and metadata models based on standards.     * Import sample data to test the model (XML output).
  3. Data Creation for Catalog and Metadata: Populate catalog and metadata content.
  4. Data Creation for the Database:     * Data Conversion: Standardizing spatial/non-spatial digital data. Spatial data must follow specific coordinate systems (e.g., VN-2000). Non-spatial data follows TCVN 69096909 standards.     * Document Scanning: Digitizing paper records and attaching them to attribute fields.     * Data Input and Comparison: Digitizing paper maps and inputting structured/unstructured data.
  5. Data Editing: Topology error correction for spatial data, content correction for non-spatial data, and display styling.
  6. Product Inspection: Checking model, spatial content, attribute content, and metadata accuracy against requirements.
  7. Acceptance and Delivery: Final task report, packaging digital/paper products, and transferring to specialized IT storage units.

Workflow for Building Management and Exploitation Software

  1. Requirement Collection: Functional and non-functional requirements. identify actors and Use Cases (THSD).
  2. Detailed Business Modeling: Using UML to model organizational processes; building Business Use-Case diagrams.
  3. Design: Software architecture, Activity diagrams, Sequence diagrams, Class diagrams, DB model, and UI design.
  4. Programming: Writing and integrating source code.
  5. Testing: Coding convention checks, component tests, and system-level tests.
  6. Deployment: Packaging, installation, user manual construction, and end-user training.
  7. Management of Change Requests: Updating products based on development feedback.
  8. Acceptance and Delivery: Final reports and confirmed handover minutes.
  9. Maintenance: Fixing errors, releasing patches, and data incident processing.

National Database Standards and 1:50,000 Scale Base Data

Coordinate Standards in Vietnam

  • VN-2000: National coordinate and reference system established via Decision 83/2000/QĐ−TTg83/2000/QĐ-TTg (12/07/200012/07/2000) and Circular 973/2001/TT−TCĐC973/2001/TT-TCĐC.
  • VN-2000 Parameters: WGS-84 Ellipsoid, specific rotation angular velocity, gravitational constant, and national origin point.
  • Standards for Digitization: Based on MicroStation format for 1:10,0001:10,000, 1:25,0001:25,000, 1:50,0001:50,000, and 1:100,0001:100,000 maps.
  • Circular 02/2012/TT-BTNMT: Governs spatial data structure models, spatial/temporal conceptual models, object classification, metadata quality, presentation, and data exchange encoding.

Structure of National Geographic Base Database (1:50,000)

  • ID Mapping (maNhanDang): A unique identifier consisting of 4 parts:     1. DB Code: 050N (44 characters).     2. Province Code (22 characters; 00 for sea areas).     3. Object Code from catalog (44 characters).     4. Ordinal Number (66 digits, e.g., 000001).     * Example: 050N01AA01000001 (050N=DB, 01=Province, AA01=Object, 000001=Order).
  • Core Data Themes (Packages):     * CoSoDoDac: Geodetic control points (GA01: Coordinates, GA02: Elevation, GB01: National control).     * BienGioiDiaGioi: National borders (AA01: Land, AA02: Sea) and administrative boundaries (AC01: Province, AC02: District, AC03: Village).     * DiaHinh: Topography (DA05: Place names, EA01: Elevation points, EA02: Depth points, EA03: Contours, EB…: Special terrain like caves, cliffs, dunes).     * ThuyHe: Hydrology (LC03: Sea, LC04: Islands, LD01: Alluvium, LG01: Shoreline, LA07: Rivers/Streams, LB…: Lakes/Ponds, LE…: Dams, Dykes, Pumping stations).     * GiaoThong: Transportation (HA…: Roads, HB…: Railways, HC…: Ports, HD…: Airports, HG02: Bridges, HG05: Tunnels).     * DanCuCoSoHaTang: Population and infrastructure (CA01: Residential points, BA03: Power lines, BB04: Transmission stations, BC04: Water towers, HaTangKinhTeXaHoi: Schools, Hospitals, Factories, etc.).     * PhuBeMat: Land cover (IA02: Residential area, IA04: Bare land, IB02: Agricultural cover, IB04: Forest).     * RanhGioi: Functional boundaries (KB01: Land use boundary, KB03: Fence boundary).

Land Database (Cadastral Database)

  • Core Components: Cadastral data, land use planning data, land price data, and statistical/inventory data.
  • Principles: Unified from Central to Provincial/District levels. The Village (commune) is the basic unit for establishment.
  • Building a Cadastral Database (Cases):     * Case 1: Simultaneous Registration/Mapping: Involves 10 steps from preparation, data collection, spatial data construction (VN-2000), attribute data construction, scanning legal papers, integration, building metadata, testing, to delivery (formats: GML/XML).     * Case 2: Existing Registration Data: Includes 11 steps. Crucial step: Classification of Parcels:         * Type A: Certified parcets with correct info/no changes.         * Type B: Certified, but information (origin/purpose) is outdated.         * Type C: Attribute changes after certification.         * Type D: Boundary changes (split/merge) not yet updated on maps.         * Type Đ: Certified in areas without maps/coordinate-deficient data.         * Type E: Certified on old maps but not updated to new cadastral maps.         * Type G: Declared/registered but not yet certified.     * Case 3: Improving Existing Databases: Steps centered on reviewing, collecting supplementary docs, and standardizing data to Circular 17/2010/TT−BTNMT17/2010/TT-BTNMT specs.
  • Integration: Merging village-level data into district/province/national levels. Includes auditing boundary errors between adjacent communes and ensuring unique owner identification across the system.

Python for Data Processing in Natural Resources

Python Basics

  • Data Types:     * Standard: String (immutable characters), Number (Integer or Float), List (mutable sequence), Tuple (immutable sequence), Dictionary (key-value pairs).     * Strings: Use single ' ' or double `