Evaluation for spatialkg
Evaluator: Automated Evaluation
Evaluated on: 2026-01-06
⚠️ Automated Evaluation: This evaluation was generated automatically using an AI-based system. It is distinct from manual evaluations curated by human experts. Please review findings carefully and report any inaccuracies.
Evaluation Criteria: This evaluation uses the KG-Registry evaluation rubric as described in Cortes et al. (2025) . The rubric assesses knowledge graphs across multiple dimensions including access, provenance, documentation, maintenance, and fitness for purpose.
Access Level and Types
| Question | Answer | Comment |
|---|---|---|
| Access to data outside of the knowledge graph | Y | SPARQL endpoint at frink.apps.renci.org/spatialkg/sparql provides access to SAWGraph spatial grid and administrative region data |
| API or online access to the knowledge graph | N | SPARQL endpoint only; no REST API or web portal interface for non-expert geographic queries |
| Multiple access options available | N | Single SPARQL access method; no web UI, downloads, or alternative query mechanisms documented |
| Source code availability | N | No public source code repository found; SAWGraph spatial KG construction methodology not openly available |
| Downloadable knowledge graph | N | No bulk RDF export or geographic data dumps available; SPARQL queries required for data access |
Section Score: 1/5
Provenance of Nodes and Edges
| Question | Answer | Comment |
|---|---|---|
| Source list provided | Y | SAWGraph spatial data integrating S2 grid cells and U.S. administrative regions clearly documented |
| Source versions information | N | No versioning for S2 geometry or administrative boundary source datasets documented |
| Import dependencies | Y | SAWGraph framework integration apparent for spatial data organization and relationships |
| Node and edge sources | Y | Geographic cells and administrative regions with documented spatial relationships from SAWGraph |
| Edges deduplication | N | No deduplication strategy documented for overlapping spatial features or boundary conflicts |
| Triples source details | N | RDF schema not formally documented for geographic entities and spatial relationships |
| Edge type schema | N | Spatial relationship types (contains, intersects, etc.) not mapped to standard GIS ontologies |
Section Score: 3/7
Documented standards, schema, construction
| Question | Answer | Comment |
|---|---|---|
| Biological usable data | Y | Spatial geographic data applicable to environmental science, agriculture, and water resource management |
| Resolvable IDs | N | S2 grid cell and administrative region IDs not resolvable outside SPARQL endpoint; no external mapping documented |
| Construction documentation | N | SAWGraph spatial KG construction methodology not publicly documented |
| Transformation documentation | N | How geographic data transformed into spatial knowledge graph structure not transparent |
| Schema used | N | RDF schema and GIS ontology choices not published or documented |
Section Score: 1/5
Update frequency and versioning
| Question | Answer | Comment |
|---|---|---|
| Stable versions | N | No formal versioning scheme; SPARQL endpoint updates continuously without released stable versions |
| Public tracker information | N | No public issue tracker or development roadmap visible; limited transparency into maintenance |
| Knowledge graph contact information | Y | David Kedrowski (david.kedrowski@maine.edu) available as primary contact for SAWGraph Spatial KG |
| Updated annually | N | Update frequency and schedule for geographic data not documented |
| Prior versions access | N | No version history or archived spatial data snapshots available for reproducibility |
Section Score: 1/5
Evaluation - Metrics and Fitness for Purpose
| Question | Answer | Comment |
|---|---|---|
| Use case provided | Y | Use cases in environmental monitoring and agricultural spatial analysis across contiguous U.S. |
| Evaluation against other models | N | No comparison with other GIS knowledge graphs or spatial databases documented |
| Defined scope | Y | Focused scope on SAWGraph spatial grid covering 48 contiguous U.S. states at Level 13 resolution |
| Multiple evaluation methods | N | No validation against independent geospatial datasets or coordinate accuracy assessments |
| Accuracy metrics | N | No reported coordinate accuracy, spatial resolution metrics, or boundary completeness documented |
Section Score: 2/5
License Information
| Question | Answer | Comment |
|---|---|---|
| License |