Evaluation for eco-kg
Evaluator: Automated Evaluation
Evaluated on: 2026-01-06
⚠️ Automated Evaluation: This evaluation was generated automatically using an AI-based system. It is distinct from manual evaluations curated by human experts. Please review findings carefully and report any inaccuracies.
Evaluation Criteria: This evaluation uses the KG-Registry evaluation rubric as described in Cortes et al. (2025) . The rubric assesses knowledge graphs across multiple dimensions including access, provenance, documentation, maintenance, and fitness for purpose.
Access Level and Types
| Question | Answer | Comment |
|---|---|---|
| Access to data outside of the knowledge graph | Y | Plant trait data available through KGHub portal at kg-hub.berkeleybop.io/eco-kg/ with downloads and browser access |
| API or online access to the knowledge graph | N | API endpoint available at kghub.org/eco-kg/api but limited REST API documentation for programmatic access |
| Multiple access options available | Y | Three documented access methods: KGHub portal, downloadable KGX graph, and API endpoint for trait data |
| Source code availability | Y | Complete source code at github.com/Knowledge-Graph-Hub/eco-kg with CC-BY 4.0 license enabling reproducibility |
| Downloadable knowledge graph | N | KGX format available through KGHub but no comprehensive RDF/standard graph dumps documented |
Section Score: 3/5
Provenance of Nodes and Edges
| Question | Answer | Comment |
|---|---|---|
| Source list provided | Y | Primary sources: Planteome plant ontology and Encyclopedia of Life (EOL) TraitBank documented clearly |
| Source versions information | N | No version tracking for Planteome or EOL TraitBank snapshots used in KG construction |
| Import dependencies | Y | GitHub repository shows ETL pipeline and dependencies for integrating plant trait sources |
| Node and edge sources | Y | Plant traits traceable to Planteome and EOL sources with documented mapping |
| Edges deduplication | N | No deduplication strategy documented for redundant trait assignments across sources |
| Triples source details | N | KGX format used but RDF schema and ontology mappings not formally documented |
| Edge type schema | N | Plant trait relationship types not formally mapped to standard ontologies |
Section Score: 3/7
Documented standards, schema, construction
| Question | Answer | Comment |
|---|---|---|
| Biological usable data | Y | Plant phenotype and trait data directly applicable to ecology, botany, and agriculture research |
| Resolvable IDs | Y | Uses stable Planteome and EOL identifiers for plant terms and trait names resolvable externally |
| Construction documentation | N | ETL methodology described in source code but not formally documented in publications |
| Transformation documentation | N | How Planteome and EOL data transformed to KGX format not transparent in documentation |
| Schema used | N | KGX schema not formally published; plant trait ontology mapping unclear |
Section Score: 2/5
Update frequency and versioning
| Question | Answer | Comment |
|---|---|---|
| Stable versions | Y | KGHub releases available with versioned downloads through kg-hub portal |
| Public tracker information | Y | GitHub issues tracker active; Knowledge Graph Hub team maintains the resource |
| Knowledge graph contact information | Y | Anne Thessen (annethessen@gmail.com) available for contact; KGHub organization provides support |
| Updated annually | Y | Repository shows regular commits reflecting trait data and source updates |
| Prior versions access | Y | Full Git history and KGHub release archive enable reproducibility with prior versions |
Section Score: 5/5
Evaluation - Metrics and Fitness for Purpose
| Question | Answer | Comment |
|---|---|---|
| Use case provided | Y | Clear use case: plant trait discovery for ecological characterization and agricultural phenotyping |
| Evaluation against other models | N | No comparison with other plant phenotype databases or trait knowledge graphs documented |
| Defined scope | Y | Focused scope on plant traits from Planteome and EOL for trait-based ecological research |
| Multiple evaluation methods | N | No systematic validation framework for trait annotation accuracy or completeness |
| Accuracy metrics | N | No reported precision/recall for trait predictions or trait curation metrics |
Section Score: 2/5
License Information
| Question | Answer | Comment |
|---|---|---|
| License |