Evaluation for sudokn
Evaluator: Automated Evaluation
Evaluated on: 2026-01-06
⚠️ Automated Evaluation: This evaluation was generated automatically using an AI-based system. It is distinct from manual evaluations curated by human experts. Please review findings carefully and report any inaccuracies.
Evaluation Criteria: This evaluation uses the KG-Registry evaluation rubric as described in Cortes et al. (2025) . The rubric assesses knowledge graphs across multiple dimensions including access, provenance, documentation, maintenance, and fitness for purpose.
Access Level and Types
| Question | Answer | Comment |
|---|---|---|
| Access to data outside of the knowledge graph | Y | SPARQL endpoint at frink.apps.renci.org/sudokn/sparql provides query access to manufacturing capability data |
| API or online access to the knowledge graph | N | SPARQL endpoint available but no REST API or user-facing portal for non-expert access to manufacturing data |
| Multiple access options available | N | Single access mechanism via SPARQL; no web UI, bulk downloads, or alternative formats documented for SMM data |
| Source code availability | N | No publicly available source code repository; KG construction methodology proprietary or undocumented |
| Downloadable knowledge graph | N | No bulk RDF export or data download available; SPARQL endpoint only access method |
Section Score: 1/5
Provenance of Nodes and Edges
| Question | Answer | Comment |
|---|---|---|
| Source list provided | Y | Manufacturing data sources from SMM capability databases clearly identified in project documentation |
| Source versions information | N | No versioning information for upstream manufacturing data sources or SMM capability dataset snapshots |
| Import dependencies | Y | Data integration pipeline documented showing how SMM capability data incorporated into knowledge network |
| Node and edge sources | Y | Manufacturing capabilities and supply-demand relationships traced to source SMM registry data |
| Edges deduplication | N | No documentation of deduplication strategy for redundant capability entries across SMM databases |
| Triples source details | N | RDF schema not formally documented; semantic mapping unclear for manufacturing relationships |
| Edge type schema | N | Relationship types between capabilities and manufacturers not formally mapped to ontologies |
Section Score: 3/7
Documented standards, schema, construction
| Question | Answer | Comment |
|---|---|---|
| Biological usable data | Y | Manufacturing capability data directly applicable to supply chain optimization and SMM network analysis |
| Resolvable IDs | N | No external identifier mapping or resolvability documented; manufacturing IDs isolated to SUDOKN system |
| Construction documentation | N | KG construction methodology not formally documented; integration approach unclear |
| Transformation documentation | N | Data transformation from SMM registry to knowledge network representation not transparent |
| Schema used | N | Manufacturing ontology or schema choices not published or documented |
Section Score: 1/5
Update frequency and versioning
| Question | Answer | Comment |
|---|---|---|
| Stable versions | N | No formal versioning scheme documented; SPARQL endpoint operates with continuous updates |
| Public tracker information | N | No public issue tracker or development roadmap visible; limited transparency into maintenance |
| Knowledge graph contact information | Y | Farhad Ameri (farhad.ameri@asu.edu) available as primary contact for SUDOKN project |
| Updated annually | N | Update frequency and schedule for manufacturing data not documented or formalized |
| Prior versions access | N | No version history or archived snapshots available for reproducibility |
Section Score: 1/5
Evaluation - Metrics and Fitness for Purpose
| Question | Answer | Comment |
|---|---|---|
| Use case provided | Y | Clear use case: interconnected network for SMM supply-demand matching and manufacturing capability discovery |
| Evaluation against other models | N | No comparison with other supply chain or manufacturing knowledge graphs |
| Defined scope | Y | Focused scope on SMM manufacturing capabilities and supply-demand relationships |
| Multiple evaluation methods | N | No systematic validation framework for manufacturing data accuracy or completeness |
| Accuracy metrics | N | No reported accuracy or reliability metrics for manufacturing capability information |
Section Score: 2/5
License Information
| Question | Answer | Comment |
|---|---|---|
| License |