Evaluation for biobricks-aopwiki
Evaluator: Automated Evaluation
Evaluated on: 2026-01-06
⚠️ Automated Evaluation: This evaluation was generated automatically using an AI-based system. It is distinct from manual evaluations curated by human experts. Please review findings carefully and report any inaccuracies.
Evaluation Criteria: This evaluation uses the KG-Registry evaluation rubric as described in Cortes et al. (2025) . The rubric assesses knowledge graphs across multiple dimensions including access, provenance, documentation, maintenance, and fitness for purpose.
Access Level and Types
| Question | Answer | Comment |
|---|---|---|
| Access to data outside of the knowledge graph | Y | SPARQL endpoint at frink.apps.renci.org/biobricks-aopwiki/sparql enables querying AOP pathway data |
| API or online access to the knowledge graph | N | SPARQL endpoint available but no REST API or user-friendly web interface for non-expert queries |
| Multiple access options available | N | Single access mechanism (SPARQL); no web portal, downloadable RDF, or alternative query methods |
| Source code availability | Y | Complete source code and RDF generation pipeline at github.com/biobricks-ai/aopwikirdf-kg |
| Downloadable knowledge graph | N | No bulk RDF/Turtle download; SPARQL queries required to retrieve data |
Section Score: 2/5
Provenance of Nodes and Edges
| Question | Answer | Comment |
|---|---|---|
| Source list provided | Y | Source clearly identified as AOP-Wiki, NIVA's adverse outcome pathway database |
| Source versions information | N | No documented AOP-Wiki version used; unclear how frequently data is synchronized |
| Import dependencies | Y | RDF generation scripts available in GitHub showing integration process and dependencies |
| Node and edge sources | Y | AOP pathway data transformed to RDF with clear relationships between molecular initiating events and adverse outcomes |
| Edges deduplication | N | No documentation of deduplication strategy for duplicate AOP pathways or overlapping relationships |
| Triples source details | N | RDF schema documentation not provided; ontology mappings unclear |
| Edge type schema | N | Relationship types not formally mapped to standard ontologies (RDF, OWL) |
Section Score: 3/7
Documented standards, schema, construction
| Question | Answer | Comment |
|---|---|---|
| Biological usable data | Y | AOP pathway data directly applicable to toxicology and adverse effect prediction |
| Resolvable IDs | Y | Nodes use stable AOP-Wiki identifiers resolvable through NIVA's AOP-Wiki website |
| Construction documentation | N | RDF generation methodology not formally documented beyond source code |
| Transformation documentation | N | No documentation of how AOP-Wiki hierarchical data maps to RDF structure |
| Schema used | N | RDF vocabulary and ontology choices not formally published or documented |
Section Score: 2/5
Update frequency and versioning
| Question | Answer | Comment |
|---|---|---|
| Stable versions | Y | GitHub releases available for BioBricks AOP-Wiki with tagged stable versions |
| Public tracker information | Y | GitHub issues tracker active; BioBricks team maintains the project |
| Knowledge graph contact information | Y | Maintainer Tom Luechtefeld available; BioBricks organization provides support |
| Updated annually | Y | Part of active BioBricks ecosystem; repository shows regular commits |
| Prior versions access | Y | Full GitHub history available; prior versions accessible for reproducibility |
Section Score: 5/5
Evaluation - Metrics and Fitness for Purpose
| Question | Answer | Comment |
|---|---|---|
| Use case provided | Y | Clear use case: support toxicological risk assessment through structured AOP pathway data |
| Evaluation against other models | N | No comparison with other AOP databases or structured toxicology knowledge graphs |
| Defined scope | Y | Focused scope: adverse outcome pathways linking molecular events to population-level effects |
| Multiple evaluation methods | N | No systematic validation or accuracy assessment framework documented |
| Accuracy metrics | N | No reported accuracy, precision, or coverage metrics for AOP data completeness |
Section Score: 2/5
License Information
| Question | Answer | Comment |
|---|---|---|
| License |