Evaluation for medkg
Evaluator: Automated Evaluation
Evaluated on: 2026-01-06
⚠️ Automated Evaluation: This evaluation was generated automatically using an AI-based system. It is distinct from manual evaluations curated by human experts. Please review findings carefully and report any inaccuracies.
Evaluation Criteria: This evaluation uses the KG-Registry evaluation rubric as described in Cortes et al. (2025) . The rubric assesses knowledge graphs across multiple dimensions including access, provenance, documentation, maintenance, and fitness for purpose.
Access Level and Types
| Question | Answer | Comment |
|---|---|---|
| Access to data outside of the knowledge graph | Y | http://pitools.niper.ac.in/medkg/ |
| API or online access to the knowledge graph | N | None provided |
| Multiple access options available | N | None |
| Source code availability | N | No public repository |
| Downloadable knowledge graph | N | No download link |
Section Score: 1/5
Provenance of Nodes and Edges
| Question | Answer | Comment |
|---|---|---|
| Source list provided | Y | Data integrated from 35 authoritative sources (see description) |
| Source versions information | N | Not specified |
| Import dependencies | Y | Continuous Integration/Continuous Update pipeline |
| Node and edge sources | Y | 35 sources as described |
| Edges deduplication | N | Not indicated |
| Triples source details | N | Not provided |
| Edge type schema | N | Not provided |
Section Score: 3/7
Documented standards, schema, construction
| Question | Answer | Comment |
|---|---|---|
| Biological usable data | Y | Yes – integrates biological systems |
| Resolvable IDs | N | Not indicated |
| Construction documentation | N | None provided |
| Transformation documentation | N | None provided |
| Schema used | N | None provided |
Section Score: 1/5
Update frequency and versioning
| Question | Answer | Comment |
|---|---|---|
| Stable versions | N | No version tags |
| Public tracker information | N | None |
| Knowledge graph contact information | Y | prabhagarg@niper.ac.in |
| Updated annually | N | Continuously via CI pipeline |
| Prior versions access | N | Not available |
Section Score: 1/5
Evaluation - Metrics and Fitness for Purpose
| Question | Answer | Comment |
|---|---|---|
| Use case provided | Y | Precision medicine and drug discovery (see description) |
| Evaluation against other models | N | None |
| Defined scope | Y | Precision medicine and drug discovery |
| Multiple evaluation methods | N | None |
| Accuracy metrics | N | Not provided |
Section Score: 2/5
License Information
| Question | Answer | Comment |
|---|---|---|
| License | No license information provided |