Evaluation for identifier-mappings
Evaluator: Automated evaluation (GPT-5.1-Codex-Max)
Evaluated on: 2026-01-23
⚠️ Automated Evaluation: This evaluation was generated automatically using an AI-based system. It is distinct from manual evaluations curated by human experts. Please review findings carefully and report any inaccuracies.
Evaluation Criteria: This evaluation uses the KG-Registry evaluation rubric as described in Cortes et al. (2025) . The rubric assesses knowledge graphs across multiple dimensions including access, provenance, documentation, maintenance, and fitness for purpose.
Access Level and Types
| Question | Answer | Comment |
|---|---|---|
| Access to data outside of the knowledge graph | N | No published embeddings or derived artifacts beyond the mapping triples. |
| API or online access to the knowledge graph | Y | SPARQL endpoint at https://frink.apps.renci.org/identifier-mappings/sparql. |
| Multiple access options available | Y | Both SPARQL and a Triple Pattern Fragments endpoint (https://frink.apps.renci.org/ldf/identifier-mappings). |
| Source code availability | N | No code repository linked for the extraction/hosting pipeline. |
| Downloadable knowledge graph | N | No dump or download link provided. |
Section Score: 2/5
Provenance of Nodes and Edges
| Question | Answer | Comment |
|---|---|---|
| Source list provided | Y | States the graph is a subset of the Wikidata RDF dump focused on identifier mappings. |
| Source versions information | N | No dump date or version of Wikidata specified. |
| Import dependencies | Y | Depends on Wikidata RDF dumps for mapping predicates. |
| Node and edge sources | Y | Nodes and edges originate from Wikidata mapping triples. |
| Edges deduplication | N | No mention of deduplication. |
| Triples source details | N | Does not enumerate triple-level provenance. |
| Edge type schema | N | Uses standard predicates (e.g., skos:exactMatch) but no explicit edge type schema is described. |
Section Score: 3/7
Documented standards, schema, construction
| Question | Answer | Comment |
|---|---|---|
| Biological usable data | Y | Identifier mappings are broadly usable, including for biomedical integration. |
| Resolvable IDs | Y | External identifiers are represented as RDF IRIs and are resolvable. |
| Construction documentation | N | No build or ingestion pipeline documentation provided. |
| Transformation documentation | Y | Notes conversion of Wikidata custom predicates to standard ones like skos:exactMatch. |
| Schema used | Y | States use of standard RDF predicates (e.g., SKOS exactMatch) for mappings. |
Section Score: 4/5
Update frequency and versioning
| Question | Answer | Comment |
|---|---|---|
| Stable versions | N | No release cadence or version tags are listed. |
| Public tracker information | N | No issue tracker linked for this graph. |
| Knowledge graph contact information | Y | Contact provided: Mahir Morshed (morshedm@renci.org). |
| Updated annually | N | No stated update schedule. |
| Prior versions access | N | No access to historical versions. |
Section Score: 1/5
Evaluation - Metrics and Fitness for Purpose
| Question | Answer | Comment |
|---|---|---|
| Use case provided | Y | Intended for cross-referencing Wikidata entities to external identifier systems. |
| Evaluation against other models | N | No comparative evaluation reported. |
| Defined scope | Y | Scope limited to identifier-mapping triples extracted from Wikidata. |
| Multiple evaluation methods | N | No evaluation methodology described. |
| Accuracy metrics | N | No accuracy or quality metrics provided. |
Section Score: 2/5
License Information
| Question | Answer | Comment |
|---|---|---|
| License | CC0 1.0 | Inherits Wikidata's CC0 license; FRINK provides the subset. |