Architecture Decision Records

Here we document the architecture decisions we have made.

Infrastructure & Access

• Cross-Project Orchard Data Access Implementation - Implementation of secure cross-project access to orchard datasets from Matrix platform
• Main-Only Infrastructure Deployment - Decision to deploy infrastructure changes only from main branch
• Secure Private Datasets - Implementation of secure handling for private datasets

Data & Processing

• Automated Data Release EC KG - Automation of knowledge graph data releases
• Improve Testing Through Sampling - Enhanced testing strategy using data sampling
• New Environment Resolver - Implementation of improved environment resolution

Performance & Operations

• CI Optimization with Self-Hosted Runners - GitHub Actions self-hosted runners deployment to reduce CI time from 30 to 15 minutes
• Switching Pipeline Runs to Spot Instances - Migration to cost-effective spot instances for pipeline execution
• OSS Storage Setup - Open source storage configuration decisions

Historical

• History Rewrite Pre-OSS - Documentation of codebase history cleanup before open sourcing