Skip to content

Pipelines

The visualizer is the front door. Behind it are command-line pipelines that do the heavy lifting and can be scripted, scheduled or run on a cluster. Most visualizer forms start one of them as a background job, and each job stores the exact command it ran (results/visualizer/jobs/<id>/task.json).

flowchart LR
    subgraph data [Build data]
      GA["genomes-analyzer<br/>FASTQ → VCF"]
      DB["dataset-builders<br/>VCF → canonical dataset"]
      AG["alphagenome<br/>predict-dataset"]
    end
    subgraph learn [Learn from it]
      GT["genotype<br/>CNNs over tracks"]
      VT["variant<br/>transformer"]
      SNP["snp-ancestry"]
    end
    GA --> DB --> AG --> GT
    DB --> VT
    DB --> SNP
Pipeline CLI Visualizer equivalent Code
Dataset builders genomics dataset-builders Import dataset src/genomics/workflows/dataset_builders/
AlphaGenome genomics alphagenome AlphaGenome predictions, AlphaGenome page src/genomics/workflows/alphagenome/
Genotype predictor genomics genotype Experiments, Perturbation Lab src/genomics/predictors/genotype_based/
Variant transformer genomics variant – src/genomics/predictors/variant_transformer/
SNP ancestry genomics snp-ancestry – src/genomics/predictors/snp_ancestry/
Genomes analyzer genomics genomes-analyzer – src/genomics/workflows/genomes_analyzer/
VCF to 23andMe genomics convert vcf-to-23andme – src/genomics/converters/vcf_to_23andme/
Native and third-party – – native/, third_party/
Legacy – – legacy/

To reproduce the 1000 Genomes results from the command line, follow Building 1000 Genomes dataset, then Training and running predictions. Every subcommand is listed in the CLI reference.

All active Python code imports through genomics.* or relative imports inside the same package.