Language models from first principles · R · open source
Reproducing neural language models from scratch
Rebuilt a recurrent neural network, a causal Transformer, and a GPT-2-style decoder in base R. Implemented attention, forward and backward passes, loss functions, and optimisation directly, without pretrained weights, deep-learning frameworks, or automatic differentiation.
Three reproducible CPU-trained implementations with source code and validation; the GPT-2-style model has 369,504 trainable parameters. RNN · Transformer · GPT-2 · Source code
Foundation-model fine-tuning · Hugging Face · PyTorch
Fine-tuning pretrained language models
Fine-tuned DistilBERT using Hugging Face Transformers and PyTorch for four-class news classification. Implemented task-specific training, validation, held-out evaluation, and probabilistic inference.
Held-out accuracy of 88.8% and macro F1 of 0.886 after one CPU training epoch using 1,000 labelled training articles. Methods and results
PanelAppRex AI · disease-gene evidence
AI-assisted disease panel-level interpretation
Built an AI-assisted information layer over structured disease-gene panel evidence, combining UniProtKB mechanistic text with panel metadata, inheritance, disease group, and reported phenotypes.
6.6 million features compressed 5x into disease-aware summaries, integrated into a user-facing application for interpretation and review.
Quant Group et al., 2026.
Universitäts-Kinderspital Zürich · secure clinical genetics
Secure AI-assisted variant interpretation
Built a secure AI-assisted clinical genetics system on cloud high-performance computing infrastructure using open-weight models including Llama and DeepSeek R1.
High-throughput variant interpretation and report generation for human review by the Molecular Board, including geneticists, doctors, and researchers.
Customer-facing platform · credentialed agent workflows
Clinical information collation and diagnostic candidate generation
Developed a credentialed platform using OpenAI APIs and agent workflows to collate clinical information and convert ICD-10 codes into candidate diagnostic hypotheses.
Customer-facing interface, controlled access, structured clinical inputs, candidate diagnosis generation, and reviewable outputs.
Systematic review and freedom-to-operate · verifiable evidence
AI-assisted evidence extraction and review
Built AI-assisted workflows for systematic review, structured extraction, algorithm development, freedom-to-operate, patent review, and trademark analysis.
More than 5,000 full-text research articles processed into structured datasets; evidence preparation for Switzerland Omics trademark registration with the Swiss Federal Institute of Intellectual Property.