benchmark study

Impacts of human-introduced species on the geography of life on Earth

The paper assesses how non-native species alter global biogeographical patterns by analyzing 15 classical biogeographical rules.

nf-core/detaxizer: A Benchmarking Study for Decontamination from Human Sequences

The paper benchmarks decontamination tools for removing human sequences from metagenomic data, showing significant variation in effectiveness among tools.

Comprehensive benchmark of differential transcript usage analysis for static and dynamic conditions

The paper benchmarks differential transcript usage analysis tools across static and dynamic conditions, finding optimal tools for different data types and experimental settings.

Benchmarking Genetic Interaction Scoring Methods for Identifying Synthetic Lethality from Combinatorial CRISPR Screens

Ambient Proteins: Training Diffusion Models on Low Quality Structures

Treating low-confidence AlphaFold structures as noisy data at pLDDT-dependent diffusion times lets a 16.7M-parameter model generate long proteins with higher diversity, designability and novelty than Proteína.

A Study of Calibration as a Measurement of Trustworthiness of Large Language Models in Biomedical Research

This study evaluates the calibration of 9 LLMs in BioNLP tasks using Flex-ECE and finds that post-hoc calibration significantly improves model reliability.

A comparison of long-read single-cell transcriptomic approaches

This study compares long-read single-cell sequencing platforms, identifying common limitations and demonstrating their utility for isoform-resolved analyses.

A Comprehensive Benchmark of Tools for Efficient Genomic Interval Querying

The paper benchmarks genomic interval querying tools using simulated datasets, evaluating performance, memory usage, and precision across different tools and data structures.

Medium-sized protein language models perform well at transfer learning on realistic datasets

Medium-sized protein language models (e.g. ESM C 600M) with mean embeddings nearly match ESM-2 15B and ESM C 6B in transfer learning on mutational scanning and PISCES data.

Refinement Strategies for Tangram for Reliable Single-Cell to Spatial Mapping

This paper refines the Tangram spatial mapping tool to improve consistency and reliability in mapping single-cell RNA-seq data to spatial transcriptomics data.

An optimised computational approach for the identification of somatic structural variants in cancer

The paper benchmarks structural variant callers in cancer genomics and recommends a consensus approach combining Delly, GRIDSS, Manta, and SvABA for improved performance.

PLMFit : Benchmarking Transfer Learning with Protein Language Models for Protein Engineering

PLMFit benchmarks transfer learning methods on protein language models for protein engineering tasks, identifying optimal strategies for knowledge transfer.

A Comparative Evaluation of Computational Models for RNA modification detection using Nanopore sequencing with RNA004 Chemistry

This study compares two RNA modification detection models, Dorado and m6Anet, using RNA004 sequencing data, finding Dorado has higher recall but both have high false discovery rates for m6A and pseudouridine.

From Ice Cores to Dinosaurs: Physical Collections Managers' Research Data Curation Perceptions and Behaviors

This study examines how physical collection managers perceive and manage data curation across disciplines to improve reusability and discoverability of physical collections.

Simple threshold-based Boolean rules fall short in capturing biological regulatory network dynamics

This study evaluates threshold majority rules in gene regulatory network modeling, finding they lack biological realism and fail to capture key dynamics observed in empirical data.

A flexible pipeline for reproducible exome-wide rare variant gene-trait associations

The paper introduces a customizable pipeline for exome-wide rare variant gene-trait associations, demonstrating its utility by replicating three studies and providing a standardized framework for similar analyses.

DiPPER2 - a user-friendly pipeline for picking and evaluating taxon-specific PCR primers

DiPPER2 is a pipeline for designing and evaluating taxon-specific PCR primers, ensuring specificity and sensitivity for pathogen detection.

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central Dogma

Genomic Touchstone evaluates genomic language models across 36 tasks and 88 datasets, revealing insights on model performance, scaling, and pretraining strategies.

Benchmarking Peak Calling Methods for CUT&RUN

This study benchmarks four peak calling methods for CUT&RUN data, revealing variability in performance across histone marks and highlighting method-specific strengths.

The strength of weird ties: positive genetic interactions have greater scientific impact but are under-represented in the literature

The paper finds that positive genetic interactions have greater scientific impact but are underrepresented in literature, despite equal detection capability.

High School Science Fair: What Students Say -- Mastery, Performance, and Self-Determination Theory

The paper analyzes student feedback from science fairs to understand how participation affects interest in STEM, finding that mastery-oriented reasons align with self-determination theory.

A Benchmark of Modern Statistical Phasing Methods

This paper benchmarks three statistical phasing methods using synthetic diploids, finding consistent error patterns across methods and populations.

PubPlant: a continuously updated online resource for sequenced and published plant genomes

PubPlant catalogs over 1800 sequenced plant genomes, offering visualizations and phylogenetic insights, and highlights gaps in food crop genome sequencing.

Cross-talk between RNA secondary and three-dimensional structure prediction: a comprehensive study

This study benchmarks RNA 3D structure prediction models using varying accuracy 2D structures, finding that 3D models modify input base-pairing interactions and are more sensitive to false positives in 2D structures.

Results of the Protein Engineering Tournament: An Open Science Benchmark for Protein Modeling and Design

The paper introduces a protein engineering competition to benchmark computational models for protein design and characterization, with results from a pilot tournament involving seven teams.

Comparison of spatial transcriptomics technologies used for tumor cryosections

This study compares four spatial transcriptomics technologies for analyzing medulloblastoma cryosections, highlighting their strengths and providing guidance for method selection.

Pathway Volcano: An interactive tool for pathway guided visualization of differential expression data

Pathway Volcano simplifies differential expression visualization by filtering volcano plots to highlight pathway-related features, enabling better biological interpretation.

Population-specific brain charts reveal Chinese-Western differences in neurodevelopmental trajectories

The paper develops population-specific brain charts for Chinese individuals, revealing distinct neurodevelopmental patterns compared to Western populations and showing better performance in predicting brain phenotypes.

RNAGym: Large-scale Benchmarks for RNA Fitness and Structure Prediction

RNAGym provides a benchmarking framework for RNA fitness, secondary structure, and tertiary structure prediction using diverse datasets and standardized assays.

LAMPP: A benchmark for continuous evaluation of host phenotype prediction from shotgun metagenomic data

LAMPP provides a standardized benchmark for evaluating host phenotype prediction from gut metagenomic data, showing that traditional methods remain competitive.