benchmark study

Toward Reliable Synthetic Omics: Statistical Distances for Generative Models Evaluation

This study evaluates generative models for transcriptomics data using statistical distances to assess their performance and convergence.

The Freshwater Sounds Archive

The paper introduces The Freshwater Sounds Archive, a global database of species-specific freshwater sounds, aiming to improve species identification from soundscape recordings and enable machine learning applications.

Extensive Benchmarking of Community Detection Algorithms

This paper benchmarks community detection algorithms on artificial and real-world networks, finding performance declines with lower modularity and trade-offs between accuracy and computational time.

Tool Choice drastically Impacts CRISPR Spacer-Protospacer Detection

The paper compares sequence search tools for detecting CRISPR spacer-target interactions and finds significant differences in their performance.

Integrative Single-Cell Analysis of Autism Spectrum Disorder Animal Models Reveal Convergent Transcriptomic Dysregulation Involved in Excitatory-Inhibitory Imbalance and Glial Disfunction

This study integrates scRNA-seq data from ASD animal models to identify convergent transcriptomic dysregulation in excitatory-inhibitory imbalance and glial dysfunction.

High-throughput biodiversity surveying sheds new light on the brightest of insect taxa

One year of COI metabarcoding of 197 Malaise traps across Sweden detected 1,535 of 2,990 known Lepidoptera species, plus specimen-validated new country records, range extensions and putative undescribed species.

EvANI benchmarking workflow for evolutionary distance estimation

The paper benchmarks ANI estimation algorithms using simulated and real datasets, showing that ANIb is most accurate but least efficient, while k-mer approaches are efficient and accurate, with some clades requiring multiple k-values.

Gene Editing and Aging: A Bibliometric Analysis of Global Trends and Frontier Themes (2015-2024)

This study performs a bibliometric analysis of gene editing and aging research from 2015 to 2024, identifying key trends and future directions.

Integrated multi-model analysis of intestinal inflammation exposes key molecular features of preclinical and clinical IBD

The paper compares 13 mouse models of intestinal inflammation with human IBD datasets to identify translatable pathways and introduces a web tool for analyzing these models.

STABIX: Summary statistic-based GWAS indexing and compression

STABIX improves GWAS data compression and query efficiency by enabling summary-statistic-based queries and achieving smaller file sizes and faster decompression speeds compared to tabix.

Small molecule bioactivity benchmarks are often well-predicted by counting cells

The paper shows that cell counting can predict compound bioactivity as well as Cell Painting or gene expression, but Cell Painting adds unique value in protein-target-specific benchmarks.

The Latentverse: An Open-Source Benchmarking Toolkit for Evaluating Latent Representations

The paper introduces Latentverse, an open-source toolkit for evaluating latent representations, providing reports and visualizations on properties like clustering and robustness.

Organ-specific filtering by abiotic and biotic environmental factors shapes distinct yet overlapping microbial communities across Lotus corniculatus roots, shoots, flowers, and seeds

The paper examines how environmental factors shape distinct yet overlapping microbial communities in different organs of Lotus corniculatus across multiple sites and years.

MotorBench: A Cryo-Electron Tomography Dataset of Bacterial Flagellar Motors for Testing Detection Algorithms

The paper introduces MotorBench, a dataset of bacterial flagellar motors for testing automated detection algorithms in cryo-ET.

Commercially Relevant Species in the Mediterranean Sea: A Perspective from Late Pleistocene to the Industrial Revolution

This study reviews the impacts of climate and human activities on commercially relevant marine species in the Mediterranean Sea from the Late Pleistocene to the Industrial Revolution, identifying research gaps and data trends.

BenchXAI: Comprehensive Benchmarking of Post-hoc Explainable AI Methods on Multi-Modal Biomedical Data

BenchXAI benchmarks fifteen post-hoc XAI methods on multi-modal biomedical data, finding some methods perform well across tasks while others struggle.

Before the Black Box

The paper investigates evolutionary changes in three enzymes involved in ecdysteroid synthesis across arthropods and correlates these changes with dietary factors.

Benchmarking single cell transcriptome matching methods for incremental growth of cell atlases

The paper benchmarks seven computational tools for matching cell types across cell atlases, finding variations in accuracy and proposing a framework for incremental growth of cell atlases.

A benchmarking study of copy number variation inference methods using single-cell RNA-sequencing data

This study benchmarks five scCNV inference methods across multiple scRNA-seq platforms and mixed samples, finding variations in performance based on data characteristics and batch effects.

T cells promote distinct transcriptional programs of cutaneous inflammatory disease in keratinocytes and dermal fibroblasts

The paper shows how different T cell types drive distinct transcriptional changes in skin cells during inflammation, linking these changes to diseases like psoriasis and scleroderma.

PepPCBench is a Comprehensive Benchmark for Protein-Peptide Complex Structure Prediction with AlphaFold3

The paper introduces PepPCBench, a benchmark framework to evaluate AlphaFold3's performance in predicting protein-peptide complexes using a curated dataset.

Benchmark of cellular deconvolution methods using a multi-assay reference dataset from postmortem human prefrontal cortex

The paper benchmarks cellular deconvolution methods using a multi-assay dataset from human prefrontal cortex, finding Bisque and hspe to be the most accurate.

AlphaFold3 in Drug Discovery: A Comprehensive Assessment of Capabilities, Limitations, and Applications

This study evaluates AlphaFold3's performance in drug discovery tasks, finding it excels at static protein-ligand interactions but struggles with conformational changes, GPCR bias, and affinity ranking.

Gaps and Advances in Long-Term Monitoring of Antarctic Near-Shore and Terrestrial Ecosystems

The paper reviews long-term monitoring efforts in Antarctic near-shore and terrestrial ecosystems, identifies gaps, and recommends standardized protocols and increased collaboration to improve data collection.

GSK3B inhibition partially reverses brain ethanol-induced transcriptomic changes in C57BL/6J mice: Expression network co-analysis with human genome-wide association studies

The paper investigates how GSK3B inhibition with tideglusib reverses ethanol-induced transcriptomic changes in mouse brains and links these findings to human genetic risk for alcohol dependence.

Defining effective strategies to integrate multi-sample single-nucleus ATAC-seq datasets via a multimodal-guided approach

The paper benchmarks snATAC-seq integration pipelines using multimodal datasets and recommends SnapATAC2 + Harmony with ENCODE cCRE features for effective integration.

We are the sensors of consciousness! A review and analysis on how awakenings during sleep influence dream recall.

This paper reviews 69 studies on dream recall after awakening from different sleep stages, finding that awakening method, sleep environment, and participant characteristics significantly affect recall rates.

PlateletBase: A Comprehensive Knowledgebase for Platelet Research and Disease Insights

PlateletBase provides a curated knowledgebase with genomic, transcriptomic, proteomic, and clinical data to enhance platelet research and disease insights.

Refining filtering criteria for accurate taxonomic classification of ancient metagenomic data

This study benchmarks filtering strategies for ancient metagenomic data to improve taxonomic classification accuracy by optimizing thresholding based on sequencing depth.

Putting computational models of immunity to the test - an invited challenge to predict B. pertussis vaccination outcomes

The paper benchmarks 49 algorithms for predicting B. pertussis vaccination outcomes, finding that purpose-built models outperform literature-based ones due to better handling of nonlinearities and data preprocessing.