benchmark study

Avian predator-prey dynamics in a changing climate along the Western Antarctic Peninsula; a scoping review

This paper reviews avian predator-prey dynamics in Antarctica, identifies research gaps, and recommends future studies on how these relationships interact with climate change along the Western Antarctic Peninsula.

Beating the gold standard: A review of Mycobacterium tuberculosis lysis using bead beating and the need for standardization.

The paper reviews bead beating methods for Mycobacterium tuberculosis lysis, identifies protocol variability, and highlights the need for standardization to improve reproducibility.

Benchmarking of T-Cell Receptor - Epitope Predictors with ePytope-TCR

The paper benchmarks T-cell receptor-epitope predictors using ePytope-TCR, showing performance on datasets and highlighting biases in prediction scores across epitope classes.

mRNABench: A curated benchmark for mature mRNA property and function prediction

mRNABench evaluates self-supervised mRNA foundation models using 13 datasets and 81 tasks to assess their ability to predict mRNA properties.

Why do some predicted protein structures fold poorly? Benchmarking AlphaFold, ESMFold, and Boltz in maize

The paper benchmarks AlphaFold, ESMFold, and Boltz in maize to assess their performance on plant proteins, finding lower confidence scores and geometry issues in less conserved proteins.

Impacts of human-introduced species on the geography of life on Earth

The paper assesses how non-native species alter global biogeographical patterns by analyzing 15 classical biogeographical rules.

nf-core/detaxizer: A Benchmarking Study for Decontamination from Human Sequences

The paper benchmarks decontamination tools for removing human sequences from metagenomic data, showing significant variation in effectiveness among tools.

Comprehensive benchmark of differential transcript usage analysis for static and dynamic conditions

The paper benchmarks differential transcript usage analysis tools across static and dynamic conditions, finding optimal tools for different data types and experimental settings.

Benchmarking Genetic Interaction Scoring Methods for Identifying Synthetic Lethality from Combinatorial CRISPR Screens

Ambient Proteins: Training Diffusion Models on Low Quality Structures

Treating low-confidence AlphaFold structures as noisy data at pLDDT-dependent diffusion times lets a 16.7M-parameter model generate long proteins with higher diversity, designability and novelty than Proteína.

A Study of Calibration as a Measurement of Trustworthiness of Large Language Models in Biomedical Research

This study evaluates the calibration of 9 LLMs in BioNLP tasks using Flex-ECE and finds that post-hoc calibration significantly improves model reliability.

A comparison of long-read single-cell transcriptomic approaches

This study compares long-read single-cell sequencing platforms, identifying common limitations and demonstrating their utility for isoform-resolved analyses.

A Comprehensive Benchmark of Tools for Efficient Genomic Interval Querying

The paper benchmarks genomic interval querying tools using simulated datasets, evaluating performance, memory usage, and precision across different tools and data structures.

Medium-sized protein language models perform well at transfer learning on realistic datasets

Medium-sized protein language models (e.g. ESM C 600M) with mean embeddings nearly match ESM-2 15B and ESM C 6B in transfer learning on mutational scanning and PISCES data.

Refinement Strategies for Tangram for Reliable Single-Cell to Spatial Mapping

This paper refines the Tangram spatial mapping tool to improve consistency and reliability in mapping single-cell RNA-seq data to spatial transcriptomics data.

An optimised computational approach for the identification of somatic structural variants in cancer

The paper benchmarks structural variant callers in cancer genomics and recommends a consensus approach combining Delly, GRIDSS, Manta, and SvABA for improved performance.

PLMFit : Benchmarking Transfer Learning with Protein Language Models for Protein Engineering

PLMFit benchmarks transfer learning methods on protein language models for protein engineering tasks, identifying optimal strategies for knowledge transfer.

A Comparative Evaluation of Computational Models for RNA modification detection using Nanopore sequencing with RNA004 Chemistry

This study compares two RNA modification detection models, Dorado and m6Anet, using RNA004 sequencing data, finding Dorado has higher recall but both have high false discovery rates for m6A and pseudouridine.

From Ice Cores to Dinosaurs: Physical Collections Managers' Research Data Curation Perceptions and Behaviors

This study examines how physical collection managers perceive and manage data curation across disciplines to improve reusability and discoverability of physical collections.

Simple threshold-based Boolean rules fall short in capturing biological regulatory network dynamics

This study evaluates threshold majority rules in gene regulatory network modeling, finding they lack biological realism and fail to capture key dynamics observed in empirical data.

A flexible pipeline for reproducible exome-wide rare variant gene-trait associations

The paper introduces a customizable pipeline for exome-wide rare variant gene-trait associations, demonstrating its utility by replicating three studies and providing a standardized framework for similar analyses.

DiPPER2 - a user-friendly pipeline for picking and evaluating taxon-specific PCR primers

DiPPER2 is a pipeline for designing and evaluating taxon-specific PCR primers, ensuring specificity and sensitivity for pathogen detection.

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central Dogma

Genomic Touchstone evaluates genomic language models across 36 tasks and 88 datasets, revealing insights on model performance, scaling, and pretraining strategies.

Benchmarking Peak Calling Methods for CUT&RUN

This study benchmarks four peak calling methods for CUT&RUN data, revealing variability in performance across histone marks and highlighting method-specific strengths.

The strength of weird ties: positive genetic interactions have greater scientific impact but are under-represented in the literature

The paper finds that positive genetic interactions have greater scientific impact but are underrepresented in literature, despite equal detection capability.

High School Science Fair: What Students Say -- Mastery, Performance, and Self-Determination Theory

The paper analyzes student feedback from science fairs to understand how participation affects interest in STEM, finding that mastery-oriented reasons align with self-determination theory.

A Benchmark of Modern Statistical Phasing Methods

This paper benchmarks three statistical phasing methods using synthetic diploids, finding consistent error patterns across methods and populations.

PubPlant: a continuously updated online resource for sequenced and published plant genomes

PubPlant catalogs over 1800 sequenced plant genomes, offering visualizations and phylogenetic insights, and highlights gaps in food crop genome sequencing.

Cross-talk between RNA secondary and three-dimensional structure prediction: a comprehensive study

This study benchmarks RNA 3D structure prediction models using varying accuracy 2D structures, finding that 3D models modify input base-pairing interactions and are more sensitive to false positives in 2D structures.

Results of the Protein Engineering Tournament: An Open Science Benchmark for Protein Modeling and Design

The paper introduces a protein engineering competition to benchmark computational models for protein design and characterization, with results from a pilot tournament involving seven teams.