benchmark study

Benchmarking Peptide Spectral Library Search

The paper benchmarks peptide spectral library search methods using a new dataset, finding poor recall (~70%) and varying performance across scoring functions and preprocessing scenarios.

Gut MicrobiotAware: how much do we know about gut microbiota? An international questionnaire.

This study assesses public and healthcare professionals' knowledge of gut microbiota and evaluates their understanding of its health links to improve communication strategies.

Loss of Exocytosis Protein DOC2B is an Early Event in Type 1 Diabetes Development

The paper identifies DOC2B decline as an early biomarker of presymptomatic type 1 diabetes progression, preceding traditional markers like C-peptide and HbA1c.

Comprehensive hallmark gene sequence, genomic and structural analysis of Picornavirales viruses clarifies new and existing taxa

The paper genetically classifies 525 Picornavirales genomes and 'picorna-like' viruses using multiple sequence and structural analyses, revealing support for existing families and six novel families, along with 32 new genera.

Benchmarking algorithms for RNA velocity inference

This study benchmarks 29 RNA velocity algorithms across simulated and real scRNA-seq datasets, highlighting performance variations and practical constraints.

Probing the content of semantic representations in body-selective regions

The paper investigates semantic representations in body-selective brain regions by linking natural scene captions to neural responses, finding that implied body motion is the primary contributor.

Systematic fMRI signal differences across cohorts alter lifespan trajectories of functional brain networks

The paper examines how systematic fMRI signal differences across cohorts affect lifespan trajectories of functional brain networks and shows how harmonization can mitigate these effects.

Fluorescence lifetime estimation: a practical approach using Flipper-TR FLIM

Benchmarking fluorescence lifetime estimators for the membrane mechanosensor Flipper-TR across microscopes, laser frequencies, and photon budgets establishes practical guidelines for quantifying relative lipid packing dynamics in live cells.

DoReMiTra: An R/Bioconductor data package for orchestrating the analysis of radiation transcriptomic studies

DoReMiTra provides a unified radiation transcriptomics dataset collection with standardized metadata and pre-processed data for benchmarking and integrative analysis.

CoV-UniBind: A Unified Antibody Binding Database for SARS-CoV-2

The paper introduces CoV-UniBind, a unified database of SARS-CoV-2 antibody-antigen interactions, and benchmarks models for antibody design and vaccine development.

GEfetch2R: fetching single-cell/bulk RNA-seq data from public repositories to R and benchmarking the subsequent format conversion tools

GEfetch2R downloads and processes scRNA-seq and bulk RNA-seq data from public repositories, converts formats between scRNA-seq objects, and benchmarks conversion tools.

EC-Bench: A Benchmark for Enzyme Commission NumberPrediction

EC-Bench provides a benchmark for evaluating EC number prediction methods, comparing existing approaches and highlighting task-specific performance variations.

GeneSNAKE: a Python package for benchmarking and simulation of gene regulatory networks and perturbation-induced expression data

GeneSNAKE is a Python package that simulates gene regulatory networks and perturbation-induced expression data for benchmarking, offering control over network properties and noise models.

Crossing effects in the tactile temporal order judgment task: A meta-analysis

This paper conducts a meta-analysis of the tactile temporal order judgment crossing effect, finding a large effect size but limited moderator significance.

Navigating methodological decisions: Balancing rigor and data volume of the Canadian Living Planet Index

This paper evaluates methodological choices for the Canadian Living Planet Index and explores their impact on results without advocating a single approach.

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research

CARDBiomedBench evaluates LLM performance in biomedical research using a benchmark focused on neurodegenerative diseases, revealing significant limitations in response quality and safety.

Federated Knowledge Retrieval Elevates Large Language Model Performance on Biomedical Benchmarks

This paper introduces BTE-RAG, a retrieval-augmented generation framework that improves LLM performance on biomedical benchmarks by integrating mechanistic evidence from federated knowledge sources.

Benchmarking antigen-aware inverse folding methods for antibody design.

This study benchmarks inverse folding methods for antibody design to assess their effectiveness in predicting binder sequences given a structure.

An Evidence-Grounded Research Assistant for Functional Genomics and Drug Target Assessment

Alvessa improves accuracy in functional genomics and drug target assessment by integrating evidence-based reasoning and verification.

Bento: Benchmarking Classical and AI Docking on Drug Design-Relevant Data

This study benchmarks 11 protein-ligand interaction prediction tools, showing classical and deep learning methods perform similarly on drug-like ligands, while co-folding tools excel on complex ligands and all struggle with generalization to unseen pockets.

Fitness Landscape for Antibodies 2: Benchmarking Reveals That Protein AI Models Cannot Yet Consistently Predict Developability Properties

This paper benchmarks AI models on predicting antibody developability properties using FLAb2, finding they cannot consistently predict most properties and performance depends on data and architecture.

COMPARATIVE METAGENOMIC ASSESSMENT OF SHORT- AND LONG-READ SEQUENCING TECHNOLOGIES REVEALS UNKNOWN MICROBIAL INFORMATION IN A COMPLEX ENVIRONMENTAL SAMPLE

The paper compares short- and long-read sequencing technologies in metagenomics, showing that longer short reads with optimal prep improve assembly and protein detection without needing more sequencing depth.

FHIR as a Unifying Format for Genomic Research Data Tracking, Aggregation, and Integration

The paper explores using FHIR to integrate genomic research data from multiple repositories and evaluates its effectiveness for structured data representation and aggregation.

Insights into the Datasets, Tools, and Training Needs of the AnVIL Community: 2024

This study surveys the AnVIL community to understand user needs, training preferences, and platform adoption opportunities.

PTEN deficiency linked to chromosome 10q loss leads to aggressive NF2mutant meningioma biology

The paper identifies PTEN loss as a driver of aggressive NF2 mutant meningiomas and validates a cross-species model for preclinical testing.

ProteoBench: the community-curated platform for comparing proteomics data analysis workflows

ProteoBench provides a centralized platform for comparing proteomics data analysis workflows, enabling benchmarking and community collaboration.

Cross-ancestry information transfer framework improves protein abundance prediction and protein-trait association identification

The paper develops a cross-ancestry information transfer framework to improve protein abundance prediction and protein-trait association identification in underrepresented populations.

Benchmarking Software for DDA-PASEF Immunopeptidomics

This study benchmarks DDA-PASEF immunopeptidomics software tools, showing PEAKS identifies the most immunopeptides, while database size affects performance across platforms.

Benchmarking datasets for machine learning in protein function prediction

The paper creates a benchmarking dataset for protein function prediction by curating functional annotations from UniProt, enabling training and evaluation of machine learning models.

Benchmarking Chemical, Genetic, and Cell Line Encodings for Cancer Perturbation Response Prediction

The paper benchmarks encoding methods for chemical, genetic, and cell line perturbations to predict cancer cell viability and gene dependency.