Building Bridges: A Dataset for Evaluating Gender-Fair Machine Translation into German
Paper • 2406.06131 • Published
AI & ML interests
JAX, Flax, TPU, 🤗
Recent Activity
View all activity
g8a9
authored 4
papers 11 days ago
Movie Facts and Fibs (MF$^2$): A Benchmark for Long Movie Understanding
Paper • 2506.06275 • Published
Ouvia: A User-centered Framework for Measuring Usability of Speech Translation in Real-World Communication Scenarios
Paper • 2606.06177 • Published
AMALIA Technical Report: A Fully Open Source Large Language Model for European Portuguese
Paper • 2603.26511 • Published
shahrukhx01
authored a
paper about 1 month ago
amphora
authored 14
papers about 2 months ago
Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?
Paper • 2402.11597 • Published
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
Paper • 2406.05761 • Published • 3
BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation
Paper • 2506.00482 • Published • 8
From KMMLU-Redux to KMMLU-Pro: A Professional Korean Benchmark Suite for LLM Evaluation
Paper • 2507.08924 • Published • 18
Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thought
Paper • 2510.04230 • Published • 27
Revisiting the Uniform Information Density Hypothesis in LLM Reasoning Traces
Paper • 2510.06953 • Published • 9
Ko-PIQA: A Korean Physical Commonsense Reasoning Dataset with Cultural Context
Paper • 2509.11303 • Published
What Users Leave Unsaid: Under-Specified Queries Limit Vision-Language Models
Paper • 2601.06165 • Published • 16
Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures
Paper • 2510.24081 • Published • 24
Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math
Paper • 2602.06291 • Published • 24
KMMMU: Evaluation of Massive Multi-discipline Multimodal Understanding in Korean Language and Context
Paper • 2604.13058 • Published • 2
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
Paper • 2605.09063 • Published • 82
Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback
Paper • 2605.17448 • Published • 19
ResearchMath-14K: Scaling Research-Level Mathematics via Agents
Paper • 2605.28003 • Published • 50
amphora
submitted a
paper to Daily Papers about 2 months ago