Recent Talks
July, 2026. Toward Safer Evaluation and Training of Increasingly Capable AI Systems. NTU AICore - RIKEN AIP Joint Workshop (online).
Apr, 2026. Reliable Model Evaluation Without Full Ground Truth. Statistical Safeguarding Workshop 2026, Tokyo. [workshop page]
Mar, 2026. Reliable Model Evaluation Without Full Ground Truth. The 2nd RIKEN AIP - IIT Hyderabad Joint Workshop (online).
Aug, 2025. Ensuring Contamination-Robustness in LLM Benchmark Design. Department of Computer Science, Hong Kong Baptist University, Hong Kong. [event page]
Aug, 2025. EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statements (in Japanese). Weights & Biases Japan's Monthly Meetup, Tokyo. [event page]
July, 2025. How Can I Publish My LLM Benchmark Without Giving the True Answers Away? MemFM@ICML2025 workshop, Vancouver, Canada. [workshop page]
July, 2025. Data-Centric Machine Learning via Bayes-accuracy Estimation. Sydney - RIKEN AIP Joint AI Workshop, Sydney, Australia. [workshop page]
July, 2025. Ensuring Contamination-Robustness in LLM Benchmark Design. School of Computer Science, University of Sydney, Sydney, Australia.
May, 2025. How Can I Publish My LLM Benchmark Without Giving the True Answers Away? International Symposium on Trustworthy Foundation Models, MBZUAI, Abu Dhabi, UAE. [symposium page]
Nov, 2024. The evolving role of human supervision in modern AI systems. International Workshop on Weakly Supervised Learning 2024, University of Queensland, Brisbane, Australia. [workshop page]
Oct, 2024. Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classification. Tokyo-Oulu Joint Symposium on Human-AI Interaction, Tokyo. [symposium page]
July, 2024. How and how far can we supervise AI systems? ENSAI/CREST, Rennes, France.