Testing The Limits: Three Ways AI Benchmarks Are Evolving
When it comes to real-world evaluation, appropriate benchmarks need to be carefully selected to match the context of AI ...
This new AI benchmark measures how much models lie
Researchers behind the MASK benchmark found that more knowledge doesn't mean more 'moral virtue.' See which model lies the ...
MIT Technology Review2d
These new AI benchmarks could help make models less biased
New AI benchmarks could help developers reduce bias in AI models, potentially making them fairer and less likely to cause harm. The research, from a team based at Stanford, was posted to the arXiv ...
People are using Super Mario to benchmark AI now
Thought Pokémon was a tough benchmark for AI? One group of researchers argues that Super Mario Bros. is even tougher.