A team of technology experts issued a global call on Monday (Sept 16) seeking the toughest questions to pose to artificial intelligence systems, which increasingly have handled popular benchmark tests like child’s play. Dubbed ‘Humanity’s Last Exam,’ the project seeks to determine when expert-level AI has arrived. It aims to stay relevant even as capabilities advance in future years, according…
PHOTO: Reuters file PUBLISHED ONSeptember 17, 2024 3:23 AM A team of technology experts issued a global call on Monday (Sept 16) seeking the toughest questions to pose to artificial intelligence systems, which increasingly have handled popular benchmark tests like child’s play. The call comes days after the maker of ChatGPT previewed a new model, known as OpenAI o1, which “destroyed the most popular reasoning benchmarks,” said Dan Hendrycks, executive director of CAIS and an advisor to Elon Musk’s xAI startup.
