Current passive acoustic monitoring datasets focus on single species, limiting their use for conservation and policy. We propose a collaboration between biologists and computer scientists to create a comprehensive benchmark covering various species and soundscape components. Standardized annotations, preprocessing, and baseline models will bridge this gap for a general ecosystem and animal population assessment system.