Youth build free app to help identify and log Singapore’s fish – Asia News Network

To build the app’s computer vision model, Sng, who is the lead developer of the mobile app, collated and vetted more than 90,000 photos of fish species found near Singapore and neighbouring waters. These were sourced from international databases, society members and his own photos.

It took two months to train the model with his dataset until it reached an 82.7% accuracy rate, said Sng, who was working on this while studying. He noted that it is more accurate than the model created by the US-based flora and fauna database iNaturalist, which has an accuracy rate of about 80% for fish across the world.

Novice anglers can sometimes mistake dangerous fish for harmless ones or lack awareness of sustainable fishing practices, the developers told The Straits Times.

This prompted them to include a pop-up feature that alerts users on what to do if a scanned fish is a protected, rare or harmful species. For example, if an endangered fish is caught, users are advised to release it.

To minimise the risk of incorrect identifications, the app shows the top five predictions of the scanned fish’s identity, ranked according to how similar they are to the specimen. Users then finalise the identity of species by selecting one of the options.

For convenience in the field, the app uses a lightweight offline model for quick identifications when mobile connections are spotty, alongside a more accurate online version.

To reel recreational anglers in, the app also includes tide data to indicate the best times to go fishing. A fish encyclopaedia was also included, added fellow developer Guan Chen Di, a 22-year-old computer science student at Nanyang Technological University.

“One of the most complex hurdles we faced was how to maximise and condense a variety of information onto a tiny phone screen,” he said, adding that the team figured out how to seamlessly fit the image, species and catch method into a single view.

The SGFish app built by Ichthyological Society of Singapore volunteers. PHOTO: BRIAN SNG/THE STRAITS TIMES

In future updates, the developers hope to make the app available on the Google Play Store and incorporate the initial Telegram bot’s popular gamification elements, such as a high-score board that recognises users who record the highest diversity of unique species.

Fish biologist Jeffrey Kwik said citizen science initiatives like the SGFish app can help supplement fish surveys involving diving or snorkelling, which rely heavily on good water visibility.

Spotting and counting fish populations visually in Singapore is particularly challenging owing to the Republic’s murky waters.

“This is exacerbated for well-camouflaged species or species that find refuge in associated marine habitats like seagrass and corals, which are even harder to spot,” said the associate professor at the Singapore Institute of Technology.

Records from anglers are particularly useful for covering large survey areas, Kwik added, as gathering detailed, wide-ranging data through official surveys requires significant resources.

Even with potential biases from hook sizes or bait types, data from anglers is useful for supplementing species lists and tracking the distribution of fish, he said.

As the community logs more observations, ISS co-founder Andriel Cheong hopes the database built from these records can inform environmental impact assessments, giving the authorities a clearer picture of marine biodiversity when planning coastal developments.

Beyond recreational fishing and divers, the team hopes the public will use the app to learn about fishes.

“We encourage the average person to test it out on everyday sightings of fish, such as those you see in the market, just to learn more about the varieties of fish that can be found in our local markets,” said Cheong, noting that this could promote more conscious consumption of seafood.

The app joins a growing list of community-led wildlife databases in Singapore.

In 2021, for instance, a group of seasoned birders and scientists was formed to review records of species rarely encountered in Singapore and made such sightings available in the Singapore Bird Database.