Giter Club home page Giter Club logo

silic's Introduction

SILIC

Sound Identification and Labeling Intelligence for Creatures

SILIC

Goal

The goal of SILIC is to build an autonomous wildlife sound identification system which can help to monitoring the population status and trends of terrestrial vocal animals in Taiwan by using the data of Passive Acoustic Monitorings (PAMs).

Objects

  • Object 1: Extract robust species, sound class, time and frequency information from various and complex soundscape recordings.
  • Object 2: Model can be constructed using a dataset as small as possible, and the training audios can be easily and quickly acquired.
  • Object 3: Most species of terrestrial vocal wildlife in Taiwan should be included in model, especially those are hard to be detected with survey methods other than PAM.

Model

SILIC uses Python language and yolov5 package (Glenn Jocher et al., 2020) to construct an object detection model. Additional pydub (Robert, 2011), nnAudio (Cheuk et al., 2020) and matplotlib (Hunter, 2007) libraries were imported for audio signal processing and Time–Frequency Representation (TFR).

Datasets

Install

Tutorials

  • Model Weights:
    • ./model/exp12 , including 27 sound classes of 16 species, updated on Apr. 2021
    • ./model/exp14 , including 74 sound classes of 52 species, updated on Jul. 2021
    • ./model/exp18 , including 194 sound classes of 147 species, updated on Oct. 2021
    • ./model/exp20 , including 213 sound classes of 163 species, updated on Dec. 2021
    • ./model/exp24 , including 253 sound classes of 169 species, updated on Aug. 2022
    • ./model/exp27 , including 279 sound classes of 183 species, updated on May. 2023
    • ./model/exp28 , including 284 sound classes of 184 species, updated on Jun. 2023
    • ./model/exp29 , including 284 sound classes of 184 species, updated on Jul. 2023
  • Scripts of detection: ./silic.ipynb
  • Demo video of inference results of the SILIC on detecting an camera trap video:
    • Demo video
  • UI tool: silic-ui.py
    • SILIC-UI

Audio Sources

Publication

Application

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.