Giter Club home page Giter Club logo

classifying-quasars-galaxies-stars-using-photometry's Introduction

Skills demonstarted:

(pandas, numpy, tensorflow/keras, scikit-learn & matplotlib)

Classifying-Quasars-Galaxies-Stars-using-Photometry

Note: There are 2 notebooks photometry.ipynb (models were initially created and ensembled here) and production.ipynb (already saved models were loaded and used in production)

I have tried to classify Quasars, Galaxies and Stars using photometric data.

Motivations:

Large catalogs of unlabelled stellar objects are available. Labelling these stellar objects is important for a number of reasons. E.g: for statistical poulation analyses and for testing cosmological models to name a few. Although these stellar objects can be classified by analyzing their optical spectrums but that process is time consuming. Next generation of telescopes will increase the quantity of available unlabelled data even more! That's why I have tried to use the photometric data and a combination of machine learning approaches to label the stellar objects.

Table of Contents photometry.ipynb

1. Data Cleaning & Data Preparation

  • Loading data as a Pandas Data Frame
  • Selecting relevant columns/features
  • Removing unphysical records/rows
  • Undersampling
  • Creating training, validation and test splits
  • Converting data into numpy arrays
  • Normalizing The Data

2. Data Visualisation

  • Principal Component Analysis

    • Intercative 3d scatter plot

3. Data Classification

  • Unsupervised Learning

    • Gaussian Mixture Model - Clustering
      • Choosing the best Permutation
  • Supervised Learning

    • Neural Network
    • XGBoost
    • Random Forest

4. Model Ensembling

  • Simple-Random-Search for weight optimization

5. Conclusions

6. What's Next?

  • How can we achieve this?
  • Possible Limitations

Results

The results were:

  • For objects correctly_classified as Quasars, 90.3% of them had a probability greater than 0.9 of being a Quasar.
  • For objects correctly_classified as Galaxies, 86.7% of them had a probability greater than 0.9 of being a Galaxy.
  • For objects correctly_classified as Stars, 99.6% of them had a probability greater than 0.9 of being a Star.

Screenshots from the notebook production.ipynb:

4 1 2 3

Features Used

Feature Name Description
u Ultraviolet filter in the photometric system
g Green filter in the photometric system
r Red filter in the photometric system
i Near Infrared filter in the photometric system
z Infrared filter in the photometric system
redshift Redshift value based on the increase in wavelength
class Object class (galaxy, star, or quasar object)

classifying-quasars-galaxies-stars-using-photometry's People

Contributors

ansimran avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.