Giter Club home page Giter Club logo

lenslesslearning's Introduction

Learning for lensless mask-based Imaging

This code is based on the paper: "Learned reconstructions for practical mask-based lensless imaging" available here: (https://www.osapublishing.org/oe/fulltext.cfm?uri=oe-27-20-28075&id=420747)

Setup:

Clone this project using:

git clone https://github.com/Waller-Lab/LenslessLearning.git

The dependencies can be installed by using:

conda env create -f environment.yml
source activate lensless_learning

In addition, the LPIPS package is needed (this is used in the loss function during training). Instructions for installing LPIPS can be found here: (https://github.com/richzhang/PerceptualSimilarity)

Loading in the models

The pre-trained models can be downloaded here

Jupyter Notebook: pre-trained reconstructions.ipynb

  • Loads in the pre-trained models and runs reconstructions on sample lensless images.
  • Initializes un-trained models and shows output images before training. Changes model parameters to the pre-loaded parameters and shows sample reconstructions

Dataset

lenslesslearning's People

Contributors

monakhova avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

lenslesslearning's Issues

ImportError: cannot import name 'dist_model'

Thanks for sharing the pre-trained model.
I'm very interested in this work but are facing a problem when running the code.
Below is the error that occurs.

I'd really appreciate it if you could help me solve this problem.
Many thanks!

ImportError Traceback (most recent call last)
in ()
9
10
---> 11 from utils import *
12
13 sys.path.append('models/')

/content/drive/My Drive/LenslessLearning-master/utils.py in ()
234 import sys
235 sys.path.append('/home/kristina/PerceptualSimilarity')
--> 236 from models import dist_model as dm
237 from admm_helper_functions_torch import *
238

ImportError: cannot import name 'dist_model'

DiffuserCam images of natural objects

Thanks for sharing the code as well as the training dataset.
I've read your papers and I'm really interested in your work. I noticed that you also tested your network on objects in the wild captured with DiffuserCam but I could find these data on your website.
I'm wondering if these measurements can also be shared. It would be a great help!

Thank you so much!

How to calculate the homography transform?

Hello, in Chapter 5 of paper "Learned reconstructions for practicalmask-based lensless imaging", it is mentioned that a homography transform is needed to co-align both cameras’ coordinate systems when capturing real dataset. Could you please provide more details on how to calculate this homography transform?

nan in training

since there is no code for training, I write the training code by myself using DiffuserCam Dataset, but the parameter le_admm.mu2 will get a gradient of nan during the training process, thus causing the failure in training. I’m not sure whether there are something wrong with my training code, so can you public your training code?

dataset division

I want to do a comparision to the result of le-admm-unet, but I don’t know division of training set and test set in the dataset for the given trained model.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.