Giter Club home page Giter Club logo

lmrs's Introduction

LMRS: Learned Manifold Random Search

This code repository includes the source code for the Paper:

Learning to Guide Random Search
Ozan Sener, Vladlen Koltun
International Conference on Learning Representations (ICLR) 2020 

The experimentation framework is based on Ray and extends the implementation of ARS.

The source code is released under the MIT License. See the License file for details.

Please note that this is the minimal implementation of the LMRS for MuJoCo, we will update the repo with the additional code for XFoil, Pagmo, and synthetic experiments.

Requirements and References

The code uses the following Python packages and they are required: tensorboardX, pytorch>1.0, click, numpy, torchvision, tqdm, scipy, Pillow, ray

The code is only tested in Python 3 using Anaconda environment.

If you want to run the MuJoCo experiments, install OpenAI Gym (version 0.9.3) and MuJoCo(version 0.5.7) following the instructions.

If you want to run the AirFoil experiments, install XFoil and make sure the binary is in the $PATH.

If you want to run the continous optimization benchmark, install Pagmo following esa/pagmo2.

Usage

Experiment specific parameters are provided as a json file. See the hc.json for an example.

To run an example experiment, use the command:

python mujoco_experiments.py --param_file=./hc.json

Contact

For any question, you can contact [email protected]

Citation

If you use this codebase or any part of it for a publication, please cite:

@inproceedings{ICLR2020_Sener_Koltun,
title={Learning to Guide Random Search},
author={Ozan Sener and Vladlen Koltun},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=B1gHokBKwS}
}

lmrs's People

Contributors

ozansener avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

lmrs's Issues

Testing on LSGO / BBOB / others ?

Your work is super interesting! Would it be possible to test it on standard benchmarks in black-box optimization ?

For example BBOB https://coco.gforge.inria.fr/
or LSGO (large-scale global optimization) ?

We have all of them including in our benchmark suite in Nevergrad (https://github.com/facebookresearch/nevergrad).

If your black-box optimization code can be extracted and applied to a generic black-box function that can be applicable to a wide range of problems way beyond linear control. I'm just not sure if there is a strong reason for which applying your code to classical benchmarks ?

If your code is packaged in PyPi and there is an example of how to optimize lambda x: np.norm(x) with it, I can do the rest by myself.

Missing files

Hi !

I was looking to your implement but I have not tested it yet. It seems that the file random_search/synthetic_environment.py is missing but required here. Also, the method update_variance_reduced of MujocoRandomSearchLearned is called here but undefined.

Best,
Alexis

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.