seanbell / opensurfaces Goto Github PK

Crowdsourcing pipeline and website for OpenSurfaces [SIG '13] and Intrinsic Images in the Wild [SIG '14]

Home Page: http://opensurfaces.cs.cornell.edu/

License: MIT License

Shell 0.81% C++ 14.14% Python 32.38% HTML 4.30% CoffeeScript 3.68% CMake 0.02% C 31.97% Makefile 0.15% TeX 0.53% Objective-C 0.01% Lua 0.07% MATLAB 1.04% M 0.01% CSS 4.97% JavaScript 5.92%

opensurfaces's Issues

Install fails: load_config.sh not found

./install_all.sh

This command looks for load_config.sh in the parent directory. The file is outside the context of the GitHub so it can never be found. I also don't see the file anywhere within the GitHub repository.

Thoughts? Remedy?

Installation error for file permissions.

Encountering a permission error for .../virtualenv-15.1.0.egg-info/top_level.txt during installation.

Details posed in a question of StackOverflow.

http://askubuntu.com/questions/871503/i0errorerrno-13-permission-denied-for-a-txt-file

pyleargist==2.0.5 is broken in pypi

pyleargist==2.0.5 in pypi seems broken.

It's missing src/leargist.pxd. This file is in their repo though.
bitbucket src/leargist.pxd

Recommended workaround: update the install_python.sh script to install pyleargist from the bitbucket repo instead of pypi. I'll contact the author and file a ticket with them.

Installing collected packages: pyleargist
  Running setup.py install for pyleargist
    cythoning src/leargist.pyx to src/leargist.c

    Error compiling Cython file:
    ------------------------------------------------------------
    ...
    from libc.stdlib cimport free

    from cpython cimport PyObject, Py_INCREF
    import cython

    cimport leargist
           ^
    ------------------------------------------------------------

    src/leargist.pyx:6:8: 'leargist.pxd' not found
    building 'leargist' extension
    x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/opensurfaces/venv/local/lib/python2.7/site-packages/numpy/core/include -Ilear_gist -I/usr/include/python2.7 -c lear_gist/standalone_image.c -o build/temp.linux-x86_64-2.7/lear_gist/standalone_image.o -DUSE_GIST -DSTANDALONE_GIST
    x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/opensurfaces/venv/local/lib/python2.7/site-packages/numpy/core/include -Ilear_gist -I/usr/include/python2.7 -c lear_gist/gist.c -o build/temp.linux-x86_64-2.7/lear_gist/gist.o -DUSE_GIST -DSTANDALONE_GIST
    x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/opensurfaces/venv/local/lib/python2.7/site-packages/numpy/core/include -Ilear_gist -I/usr/include/python2.7 -c src/leargist.c -o build/temp.linux-x86_64-2.7/src/leargist.o -DUSE_GIST -DSTANDALONE_GIST
    src/leargist.c:1:2: error: #error Do not use this file, it is the result of a failed Cython compilation.
     #error Do not use this file, it is the result of a failed Cython compilation.
      ^
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    Complete output from command /opensurfaces/venv/bin/python -c "import setuptools, tokenize;__file__='/opensurfaces/venv/build/pyleargist/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-3yNTeO-record/install-record.txt --single-version-externally-managed --compile --install-headers /opensurfaces/venv/include/site/python2.7:
    running install

running build

running build_ext

cythoning src/leargist.pyx to src/leargist.c



Error compiling Cython file:

------------------------------------------------------------

...

from libc.stdlib cimport free



from cpython cimport PyObject, Py_INCREF

import cython



cimport leargist

       ^

------------------------------------------------------------



src/leargist.pyx:6:8: 'leargist.pxd' not found

building 'leargist' extension

creating build

creating build/temp.linux-x86_64-2.7

creating build/temp.linux-x86_64-2.7/lear_gist

creating build/temp.linux-x86_64-2.7/src

x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/opensurfaces/venv/local/lib/python2.7/site-packages/numpy/core/include -Ilear_gist -I/usr/include/python2.7 -c lear_gist/standalone_image.c -o build/temp.linux-x86_64-2.7/lear_gist/standalone_image.o -DUSE_GIST -DSTANDALONE_GIST

x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/opensurfaces/venv/local/lib/python2.7/site-packages/numpy/core/include -Ilear_gist -I/usr/include/python2.7 -c lear_gist/gist.c -o build/temp.linux-x86_64-2.7/lear_gist/gist.o -DUSE_GIST -DSTANDALONE_GIST

x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/opensurfaces/venv/local/lib/python2.7/site-packages/numpy/core/include -Ilear_gist -I/usr/include/python2.7 -c src/leargist.c -o build/temp.linux-x86_64-2.7/src/leargist.o -DUSE_GIST -DSTANDALONE_GIST

src/leargist.c:1:2: error: #error Do not use this file, it is the result of a failed Cython compilation.

 #error Do not use this file, it is the result of a failed Cython compilation.

  ^

error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

----------------------------------------
Cleaning up...
Command /opensurfaces/venv/bin/python -c "import setuptools, tokenize;__file__='/opensurfaces/venv/build/pyleargist/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-3yNTeO-record/install-record.txt --single-version-externally-managed --compile --install-headers /opensurfaces/venv/include/site/python2.7 failed with error code 1 in /opensurfaces/venv/build/pyleargist
Storing debug log for failure in /root/.pip/pip.log

Errors of creating a postgresql super user (with virtualbox)

Does anyone know how to solve the problem when running install_all.sh:
OS: Ubuntu 18
Version: Postgresql 10 (cannot get resources for 9.1 as suggested)
Issue:
An error occurs when running the command
sudo pg_ctlcluster 10 label material start
Here is the error message:
Config owner (xxxx:1000) and data owner (postgres:126) do not match, and config owner is not root.

The installation stops when running the following command
sudo -u postgres psql -p 5433
Here is the error message:

psql: could not connect to server: No such file or directory
Is the server running locally and accepting
connections on Unix domain socket "/var/run/postgresql/.s/PGSQL.5433"?

HTTPS certificate verification failed

When we try to connect MTurk, i.e. type

./manage.py mtbalance

python shows that HTTPS certificate verification failed.

Fetching account balance...
Account balance:
Traceback (most recent call last):
  File "./manage.py", line 14, in <module>
    execute_from_command_line(sys.argv)
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 399, in execute_from_command_line
    utility.execute()
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 392, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/django/core/management/base.py", line 242, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/django/core/management/base.py", line 285, in execute
    output = self.handle(*args, **options)
  File "/home/jason/Desktop/opensurfaces/server/mturk/management/commands/mtbalance.py", line 25, in handle
    print 'Account balance:', get_mturk_connection().get_account_balance()
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/boto-2.6.0.dev0-py2.7.egg/boto/mturk/connection.py", line 69, in get_account_balance
    ('OnHoldBalance', Price)])
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/boto-2.6.0.dev0-py2.7.egg/boto/mturk/connection.py", line 762, in _process_request
    response = self.make_request(request_type, params, verb='POST')
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/boto-2.6.0.dev0-py2.7.egg/boto/connection.py", line 952, in make_request
    return self._mexe(http_request)
  File "/home/jason/Desktop/opensurfaces/venv/local/lib/python2.7/site-packages/boto-2.6.0.dev0-py2.7.egg/boto/connection.py", line 872, in _mexe
    raise e
ssl.SSLError: [Errno 1] _ssl.c:504: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed

It looks like python's the root certificate is too old for MTurk. I try to upgrade the certifi package by

pip install git+https://github.com/certifi/python-certifi --upgrade

But it does not solve the problem. One solution is just disable SSL verification for boto, but it is not secure for production. Anyone has some idea?

Related issues:

Module pyrabbit2

Hi!

Try this module https://github.com/deslum/pyrabbit2. This is fork pyrabbit with new features and support

MTURK_CONFIGURE_QUALIFICATIONS needs to be defined

Somewhere in config/settings.py, MTURK_CONFIGURE_QUALIFICATIONS needs to be defined if you set MTURK_PIPELINE_ENABLE = True.

ppa:richarvey/nodejs isn't available for ubuntu 14.04 and later

Current LTS release of Ubuntu is 14.04. ppa:richarvey/nodejs is only available from 12.04 to 13.10.

Readme states:
"Ubuntu: If you are on Ubuntu 12.04 or later, you can run install_all.sh to install all components (will use ~15G disk space)."

Recommended update 1:
"Ubuntu: If you are on Ubuntu 12.04 to 13.10, you can run install_all.sh to install all components (will use ~15G disk space)."

Recommended update 2:
Detect the ubuntu distro and if 14.04 or later, install the nodejs package from the official repo and symlink nodejs to node.

Recommended update 3:
Install using nodesource's instructions instead of the official ubuntu repo. https://github.com/nodesource/distributions

Specify template during createdb

I ran the existing install_postgres.sh script.

createdb: database creation failed: ERROR:  new encoding (UTF8) is incompatible with the encoding of the template database (SQL_ASCII)
HINT:  Use the same encoding as in the template database, or use template0 as template.

Recommended update:
Change

createdb -p $DB_PORT --owner=$DB_USER --encoding=UTF8 $DB_NAME

createdb -p $DB_PORT --owner=$DB_USER --encoding=UTF8 --template=template0 $DB_NAME

I can follow up with a PR if you're interested.

The webpage is inaccessiable

It seems that the webpage http://opensurfaces.cs.cornell.edu/ is down. Could you please check it? Thank you.

sudo -v causes problems in EC2 ubuntu

$ sudo -v
[sudo] password for ubuntu:

but no password will make it happy.

Update message for MTURK_ACCEPT_SANDBOX_HITS

So that it is more obvious how to disable/enable it

Incorrect format string

https://github.com/seanbell/opensurfaces/blob/master/server/mturk/models.py#L237

base_url = 'http://' % settings.SERVER_IP

Missing the string placeholder. Change to either

base_url = 'http://%s' % settings.SERVER_IP

base_url = 'http://' + settings.SERVER_IP

Although, it doesn't really matter anymore since mturk outright rejects HITs that specify a URL with http://.

Update commission to new mturk pricing model

Was 10%

Now: 20% or 40%

mturk worker ids in code

https://github.com/seanbell/opensurfaces/blob/master/server/shapes/experiments.py#L350

You have user IDs embedded in the code.

problems with install with ubuntu 12.4.5

Hallo,

I have ubuntu 12.4.5 installed on my virtual box, when I run ./install_all.sh, there is several problems.
For example, the version of postgresql 9.1 is no more available and we can no more install ipython-notebook via sudo apt-get etc, so I changed the "requirements-ubuntu.txt" and "config.sh" for the install,
now I'm facing another problem, django can't connect to server for user labelmaterial, even thought I modified some parameters of setting.py and pg_hba.conf, I don't know if thoes problems come from the modifications that I made.
I saw there is a commit 4 months ago in readMe that you said that the install now works with ubuntu 12.4.5, so that confuse me so much, do you have some ideas?

Thanks for your time

seanbell / opensurfaces Goto Github PK

opensurfaces's Issues

Install fails: load_config.sh not found

Installation error for file permissions.

pyleargist==2.0.5 is broken in pypi

Errors of creating a postgresql super user (with virtualbox)

HTTPS certificate verification failed

Module pyrabbit2

MTURK_CONFIGURE_QUALIFICATIONS needs to be defined

ppa:richarvey/nodejs isn't available for ubuntu 14.04 and later

Specify template during createdb

The webpage is inaccessiable

sudo -v causes problems in EC2 ubuntu

Update message for MTURK_ACCEPT_SANDBOX_HITS

Incorrect format string

Update commission to new mturk pricing model

mturk worker ids in code

problems with install with ubuntu 12.4.5

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent