esheldon / desdb Goto Github PK

stumbled over this today, otherwise documentation is clear

The describe method does not work if you need to use a qualified name like joezuntz.im3shape_v7_r to access the catalog. For example, you can't use either conn.describe("joezuntz.im3shape_v7_r") or conn.describe("im3shape_v7_r") unless you are me.

Currently sync.py still uses the python2 print statement as opposed to print_function, which makes the module import fail

A version is in place but needs testing.

So in the setup.sh script for the mac osx deps (http://www.cosmo.bnl.gov/www/esheldon/code/misc/des-oracle-macosx-x86-64-v3.tar.gz), I needed to export some additional variables like this

export DYLD_LIBRARY_PATH
export LD_LIBRARY_PATH 
export C_INCLUDE_PATH 
export PATH 
export PYTHONPATH

Hi Erin,

I am having a problem with the above.

I downloaded

http://www.cosmo.bnl.gov/www/esheldon/code/misc/des-oracle-macosx-x86-64-v2.tar.gz

Am I missing a dependency?

Your README mentions oracle libraries but I assumed your tarball had everything.

Thanks Richard

rgm> ./do-install install
installing to: install
/data/superstore/rgm/soft/des/des-oracle-macosx-x86-64-v2/instantclient_10_2 /data/superstore/rgm/soft/des/des-oracle-macosx-x86-64-v2
/data/superstore/rgm/soft/des/des-oracle-macosx-x86-64-v2
installing oracle client in install/instantclient_10_2
compiling cx_Oracle
Traceback (most recent call last):
File "setup.py", line 126, in
raise DistutilsSetupError(messageFormat % userOracleHome)
distutils.errors.DistutilsSetupError: Oracle home (install/instantclient_10_2) does not refer to an 9i, 10g or 11g installation.
installing cx_Oracle to install/
cp: cx_Oracle.so: No such file or directory

Hi Erin - thanks for this package. Just heard about it last week in Berkeley.

Can you add column comments when describing tables? (Perhaps as an option so that the results are still < 80 characters?)

I could take a crack at it and give you a PR, but I wanted to check in with you first.

Hi Erin, I think there is a missing single quote in line 631 and also 635.

In [1]: import desdb
File "/home/rgm/lib/python/desdb/files.py", line 631
'name': '$RUN-$EXPNAME-$CCD-$FILETYPE.$EXT}
^
SyntaxError: EOL while scanning string literal

Adding a single quote after $EXT fixes it.

r.

The new port is the default one, so remove port altogether

Hi Erin,

I am exploring the use of des-sync-coadd for the Y1C1 release.

An example download is:
https://desar2.cosmology.illinois.edu:7443/DESFiles/desardata/OPS/coadd/20130319000001_DES0025-4249/coadd

des-sync-coadd --debug 20130319000001_DES0025-4249

I have assigned $DESDATA and $DESREMOTE

gives me an error that ends in:

File "/Library/Frameworks/EPD64.framework/Versions/7.3/lib/python2.7/site-packages/desdb/files.py", line 694, in _expand_desvars
return expand_desvars(url, **keys)
File "/Library/Frameworks/EPD64.framework/Versions/7.3/lib/python2.7/site-packages/desdb/files.py", line 838, in expand_desvars
"be sent: '%s'" % string_in)
ValueError: coadd_run keyword must be sent: '$DESDATA/$DESPROJ/coadd/$COADD_RUN/coadd'

The table I used before is not available.

Dear Erin,

This is a security related feature request for the desdb package to support reading
username and password from a ini/config file. This also helps with portability.

DES trivialAccess now supports 'hiding' your DESDB password in a Windows ini format file that defaults to ~/.desservices or a filename can be specified.

Also it checks the file protection reporting:

"Please make your service access file unreadable and unwritable by group and other
try: Go to home directory, chmod og-rw .desservices.ini"

trivialAccess -f [filename] -s[section]

see: here

e.g.

[rgm]
server ='server'
user = 'username'
passwd = 'password'
name = 'name'
port = 'port'

trivialAccess -s rgm

read my username and password from the default file in the section [rgm]

Cheers Richard

There's now a destest database at NCSA in addition to desoper. It would be nice to be able to query it using des-query. Should be a couple-line change.