jython re expression doesn't work about openrefine HOT 2 CLOSED

From [email protected] on May 17, 2010 03:05:54:
I've managed to narrow it down to the special hyphen character in the regex, but I'm
not yet sure why that causes the code to fail. The actual exception thrown is this:

Traceback (most recent call last):
File "", line 5, in _temp_
File "/home/vishal/Workspace/metaweb/freebase-gridworks-read-
only/lib/jython/re.py", line 142, in search
return _compile(pattern, flags).search(string)
File "/home/vishal/Workspace/metaweb/freebase-gridworks-read-
only/lib/jython/re.py", line 241, in _compile
raise error, v # invalid expression
sre_constants.error: nothing to repeat

I'm still investigating.

from openrefine.

From [email protected] on May 17, 2010 04:51:06:
Raymond, I found that this works

import re
g = re.search(ur"\u2014 (._),\s_BWV", value)
return g.group(1)

Could you check? Note the unicode character as well as the ur prefix. Unfortunately, I don't know a quick way
to encode unicode characters within jython code without writing a parser for it. So right now you'd have to do
the encoding yourself. I did this by first using GEL on the expression "—".unicode(), which gives 8212, and
then converting that from decimal to hex.

from openrefine.