mikhail-dremio / dremio-cloner Goto Github PK

I have found that whenever self._logger is logging things and attempting to log something that is happened to a named container or entity self._utils.get_entity_desc(container), it throws a int type error

I think this has something to do with how self._logger is initialized
self._logger = DremioClonerLogger(self._config.max_errors, self._config.logging_verbose)

When the debug.info is being sent it sees the self._config.max_errors instead of the "info" message?

I had to comment out all the logging commands to get it to run.

I'm using Python 3.8.5 windows

When moving from enterprise AWS to community docker, the reflections API call is not supported but is called in the python script on DremioWriter.py line 74
console log

    self._existing_reflections = self._dremio_env.list_reflections()['data']
TypeError: 'NoneType' object has no attribute '__getitem__'

log of ERROR

ERROR:2020-11-09 17:43:57,763:list_reflections: received HTTP Response Code 405 for : <api/v3/reflection/> errorMessage: Something went wrong. Please check the log file for details, see https://docs.dremio.com/advanced-administration/log-files.html moreInfo: HTTP 405 Method Not Allowed

to get around this I had to change {"reflection.process_mode": "create_overwrite"}, to {"reflection.process_mode": "skip"},

I'm not sure if it's related but to get it to run we also had to change the space.process_mode row in the config.json from {"space.process_mode":"update"}, to {"space.process_mode":"create_overwrite"},