Comments (4)
Ciao @usbrandon the behavior seems to be correct and not related to any issue in Apache Hop, according to what we are reading in this thread duckdb file being used by another process.
We need to perform further investigations to understand what we can do to overcome this limitations.
from hop.
Looking at what I detailed in previous message, to have things working we have 2 options that must be managed:
- If we want to RW the DuckDB database we must only use a single connection. And that is solved by using a pipeline run configuration that is defined as transactional because that is the only way to achive a single connection per pipeline
- If we only want to Read the DuckDB database we can use a normal pipeline run configuration BUT we must open the connection in read only mode by adding the appropriate flag to connection configuration as shown in the image below.
This option will work immediately after the feature #3661 will be applied so that the parameters specified will be applied in the connection in the proper way
from hop.
My bad, the idea of using transactional run configuration to solve the file locking problem seems not to be a valuable solution because the problem still remain. On the other side, the suggestion on using Read Only connections is valuable.
from hop.
The DuckDB file seems to remain locked only when an exception is raised during the execution of the table output. I'm trying to understand what's the difference.
from hop.
Related Issues (20)
- [Task]: Fix typo for "Variable substitution" tool-tip
- [Task]: Azure Move Files - Support of tests against Azurite testcontainer or actual Azure on the cloud HOT 1
- [Task]: Bump jandex from 3.1.6 to 3.1.8
- [Bug]: Issue with tests in hop-plugins-misc-git on Windows
- [Bug]: RedshiftBulkLoaderMeta has an incorrect `groupKey` in the `@HopMetadataAttribute` for the database field. HOT 1
- [Task]: Weblate is not referenced anywhere on the site HOT 2
- [Bug]: Issue with hop-assemblies-samples HOT 4
- [Bug]: Table output insert statement does not quote field names in INSERT statement HOT 3
- [Task]: Update Documentation contribution guide
- [Task]: Bump org.eclipse.platform
- [Task]: Clean up of dialog constructors for actions and transforms
- [Task]: Remove unused class ModPartitionerDialog
- [Feature Request]: Additional checks from the Filter Transform to multiple copies transforms
- [Bug]: Search Operational Field Syncronize after merge HOT 2
- [Feature Request]: Identify where the GUI is to open objects in the same location.
- [Bug]: Hop Web is missing the JDBC drivers HOT 1
- [Bug]: Delete transform + Metadata injection - missing parts and translations
- [Feature Request]: Delete transform - show evidence of deleted rows
- [Feature Request]: Flag to enable data received from another transform in Table Input HOT 2
- [Feature Request]: Move files in File Explorer
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hop.