Comments (4)
Thanks for reporting the issue.
Version v0.216.0 included a change to how we perform local relative path resolution. It is possible to have a configuration where you have the base definition of a job in one file and specify target overrides in another file in another directory. Paths should always be relative to the directory of the configuration file where they are used, and before this version, this wasn't the case. The relevant PR is at #1273, in case you're interested.
The issue seems to be that we do not have location information for this path because it is specified as a variable. The previous approach assumed all paths to be relative to the location where the job was first defined. Could you let me know what you specify for json-to-bronze-path
, is this an absolute path or a relative path, and if the latter, relative to which directory?
from cli.
It is a relative path, relative to the location where the job is defined.
from cli.
I can add to that: if I put the exact same path directly into the job definition, the error does not occur.
from cli.
Thanks for confirming.
You could work around this for the time being by including a prefix:
notebook_task:
notebook_path: "./${var.json-to-bronze-path}"
The result is the same but the location information will persist. We'll work on a fix for the pure reference as well.
from cli.
Related Issues (20)
- [Feature Request] Visibility of plans or diffs during DAB deployment
- [ISSUE] `cluster_mount_info` is not a valid field HOT 1
- databricks bundle schema does no longer work with visual studio code redhat-yaml extension HOT 1
- auto:latest-lts spark_version support HOT 1
- Jobs reset doesn't overwrite ACL HOT 3
- DOCS: `databricks workspace export-dir` command is missing from the docs HOT 3
- Unable to grant read/list permission to Databricks service principal to KeyVault HOT 3
- [Feature Request] Add support for XDG directories specification
- Error: Invalid UUID string when calling databricks account metastore-assignments update WORKSPACE_ID METASTORE_ID HOT 4
- cli commands unexpectedly inferring host from bundle HOT 5
- run_if is set to "ALL_FAILED" without expressing so in config HOT 1
- `databricks clusters start` fails if cluster is already running, despite documentation to the contrary HOT 1
- Confirm if artifact paths are still needed to be prefixed with /Workspace
- [ISSUE] `databricks auth login` - Invalid Databricks Account configuration when host does not specify scheme HOT 1
- Overwriting resources to deploy per target HOT 2
- No alert email shows up if email address is provided in the next line HOT 5
- fs cp command fails when some directories in the target path do not exist - Error: no such directory HOT 2
- Create Mlflow experiment failes when exists HOT 3
- Bundle generate and git paths HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cli.