Comments (4)
Hi @OnishiMasanori,
I see you are processing a single file but the input value in your config file points to the root of F:
, put the path of the file you want to process instead.
Moreover, I advice you to create separate folders for your input, output and temp files e.g. create an input folder to store your input files, an output folder for your output files and a temp folder for your temp files.
from pdal-parallelizer.
It would also be nice if I could see the content of your pipeline.json file
from pdal-parallelizer.
Thanks for your quick reply.
- write the filepath for input
- create a empty folder for temp
succeeded to process a little bit.
However, now I'm facing another error.
File "stringsource", line 2, in pdal.libpdalpython.PyPipeline.reduce_cython
TypeError: no default reduce due to non-trivial cinit
In temp folder, "temp__-274_-309.pickle" was made, but the file size is 0 byte.
Pipeline.json is simple with only read and write.
[{
"type": "readers.las",
"filename": "C:/inputfilepath/input.las"
},
{
"type": "writers.las",
"filename": "C:/outputfilepath/output.las"
}]
Other infomation
Input file size: 2GB
Python: 3.7 (anaconda)
pdal process including readers.las can work when I apply in simple pdal process of pipeline.execute().
other parameter settings such as n_workers, threads_per_worker cannot solve the problem.
Thanks for your advice.
from pdal-parallelizer.
@OnishiMasanori Can I see your config file ? And the command you wrote to launch pdal-parallelizer ?
Also, you don't need to specify "filename" in pdal's readers and writers. pdal-parallelizer will set these options for you.
from pdal-parallelizer.
Related Issues (20)
- Tile size impact on workers number
- -merge_tiles option writer issue
- Removing tiles when merge_tiles on
- -tile_size option needs -buffer HOT 2
- -buffer Int HOT 3
- extra dim withdrawn from merged output HOT 2
- Add some checks before computation
- Fixing the bugs of the new version
- Reorganise the project
- Advise the user in the number of workers to choose
- How to execute the deserialized pipelines in single mode
- Properly open the cloud just once using client.scatter in single mode
- Use a "PipelineWrapper" or a "PipelineManager" class to simplify actions related to PDAL pipelines
- Simplify the tile.pipeline function
- Simplify the tile.split function
- Computation performance decreasing with important number of files
- Crash due to multiple expressions on filters.assign
- Add support for Virtual Point Cloud
- CPU explotation limit HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pdal-parallelizer.