Comments (9)
Update: It finished processing the full photo library and exporting the updates successfully using the 0.58.2 version.
from osxphotos.
@rajscode I think this is fixed in v0.59.3. Please give that a try and let me know if you still see the error.
from osxphotos.
@rajscode I think this is fixed in v0.59.3. Please give that a try and let me know if you still see the error.
0.59.3 bugfix release looks to be working well (Thanks!)
Some observations:
0.59.3 (vs 0.58.2) seems to be faster: ~ 1hr35m vs 2hr16m
going through a photos library of approx 155K items using ~ 1.6TB on disk
In regards to memory utilization - I logged 0.59.3 memory use from start to end.
4th_Run_0.59.3_bugfix_version_memory_usage_observations.log
Thanks again.
from osxphotos.
My results were also positive. 3:23:23 for ~90K pics exporting via 1GB LAN to NAS Server.
from osxphotos.
Ran it again and it crashed out again at 27% of way through, but this time on a different photo file and the error messages were different.
[Errno 24] Too many open files: '/Volumes/WDSSD2B/Macbook_Pro_14_PhotosLibrary_Full_Originals_Backup/Photos Library.photoslibrary/resources/derivatives/0'
Something went wrong and osxphotos encountered an error:
Error binding parameter 14: type 'OSError' is not supported
Attached last 11 lines from the crash log file as the full crash log file is 1.12 GB in size. I'd deleted the crash log file prior to running the osxphotos command again so the 1.12 GB is from this one run.
2nd_Run_osxphotos_crash_last_11_lines.log
from osxphotos.
I downgraded to 0.58.2 version and am currently rerunning the command again.
- It's already passed 30% and hasn't failed (I fully expect it to complete successfully this time)
- The estimated time remaining and how long it's been running seem to suggest for my library at least that 0.58.2 is significantly faster vs 0.59.2 release.
My photos library is ~ 1.6TB on disk.
from osxphotos.
The estimated time remaining and how long it's been running seem to suggest for my library at least that 0.58.2 is significantly faster vs 0.59.2 release.
Yes, other users have reported that too. I'm looking into why. There appears to be a memory leak (#1047) in 0.59.x and that could contribute to the slow down. 0.59 added no features, just refactored the code to enable parallel exports (in the future) so you're fine staying on 0.58.2 for now.
from osxphotos.
@all-contributors please add @rajscode for bug
from osxphotos.
I've put up a pull request to add @rajscode! 🎉
from osxphotos.
Related Issues (20)
- AAE export doesn't work with --update HOT 10
- Allow `--save-config` to use a template string.
- Use cgmetadata to read metadata during import
- Error copying file: "Permission denied" HOT 6
- Ability to resize on convert-to-jpeg HOT 5
- Add --skip-photos, --skip-videos/--skip-movies
- Collections and Moments HOT 1
- Warn user if Photos path cannot be accessed HOT 4
- (User error!) Photos with 1 Live photo (pic+video) and a separate video with same filename: Separate video file gets overwritten. HOT 3
- filepath.* in filename_template results in `TypeError: argument should be a str or an os.PathLike object where __fspath__ returns a str, not 'NoneType` HOT 5
- add PhotoInfo.imported_by
- Add `osxphotos check` command to check access permissions
- Provide way to override "found other export database files" warning HOT 7
- Add query option for finding unnnamed faces.
- Add `--skip-raw-jpeg` as corollary for `--skip-raw`
- Add `--in-exportdb`, `--not-in-exportdb`, and `--missing-from-export` query options HOT 1
- Add pointer to export database in the export folder
- Add --not-uuid and --not-uuid-from-file HOT 1
- Warning when using --exiftool-merge-keywords and --download-missing
- Add `osxphotos cleanup` command
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from osxphotos.