Comments (2)
I now have a proof of principle code in a separate branch that implements aligned memory allocation in pure C. This is the start of the core C library that we need in any case for lots of things. I can use cython to create Numpy arrays from scratch with these memory buffers, and also disable the destruction of that memory when the numpy array is destroyed. These memory buffers are allocated outside of the python memory pool, so can be returned to the OS. Based on memory_profiler output, this technique seems to work. However, it does require care to ensure that all numpy arrays with references to that buffer are out of use before deallocation.
from toast.
This is fully implemented as of 3434030.
from toast.
Related Issues (20)
- Add convenience method for getting slices from a view
- Failing conviqt test HOT 6
- Wrong assertion in GainTemplate tests HOT 1
- Partial duplication and redistribution of observation fails roundtrip HOT 1
- Missing import in schedule.py HOT 7
- Pixelization operators should not override intermediate quaternion fields
- Small angle quaternion SLERP issues
- Scalar factor in thermal gain drift implementation HOT 1
- NameError when applying common mode noise HOT 4
- Does TOAST need `MPI_THREAD_MULTIPLE`? HOT 1
- Very Low Memory Mapmaking Support HOT 3
- FLAC compression parameters
- Cannot override tuple-valued traits from command line HOT 2
- Inconsistent results from current and older versions of toast3 HOT 1
- Maybe a bug in crosslinking in toast3
- Argument parsing errors are unreadable in a parallel run
- toast.tests.observation.ObservationTest failing if no. of MPI processes greater than 4
- Unit test failing in toast3: `Pointing weights do not agree` HOT 1
- feature request: allow user-provided pybind11 HOT 2
- drone_map test failing with 4 MPI tasks HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from toast.