Comments (4)
It's best to surface this as an option to the consumer, since Windows, Linux and macOS can all support Large Pages.
A build variant seems less ideal.
from mimalloc.
Just a heads up to be wary when using large pages to folks looking to use this feature, performance boost can be significant but large pages cannot be paged to disk so it essentially grabs physical memory and is trickier to manage.
Implication 1) If you allocate too many large pages you it ends up starving the system of physical memory including the OS, and I have had many a machines lock up completely and become unresponsive under high memory pressure - it is one of those rare bugs that takes down the whole system, and not just the process. We dealt with it by falling back to regular pages after some threshold % of physical memory was given to large pages, so that at least the OS always had memory to work with.
Implication 2) In order for the OS to allocate a large page, it needs to have a full contiguous block of physical memory equal to the size of the large block. I do not know what this entails, but when the system is saturated it can presumably involve de-fragmenting memory or just failing. We had to add a fall-back to handle the case where if a large page allocation fails, we retry with normal pages to handle this.
from mimalloc.
I didn't look into this before but it seems easy to support this on Windows -- I can definitely make this a build variant for you to test :-) However, it would preclude the guard pages in the secure mode.
from mimalloc.
I pushed initial support for large pages on Windows on the dev
branch. It is enabled when setting the environment variable MIMALLOC_LARGE_OS_PAGES=1
. (note that the "Lock Pages in memory" privilege must be enabled for the user account for it to work).
from mimalloc.
Related Issues (20)
- mimalloc vs2015 debug version is slower than windows malloc, is there any option to accelerate the speed?
- Debug memory allocation HOT 1
- `slice_count` overflow for very large allocations HOT 2
- Calling mi_heap_collect does not decommits all unused pages HOT 2
- `unix/prim.c` uses deprecated Apple `TARGET_` symbols HOT 1
- Patching a 32-bit image with `minject` doesn't tell you to use `minject32`. HOT 1
- Segment check range exceeds 40TB for asan builds HOT 1
- Test 'malloc-nomem1' failure on 32-bit architectures after v2.1.4 HOT 1
- 2.1.4 Failure build for ppc64le error: โ__builtin_thread_pointerโ is not supported on this target HOT 12
- 2.1.4 and error mingw/msys2 HOT 4
- 2.1.4: build fail on centos7 HOT 7
- CMake install with namespace and add corresponding alias targets HOT 2
- Rss memory usage increase in version 2.1.4 HOT 2
- Add dllhook mode HOT 1
- oversize allocation in mi_heap_malloc_zero_aligned_at HOT 6
- Concurrency bugs that cause hanging HOT 2
- Intermittent VirtualAlloc failure while the pagefile is growing HOT 1
- Tests fail on armhf and armv7 on Alpine Linux (musl libc) since mimalloc 2.1.4 & 1.8.4 HOT 4
- [suggestion] add a comment at the declaration of `mi_arena_t` for easier custom modify HOT 1
- Can't compile v2.1.6 tag on Ubuntu 22.04.LTS HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mimalloc.