Daniel Micay
f441dfe2e3
align size class metadata to cacheline size
2018-08-31 23:10:26 -04:00
Daniel Micay
fad10ce943
use FIFO queue for free slabs
2018-08-31 22:55:49 -04:00
Daniel Micay
3f80895822
ignore pad argument to malloc_trim per glibc
...
The pad argument is only used by the main arena for sbrk in glibc, with
every other page size gap purged with MADV_DONTNEED. It makes more sense
to simply treat it as an ignored legacy parameter rather than trying to
come up with a sensible way to use it for keeping cached free slabs.
2018-08-30 09:36:46 -04:00
Daniel Micay
1ea997b887
add missing headers to malloc.h
2018-08-30 08:48:43 -04:00
Daniel Micay
2b0f7aa985
use a consistent name for size class integer index
2018-08-30 07:13:28 -04:00
Daniel Micay
0f5f2bf6c9
add basic initial heuristic for freeing slabs
2018-08-30 06:56:00 -04:00
Daniel Micay
456dfe4154
add support for purging and protecting empty slabs
2018-08-30 05:59:44 -04:00
Daniel Micay
bb176e09bc
remove useless code in the empty_slabs path
2018-08-30 05:45:03 -04:00
Daniel Micay
29df2429c2
empty_slabs will remain a singly-linked list
2018-08-30 05:27:51 -04:00
Daniel Micay
f94068ea63
rename free_slabs to empty_slabs
2018-08-30 04:55:39 -04:00
Daniel Micay
b6d4af872f
move libdivide.h to third_party/libdivide.h
2018-08-30 03:03:19 -04:00
Daniel Micay
6f9de3e667
add inline hint to get_size_info
2018-08-29 15:13:53 -04:00
Daniel Micay
e85c69a0a4
fix builds with prefix
2018-08-29 15:07:36 -04:00
Daniel Micay
becadc57a5
get rid of unused MIN_ALIGN definition
2018-08-29 14:18:45 -04:00
Daniel Micay
2684a98eab
add initial malloc_object_size extensions
2018-08-29 14:18:42 -04:00
Daniel Micay
0e2f3d1015
sanity check page size at runtime
2018-08-29 11:00:18 -04:00
Daniel Micay
d779d41721
wrap more memory mapping implementation details
2018-08-29 10:57:42 -04:00
Daniel Micay
1cb28531a8
add wrapper for mremap with sanity check
2018-08-29 10:43:54 -04:00
Daniel Micay
5bc6820c24
rely on mmap rounding to page size when possible
2018-08-29 03:25:00 -04:00
Daniel Micay
58d929c0f0
split out low-level memory mapping wrappers
2018-08-29 00:53:38 -04:00
Daniel Micay
8b42e8c3d6
make sure errno is always set on failure
2018-08-28 22:49:11 -04:00
Daniel Micay
66aa98dbd9
sanity-check mmap errno on failure too
2018-08-28 22:41:18 -04:00
Daniel Micay
705b6a4f8d
make non-out-of-memory mprotect errors fatal
2018-08-28 22:22:57 -04:00
Daniel Micay
19c46d16f1
check pthread_atfork return value
2018-08-28 21:31:20 -04:00
Daniel Micay
803811a6ac
add support for using mremap
2018-08-28 10:44:04 -04:00
Daniel Micay
718bf82f96
add inline hints for slab_allocate and slab_free
2018-08-27 09:29:30 -04:00
Daniel Micay
33f862ec19
add inline hints for init and enforce_init
2018-08-27 09:29:27 -04:00
Daniel Micay
67b9608ccf
avoid duplicated init code calculating slab size
2018-08-27 09:22:04 -04:00
Daniel Micay
c7b24f63f1
use libdivide for substantially faster division
2018-08-27 07:07:48 -04:00
Daniel Micay
63b0c39343
reorder size_class struct for better performance
2018-08-27 05:21:58 -04:00
Daniel Micay
14ca7d7c3f
randomize large allocation guard size
2018-08-26 04:46:12 -04:00
Daniel Micay
a13a45a17d
hold regions_lock in alloc_aligned
2018-08-26 04:37:43 -04:00
Daniel Micay
2b7c9362bb
consume fewer random bytes for slab randomization
2018-08-25 18:32:44 -04:00
Daniel Micay
c5d76179a5
improve interaction of slot rand with slot mask
2018-08-25 18:04:55 -04:00
Daniel Micay
173dd6e7a5
randomize slot selection for empty slabs too
2018-08-25 18:02:13 -04:00
Daniel Micay
c335c43dd7
simplify slab out-of-memory error handling
2018-08-25 16:41:07 -04:00
Daniel Micay
7bcfa3f08b
tune slab metadata allocation
2018-08-25 15:46:22 -04:00
Daniel Micay
4777ee0c85
special case division for page size slabs
2018-08-25 15:21:50 -04:00
Daniel Micay
ec78add6ab
define ffzl utility function
2018-08-25 03:14:07 -04:00
Daniel Micay
f08d4d31db
randomize slab slot choice
2018-08-25 03:02:39 -04:00
Daniel Micay
965c3202b4
finish implementation of zero byte size class
2018-08-25 02:48:47 -04:00
Daniel Micay
f97a0ef8b1
use a more appropriate type for masked bitmaps
2018-08-25 01:09:15 -04:00
Daniel Micay
f3c8502509
add CSPRNGs for regions and slabs
2018-08-25 00:25:33 -04:00
Daniel Micay
805bdc6087
add an extra sanity check for unallocated metadata
2018-08-24 05:22:38 -04:00
Daniel Micay
2d168b0516
check for double free slightly earlier
2018-08-24 04:51:52 -04:00
Daniel Micay
97b693d862
stop treating guard size as a constant
2018-08-24 04:07:46 -04:00
Daniel Micay
83dabbd8fa
fix handling of random bases for class regions
2018-08-24 03:52:01 -04:00
Daniel Micay
0d51459dc9
add a special memory protected 0 byte size class
2018-08-24 03:24:23 -04:00
Daniel Micay
7a86b67778
add unaligned free check for small allocations
2018-08-24 02:55:53 -04:00
Daniel Micay
2aee424b7b
fix inconsistent whitespace
2018-08-24 02:09:20 -04:00
Daniel Micay
a874a61099
adjust slot count for 12288 byte size class
2018-08-23 18:00:13 -04:00
Daniel Micay
127f110126
adjust slot count for 10240 byte size class
2018-08-23 17:56:17 -04:00
Daniel Micay
c59c97c65b
adjust slot count for 48 byte size class
2018-08-23 17:53:10 -04:00
Daniel Micay
56e4c7e042
adjust slot count for 224 byte size class
2018-08-23 17:42:51 -04:00
Daniel Micay
4aa0fab4f4
avoid deadlocks after forking threaded processes
2018-08-23 17:22:12 -04:00
Daniel Micay
70d61b6662
initial commit
2018-08-23 15:42:41 -04:00
