442 Commits

Author	SHA1	Message	Date
daan	cefc930f72	bump version to 1.6.4 for further development	2020-05-05 10:47:46 -07:00
daan	5cfdc39ff1	remove on-demand page commit option	2020-04-30 18:23:33 -07:00
Anton Korobeynikov	079b886feb	Add cmake option to specify whether warnings / errors are enabled by default. ... Currently warnings / errors are enabled by default in debug build. Otherwise they could be enabled only via environmental variable or API option call. Add possibility to specify the default during the build time. This simplifies e.g. integration of the library into bigger projects as no source changes would be required.	2020-04-28 16:44:44 +03:00
daan	3484cda169	bump version to 1.6.3 for further development	2020-04-20 18:01:39 -07:00
daan	d102882bdf	bump version to 1.6.2	2020-04-20 17:59:13 -07:00
daan	69a0846478	add MI_PADDING flag to cmake to supress use of padding in debug mode	2020-04-07 10:01:18 -07:00
daan	0a3e5bb699	further fixes to compile on mingw without warnings (issue #217)	2020-04-06 10:56:53 -07:00
daan	50bfacdb71	fix mingw compilation by using export definitions (issue #217)	2020-04-06 09:53:29 -07:00
daan	cfeee53389	remove accidental include file	2020-03-16 16:44:29 -07:00
daan	7745dde8d2	allow retirement for all object sizes (issue #212)	2020-03-16 15:31:37 -07:00
daan	82684042be	bump version to 1.6.1	2020-02-17 10:10:22 -08:00
daan	f2ac272baa	strengthen alignment check for memalign and aligned_alloc	2020-02-17 09:59:11 -08:00
daan	67de2549cf	fix build with clang-cl due to _Check_return_ (issue #200)	2020-02-14 09:40:56 -08:00
daan	8a2a52843d	delete all thread owned heaps when a thread is terminated (issue #202)	2020-02-13 12:15:23 -08:00
daan	f42b8526d0	fix wrong __declspec(restrict) and __attribute__((malloc)) attributes on reallocation functions	2020-02-13 10:36:39 -08:00
daan	04f1c3b1e2	bump version to v1.6.0	2020-02-09 18:53:39 -08:00
daan	a96e94f940	change TLS slot on OpenBSD	2020-02-02 22:46:38 -08:00
daan	3560e0a867	fix TLS slot number on OSX	2020-02-02 22:15:09 -08:00
daan	1c2e0a47ca	fix noexcept attribute on array delete operators	2020-02-02 22:04:53 -08:00
daan	f3c47c7c91	improved malloc zone handling on macOSX (not working yet)	2020-02-02 21:03:09 -08:00
daan	757dcc8411	extend interpose for macOSX	2020-02-02 19:07:26 -08:00
daan	12c4108abe	update comments	2020-02-02 16:09:09 -08:00
daan	07fbe4f80f	fixes for dragonfly	2020-02-02 14:31:28 -08:00
daan	8bc20631e4	fixes for freeBSD	2020-02-02 13:25:26 -08:00
daan	d2db9f1fc2	update thread local storage	2020-02-02 13:12:22 -08:00
daan	bb64634e4e	Merge branch 'dev-exp' into dev-exp-tls	2020-02-01 17:48:57 -08:00
daan	bf2eb55ed1	reformatting	2020-02-01 17:48:26 -08:00
daan	8aba40a972	use default declaration for the STL allocator class	2020-02-01 17:41:04 -08:00
daan	3f17ac287c	add 'nodiscard' attribute to mimalloc interface	2020-02-01 17:29:30 -08:00
daan	0989562c2d	add initial fast tls for macOSX	2020-02-01 16:57:00 -08:00
daan	fea903900d	use __thread locals on linux	2020-02-01 14:33:34 -08:00
daan	a169cf0e3f	merge dev-exp; add pthread TLS support for macOSX	2020-02-01 14:10:10 -08:00
daan	edff9d4fbb	merge from dev-win (padding)	2020-02-01 12:32:59 -08:00
daan	aa68b8cbc7	improve encoding of padding canary and buffer overflow detection	2020-02-01 12:16:37 -08:00
daan	40f1e1e07b	byte-precise heap block overflow checking with encoded padding	2020-01-31 23:39:51 -08:00
daan	68112a2751	better padding implementation, more precise statistics	2020-01-31 20:34:24 -08:00
daan	4531367de2	fix padding check for aligned allocation; improve perf for small aligned allocations	2020-01-31 13:20:02 -08:00
daan	f820fae858	merge from dev; add retired collect on abandon	2020-01-30 07:24:35 -08:00
daan	a7c69ccbea	fix stat accounting of segments with huge blocks	2020-01-30 06:25:42 -08:00
daan	ed1c8a203a	improve performance with tls recursion counter	2020-01-29 23:08:52 -08:00
daan	03b363a1c2	first working tls on macOS using interpose; still slow	2020-01-29 22:46:44 -08:00
daan	5d212d688f	add MI_PADDING build option to add padding to each block to detect heap block overflows	2020-01-29 17:10:57 -08:00
daan	e628fc7067	cleanup reclaim logic	2020-01-26 12:39:11 -08:00
daan	5e32d00aab	add visit count to abandoned to limit list length	2020-01-25 12:26:08 -08:00
daan	b31bc52618	add cache alignment directives for contended variables	2020-01-24 19:02:13 -08:00
daan	4a2a0c2d50	initial abandon based on fine-grained reclamation	2020-01-23 19:50:35 -08:00
daan	c9106e74a8	remove __thread attribute from mimalloc.h	2020-01-23 11:06:25 -08:00
daan	6fb434a99b	use -fvisibility=hidden on clang as well	2020-01-23 10:31:47 -08:00
daan	e3b16fe4ef	reduce type casts in atomic operations	2020-01-22 19:44:54 -08:00
daan	0f14f431c5	bump version to 1.5 for further development	2020-01-22 18:33:07 -08:00
daan	3957b2fd28	add mi_new_realloc(n) to support C++ style reallocation that raises std::bad_alloc on out-of-memory	2020-01-20 15:41:56 -08:00
daan	146899af8a	add missing members to stl allocator (#193)	2020-01-20 15:27:05 -08:00
daan	a33ebb8625	add alloc_align attribute to aligned allocation functions	2020-01-19 22:14:35 -08:00
daan	514b315283	add max_size member to STL allocator	2020-01-19 21:27:46 -08:00
daan	9d7ac76d93	fix compilation under Intel C compiler (icc)	2020-01-19 18:35:45 -08:00
daan	dc58388968	Add ability to register custom error function called on various error conditions; including ENOMEM	2020-01-17 19:59:55 -08:00
daan	3e982a3813	fix STL deallocate passing count (instead of size) to mi_free_size	2020-01-17 15:58:43 -08:00
daan	6dd636d82d	improve STL allocator using mi_new_n and removing unused parameter names; follow up from pr #193 and #188	2020-01-17 15:41:52 -08:00
daan	6b7356a10a	make mimalloc compile with the highest warning level on msvc	2020-01-16 18:12:01 -08:00
daan	a0bee081dd	use proper C++11 check for noexcept attribute	2020-01-16 15:58:48 -08:00
daan	7a9502973d	rearrange STL allocator code: remove pragma, ifdef for C++11	2020-01-16 15:57:11 -08:00
Daan	97bd204c42	Merge branch 'dev' into kile/stl	2020-01-16 15:33:13 -08:00
Kirsten Lee	526bee6843	merge stl and main header	2020-01-16 15:17:15 -08:00
Kirsten Lee	1b2b7404f7	flip the order of includes for ease of use	2020-01-16 14:54:13 -08:00
daan	24f8bcbc8f	add explicit calling convention to registered functions	2020-01-16 14:25:09 -08:00
daan	8d8f355ed0	add option to reset eagerly when a segment is abandoned	2020-01-16 11:25:02 -08:00
daan	7a1e86fc20	merge from dev	2020-01-15 18:03:37 -08:00
daan	0099707af9	use delayed free for all pages; reduce size of the page structure for improved address calculation	2020-01-15 17:19:01 -08:00
daan	202246425b	bump version to 1.4 for further development	2020-01-15 12:16:53 -08:00
daan	c9b5ac80b3	update page reset queue to just do delayed page resets	2020-01-15 12:00:44 -08:00
daan	783e3377f7	add output argument to stat printing	2020-01-15 10:53:54 -08:00
daan	0956a05bf6	add argument pointer to the register deferred free callback	2020-01-15 10:21:32 -08:00
daan	f92a2a7264	add argument pointer to the register output routine	2020-01-15 10:18:32 -08:00
daan	941c55ee42	wip: first implementation of page free list on segments for effecient delayed page reset	2020-01-14 21:47:18 -08:00
daan	12ef2816ed	fix bug exposed by commit 59fa286 where reclaimed pages could be stuck to NEVER_DELAYED	2020-01-08 19:00:03 -08:00
daan	683d8998d4	fix potential A-B-A problem with segment abandonment; noticed by Manual Poeter and Sam Gross	2020-01-08 17:45:38 -08:00
Kirsten Lee	743e891738	add stl mimalloc wrapper	2020-01-06 16:18:22 -08:00
daan	2b108c8748	increase retire expiration to 4	2020-01-03 21:39:18 -08:00
daan	eeb623e6af	increase retire limit, collect retired pages	2020-01-03 17:06:41 -08:00
daan	f9ca88f71c	set secure default to 0 again	2020-01-02 17:57:41 -08:00
daan	fc3e537bd4	improve double free detection with faster same page check	2019-12-28 15:28:13 -08:00
daan	77134e1ad0	update free list encoding to stronger formula with addition last	2019-12-28 15:17:49 -08:00
daan	e3391d9a53	stronger encoding of free lists using two keys per page	2019-12-28 00:57:42 -08:00
daan	ba87a39d9f	updated random cookie generation using OS primitives and chacha20	2019-12-22 19:37:49 -08:00
daan	a799a19136	fix non-standard line continuation	2019-11-25 14:30:12 -08:00
Daan	fe51d11e61	Merge pull request #178 from carenas/master ... avoid deadlock with BSD systems that call malloc from the dynamic linker	2019-11-25 14:28:58 -08:00
daan	1d998af854	clean up options; make secure work with eager_page_commit	2019-11-25 10:47:17 -08:00
daan	c6df7a199c	experimental eager page commit option	2019-11-24 22:02:40 -08:00
Carlo Marcelo Arenas Belón	41ef691292	avoid deadlock with BSD systems that call malloc from the dynamic linker ... extend the exception used for macOS to cover also OpenBSD (tested in 6.4+) and DragonFlyBSD (tested in 5.6.2)	2019-11-24 10:00:39 -08:00
daan	24b768363e	bump version to 1.3 for further development	2019-11-22 09:28:48 -08:00
daan	50575b12c0	Merge branch 'dev' into dev-exp	2019-11-21 16:29:59 -08:00
daan	41caf6d0f8	set secure default to 0	2019-11-21 16:29:46 -08:00
daan	6568059cc6	merge from dev	2019-11-21 16:28:28 -08:00
daan	d55ab50a84	update version to 1.2	2019-11-21 16:10:04 -08:00
daan	74dbfc30be	improved security by encoding NULL values; double free mitigation on by default; more precise free list corruption detection	2019-11-21 15:21:23 -08:00
Daan Leijen	211f1aa519	remove reset delay slots; add reset tracking per page and segment	2019-11-20 14:55:12 -08:00
Daan Leijen	30e2c54adb	remove delayed reset option (for now)	2019-11-20 14:13:02 -08:00
daan	17ade3fca5	merge from dev	2019-11-13 17:52:20 -08:00
daan	314dcd59c2	Merge branch 'dev' of https://github.com/microsoft/mimalloc into dev	2019-11-13 17:23:54 -08:00
daan	a4ed63d127	Adresses pr #165 and issue #164 by @colesbury: ... On Mac OS, the thread-local _mi_default_heap may get reset before _mi_thread_done is called, leaking the default heap on non-main threads. Now the current default heap is also stored in mi_pthread_key (or mi_fls_key on Windows). The _mi_thread_done function is called with this value.	2019-11-13 17:22:03 -08:00
Daan	9b7a29c5da	Merge pull request #172 from aesophor/dev ... Avoid the use of variable argument list function	2019-11-13 16:28:09 -08:00
Daan Leijen	d01ed42bcb	replace max_numa_nodes by use_numa_nodes (to help with wrong detection of numa nodes on WSL for example)	2019-11-13 13:35:50 -08:00
Marco Wang	29919a938d	Avoid the use of variable argument list function	2019-11-13 13:19:21 +08:00
Daan Leijen	bdb8274819	change max_numa_node to max_numa_nodes option	2019-11-12 12:04:43 -08:00
daan	ef179a6377	avoid allocation at numa node detection on linux	2019-11-12 10:16:59 -08:00
daan	a0958b2da6	enable more reset delay slots	2019-11-11 17:06:16 -08:00
daan	741a80256d	merge from dev-exp	2019-11-11 14:51:16 -08:00
daan	2bb058bd25	remove cache_reset parameter	2019-11-11 14:44:32 -08:00
daan	83a066fd2d	remove reset_decommits option	2019-11-11 09:46:02 -08:00
daan	181bef382c	merge dev-exp	2019-11-10 11:39:53 -08:00
daan	27f1a8b3d2	fix avg display; set secure default to 0`	2019-11-07 10:35:30 -08:00
daan	36090dee5c	Merge branch 'dev' into dev-exp	2019-11-07 10:34:06 -08:00
daan	31d11f64d5	fix secure free list extension where a non-empty initial free list was discarded	2019-11-07 10:33:45 -08:00
daan	378716c467	refactor and improve atomic bitmap usage	2019-11-07 10:26:52 -08:00
daan	b09282bc0d	change arena allocator to atomic bitmap as well	2019-11-06 22:49:01 -08:00
daan	00e19cad9a	refactor region code, split out atomic bitmap	2019-11-06 21:37:23 -08:00
daan	829fd872f4	initial delay slots	2019-11-04 11:48:41 -08:00
daan	c38af8f7c1	merge d1d65fbc: make max error messages configurable	2019-11-04 08:49:59 -08:00
daan	8afd06b248	use int64 for time (instead of double)	2019-11-04 08:44:40 -08:00
daan	d1d65fbca4	make max error messages configurable	2019-11-03 13:25:41 -08:00
daan	e320488791	add numa nodes to stats	2019-11-03 12:18:32 -08:00
daan	fd9d8c85ae	change numa support on linux to use getcpu	2019-11-02 11:55:03 -07:00
daan	2c12d7f223	optimized numa calls; better Linux support	2019-11-01 22:01:52 -07:00
daan	a6499be074	initial numa support for arenas	2019-11-01 19:53:07 -07:00
daan	d36d04b4a6	add arena for huge page management	2019-10-31 15:35:10 -07:00
daan	b052d3b731	enable double free and heap corruption detection in debug mode	2019-10-28 15:54:33 -07:00
daan	081e2d1eb6	fix statistics display	2019-10-28 13:43:42 -07:00
daan	25246070ae	fix double free check in secure = 4 mode; inline _mi_ptr_cookie	2019-10-19 08:34:18 -07:00
daan	2affdbbd2e	stronger secure mode when defining MI_SECURE=4: checks for double free, corrupted free list, and invalid pointer frees. Performance is impacted but not too much -- more perf testing is needed	2019-10-18 18:11:04 -07:00
daan	fdfa6ed260	fix warnings at high warning level in msvc	2019-10-17 16:56:57 -07:00
daan	5de851a84d	update page_flags to have more portable definition	2019-10-17 16:48:16 -07:00
daan	26c27fbf58	use uint8_t bit fields, and improve portability of page_flags type	2019-10-17 12:07:26 -07:00
Johannes Schindelin	559688ec64	Suppress warning about unnamed struct ... This prevents MSVC complaining with warning C4201: nonstandard extension used: nameless struct/union The struct might seem unnecessary to the occasional reader (it did seem so to this commit's author), but it is not! It is required to align the fields to a boundary, which is verified by the test suite. Removing that "unnecessary" `struct` results in this failure: 1: Test command: mimalloc-test-api [...] 1: test: malloc-zero... mimalloc: assertion failed: at src/page.c:591, mi_page_init 1: assertion: "!mi_page_has_aligned(page)" Signed-off-by: Johannes Schindelin <johannes.schindelin@gmx.de>	2019-10-17 20:43:18 +02:00
Johannes Schindelin	e747a6f3a6	Use unsigned for bit-field variables ... It is actually non-standard to use `bool` with a bit-field quantifier, and VS 2019 complains about this. Signed-off-by: Johannes Schindelin <johannes.schindelin@gmx.de>	2019-10-17 20:43:18 +02:00
daan	f3a162f095	pick better umul_overflow variant based on size_t size	2019-10-17 09:52:10 -07:00
daan	4609537b8a	pick better umul_overflow variant based on intptr size	2019-10-17 09:47:12 -07:00
Daan Leijen	114d05cd76	bump to version 1.1	2019-10-07 09:54:23 -07:00
daan	60efb62155	make secure a build option only	2019-09-17 17:31:42 -07:00
daan	33f4ec4ac6	put new-delete overrides in separate header file	2019-09-15 19:19:00 -07:00
daan	6896408ab1	fix definition of mi_recalloc_tp	2019-09-11 20:49:18 -07:00
daan	24777f6a91	limit aligned allocation to power-of-two alignment	2019-09-11 17:49:28 -07:00
Daan Leijen	1909cfb346	refine mi_os_good_alloc_size and use it for huge pages (to ensure realloc is bounded as in #153	2019-09-10 13:26:51 -07:00
daan	ce81af1119	use mi_is_power_of_two when possible (pr #118)	2019-09-09 08:12:50 -07:00
daan	23155c5d71	add recursion guard to deferred callback	2019-09-09 08:02:41 -07:00
daan	3bbc047ba6	reserve huge pages returns actual number of pages reserved	2019-09-04 12:26:02 -07:00
daan	6c43ae2bde	add later thread-done invokation; add mi_is_redirected call	2019-09-04 12:00:41 -07:00
daan	a6a956c589	add back zero initialized re-allocation	2019-09-03 10:57:39 -07:00
daan	7a91368108	pass page to block_zero_init and extend to block_size	2019-09-03 10:11:24 -07:00
daan	d1bd1644d5	support zero-initialized memory detection	2019-09-02 13:16:52 -07:00
daan	d6e35ffd83	Merge branch 'dev' into dev-exp	2019-09-02 10:10:08 -07:00
daan	8ef8ddecc5	Merge branch 'master' into dev	2019-09-02 09:53:34 -07:00
Carlo Marcelo Arenas Belón	0e35ec3879	avoid deadlock with OpenBSD	2019-09-01 01:06:01 -07:00
daan	f35f643508	merge from dev	2019-08-29 09:52:22 -07:00
daan	7bf12c7b5f	make output function configurable; remove <stdio.h> from standard includes	2019-08-29 09:42:50 -07:00
daan	4819d3f78f	expose mi_stats_merge function	2019-08-29 09:01:00 -07:00
daan	d381fcd9fa	rename lazy to eager_commit_delay	2019-08-28 12:09:23 -07:00
daan	9af51506a6	track commit and is_large status more precisely	2019-08-28 11:58:30 -07:00
daan	23b5593af6	Merge branch 'dev' of https://github.com/microsoft/mimalloc into dev	2019-08-27 16:40:47 -07:00
David Carlier	b72a2d9659	macOS: anonymous page ID make it as env var.	2019-08-27 19:17:41 +01:00
daan	db8d443ae6	track more precisely if memory is fixed or committed	2019-08-26 22:45:26 -07:00
daan	f0a12699c2	remove atomic_iread	2019-08-26 12:42:25 -07:00
daan	a654732d99	merge from dev new atomics	2019-08-26 12:30:03 -07:00
daan	2c19388bcf	initialize mimalloc options at process load	2019-08-26 11:44:41 -07:00
daan	7ce9c02fd4	make cas weak use release memory order; improve free assembly	2019-08-26 08:20:26 -07:00
daan	5c7c106d62	strengthen some atomic operations for weak memory models	2019-08-26 08:11:58 -07:00
daan	e8664001f7	Use standard _Atomic declarations and clean up atomic operations	2019-08-25 22:59:12 -07:00
daan	23c35f4aba	merge from dev	2019-08-25 13:07:07 -07:00
daan	b86c851cca	put segment cache behind an option and disable by default	2019-08-25 12:35:14 -07:00
daan	a431d80fc3	better object sizes for large objects	2019-08-25 10:20:03 -07:00
daan	d3224d0bba	Merge branch 'dev' into dev-win	2019-08-23 21:42:32 -07:00
daan	6c6fcad242	remove threadid from pages and keep page flags separate (cherry picked)	2019-08-23 21:42:24 -07:00
daan	15552eba79	ensure volatile declaration for abandoned_next field	2019-08-23 21:39:27 -07:00
daan	acde83543f	remove threadid from pages and keep page flags separate	2019-08-23 14:08:00 -07:00
daan	b511309709	ensure volatile declaration for abandoned_next field	2019-08-23 13:44:43 -07:00
daan	71121a7457	Merge branch 'dev-win' into dev-exp	2019-08-21 11:12:25 -07:00
daan	e7bd8c5d14	merge with dev-win	2019-08-21 11:11:40 -07:00
Daan Leijen	eb25093b13	fix mi_cdecl for older clang versions	2019-08-21 09:40:57 -07:00
Daan Leijen	12257e5bc1	fix thread-id reset on page abandonment	2019-08-21 08:09:28 -07:00
Daan Leijen	cc6d14c55b	fix thread-id reset on page abandonment	2019-08-21 08:06:40 -07:00
daan	86d4ded831	Merge branch 'dev' into dev-exp	2019-08-20 08:27:46 -07:00
daan	a5071eb510	Merge branch 'dev' into dev-win	2019-08-20 07:50:03 -07:00
daan	03d994648a	better option interface: option_enable, option_disable, and option_set_enabled	2019-08-20 07:47:50 -07:00
daan	7a2e0df5ea	merge from dev	2019-08-20 07:37:46 -07:00
daan	d52e4039b6	remove the reset_discards option	2019-08-20 07:06:11 -07:00
daan	79487dbedf	add checks for right option order	2019-08-20 06:58:51 -07:00
daan	05631ebfc4	Merge branch 'dev' into dev-win	2019-08-19 21:23:04 -07:00
daan	13ef8a049b	allow larger large objects to better use segment space	2019-08-19 21:22:09 -07:00
daan	770e752578	fix parameter order on mul_overflow to fix static analysis warnings (pr #125)	2019-08-19 19:15:04 -07:00
daan	228c5e5507	allow larger large objects to better use segment space	2019-08-19 18:20:51 -07:00
daan	0e639addb0	add environment option to reserve huge pages upfront	2019-08-19 14:14:50 -07:00
daan	5b2f4184b3	Merge branch 'dev' into dev-exp	2019-08-19 11:37:39 -07:00
daan	42dedb00ec	initial implementation of mi_os_reserve_huge_pages	2019-08-19 11:10:06 -07:00
Daan Leijen	367fb046ec	Merge branch 'dev' into dev-win	2019-08-16 18:40:56 -07:00
Daan Leijen	069c26dbab	fix small object size check in mi_segment_page_alloc	2019-08-16 18:40:30 -07:00
daan	6d11e59250	fix to avoid potential linear behavior in page collect	2019-08-14 07:46:38 -07:00
daan	f35c2c5201	improve message printing from redirection module	2019-08-11 16:38:58 -07:00
daan	0fd898315c	per thread region search index	2019-08-11 12:15:13 -07:00
daan	2e924150ae	further layout improvement for msvc code generation	2019-08-11 11:30:24 -07:00
daan	7b105c4810	improve layout of page for x64	2019-08-11 10:31:00 -07:00
daan	dbe010f2d4	add huge and giant stats; increase bins	2019-08-10 20:51:37 -07:00