2856 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Daan	19ce2c6461	restore randomization when trying to reclaim abandoned segments	2024-10-11 10:44:43 -07:00
daanx	723869014f	add ability to abandon segments after a threshold	2024-10-09 21:24:20 -07:00
Daan Leijen	4913c2c65b	Merge branch 'dev-steal' into dev-slice-steal	2024-10-09 15:16:13 -07:00
Daan Leijen	a7e7cbac89	use enqueue_from_full, and keep inserting at the end	2024-10-09 15:15:57 -07:00
daanx	428e3b9ee0	Merge branch 'dev-steal' into dev-slice-steal	2024-10-09 15:05:48 -07:00
daanx	0316cb1d88	reduce page search to 8	2024-10-09 15:05:35 -07:00
daanx	933ac5c14c	Merge branch 'dev-steal' into dev-slice-steal	2024-10-09 14:41:25 -07:00
daanx	cbc0e19809	revert back to unfull at the end of queues as it slows down some benchmarks (like alloc-test1)	2024-10-09 14:41:12 -07:00
daanx	03fbaedec5	Merge branch 'dev-steal' into dev-slice-steal	2024-10-09 14:35:49 -07:00
daanx	96877159c2	insert full pages that became unfull, at the start of the page queue to increase potential reuse	2024-10-09 14:35:33 -07:00
daanx	a05b5ab0a1	search N pages for a best fit	2024-10-09 14:21:50 -07:00
daanx	b3d502179a	Merge branch 'dev-steal' into dev-slice-steal	2024-10-09 11:28:33 -07:00
daanx	ffa8bce581	prefer pages that do not expand	2024-10-09 11:27:57 -07:00
Daan	db3d8485d2	increase TSAN test to 400 iterations	2024-08-21 17:13:51 -07:00
Daan	ad02086d3b	remove default MI_DEBUG_GUARDED	2024-08-21 17:07:01 -07:00
Daan	60206ec075	merge from dev	2024-08-21 17:01:46 -07:00
Daan	d8e0cb1a37	increase test timeout for azure pipeline	2024-08-21 17:01:05 -07:00
Daan	532141fda2	Merge branch 'dev' into dev-slice	2024-08-21 15:39:31 -07:00
Daan	bb3976760f	add guarded build to test pipeline	2024-08-21 15:34:22 -07:00
Daan	51025f1ac2	set lower parameters for guarded test	2024-08-21 15:29:32 -07:00
Daan Leijen	3ec3aaf858	merge from dev	2024-08-21 11:33:11 -07:00
Daan Leijen	6a21db1017	Merge branch 'dev-guarded' into dev-slice-guarded	2024-08-21 11:31:10 -07:00
Daan Leijen	4234a9bd9d	Merge branch 'dev-guarded' into dev	2024-08-21 11:30:33 -07:00
Daan Leijen	58e743b83f	fix use_guarded signature	2024-08-21 11:30:00 -07:00
Daan Leijen	cc4dc1bb53	add comments	2024-08-21 11:26:12 -07:00
Daan Leijen	96f7cc4ef2	clean up guarded allocation	2024-08-21 11:21:25 -07:00
Daan Leijen	631ff581af	set compile as C++ in VS IDE	2024-08-21 10:47:38 -07:00
Daan Leijen	b9b529de28	shuffle for 128 bit	2024-08-21 10:45:19 -07:00
daanx	b5c6495f69	don't consider memory as large OS pages if only madvise'd	2024-08-20 15:58:36 -07:00
daanx	4ea9df3ee4	Merge branch 'dev-slice' into dev-slice-guarded	2024-08-20 13:13:10 -07:00
daanx	f163164d36	ensure start-offset in a segment respects minimal alignment	2024-08-20 13:12:51 -07:00
Daan Leijen	9731941c7b	merge from dev-guarded	2024-08-20 13:11:54 -07:00
Daan Leijen	f130808b5c	fix warnings	2024-08-20 12:58:49 -07:00
Daan Leijen	1ab67d44c8	merge from dev-guarded	2024-08-20 12:57:20 -07:00
daanx	8899a11c70	clean up guarded pages code	2024-08-20 11:09:17 -07:00
daanx	635cf7af6a	fix multi-threaded free to unprotect guarded blocks	2024-08-20 09:55:57 -07:00
daanx	0c19eb60cf	initial working guarded pages	2024-08-19 21:21:40 -07:00
Daan	5eb8c752f7	fix UINT32_MAX constant (see issue #913)	2024-08-13 16:36:53 -07:00
Daan	01503df7f3	move declaration to avoid gcc warning, see issue #919	2024-08-12 13:51:39 -07:00
Daan	7b5df14bea	initial work on guarded objects	2024-07-16 09:15:59 -07:00
daanx	349b7dc2f4	merge from dev	2024-06-17 16:22:44 -07:00
daanx	265767766b	fix alignment test	2024-06-17 16:22:07 -07:00
daanx	3c5e480ce7	fix alignment test	2024-06-17 16:21:46 -07:00
daanx	3726cf94ba	merge from dev	2024-06-17 16:18:03 -07:00
daanx	b7dd5d6564	add extra assertions to check that blocks are always aligned to MI_MAX_ALIGN_SIZE	2024-06-17 16:17:03 -07:00
Daan	03020fbf81	fix count/size order in mi_heap_alloc_new_n, issue #906	2024-06-04 17:28:04 -07:00
Daan	d68a7fc3e6	update docs	2024-06-04 17:04:33 -07:00
Daan	8f481d34dd	update docs	2024-06-04 16:54:22 -07:00
Daan	98058eed14	add heap tag to area descriptor	2024-06-04 16:54:06 -07:00
Daan	8b7b3e3754	add docs svg's	2024-06-04 14:59:42 -07:00
Daan	ab1cdbbde3	add search js files for docs	2024-06-04 14:58:58 -07:00
Daan	dee7faa6d8	add js for docs	2024-06-04 14:56:49 -07:00
Daan	272d3368a0	update aligned documentation	2024-06-04 14:50:55 -07:00
daanx	20424dbfa2	update doxyfile	2024-06-04 14:38:23 -07:00
daanx	e64684c9f9	update documentation	2024-06-04 14:37:16 -07:00
Daan	64f3afdda4	merge from dev	2024-06-03 21:31:36 -07:00
Daan	08fa864605	rename arena-abandoned to arena-abandon	2024-06-03 21:30:02 -07:00
Daan	e0baf882bb	reduce UBSAN parameters to stay within pipeline limits	2024-06-03 21:26:38 -07:00
Daan	b123bbe6c0	increase iterations for tsan test	2024-06-03 21:13:34 -07:00
Daan	0c322c5566	add reference to page_malloc_zero in C++ build	2024-06-03 21:10:05 -07:00
Daan	cf10af7824	re-enable tsan test in azure pipelines	2024-06-03 21:07:48 -07:00
daanx	f79ea2461a	merge from dev	2024-06-03 21:01:23 -07:00
daanx	b1188ea336	fix potential race on subproc field in the segment	2024-06-03 20:57:00 -07:00
daanx	76b0873ce2	fix asan tracking by explicitly setting memory to undefined before a free	2024-06-03 20:28:47 -07:00
daanx	614c4944e5	merge from dev	2024-06-03 18:27:33 -07:00
daanx	3f69119936	don't reset a segment thread id when iterating	2024-06-03 18:25:22 -07:00
daanx	065f46cefb	don't reset a segment thread id when iterating	2024-06-03 18:19:45 -07:00
Daan Leijen	7c67114fd4	merge from dev	2024-06-03 18:14:44 -07:00
daanx	537c51e227	fix vs 2022 ide	2024-06-03 18:06:53 -07:00
daanx	f7ba9d9da0	refactor arena-abandoned to be an include for backward compat with existing build scripts	2024-06-03 18:04:59 -07:00
daanx	800034cb99	refactor arena abandonment in a separate file	2024-06-03 17:58:34 -07:00
daanx	96b69d7ef6	fix leak where OS abandoned blocks were not always reclaimed	2024-06-03 17:28:14 -07:00
daanx	00dacba91f	maintain count of the abandoned os list	2024-06-03 15:44:25 -07:00
daanx	3333f776f9	push os abandoned blocks at the tail end	2024-06-03 15:37:05 -07:00
daanx	a04905c88b	revisit atomic reclaim for abandoned segments	2024-06-03 15:20:35 -07:00
daanx	f02a0b3541	more aggressive reclaim from free for OS blocks	2024-06-03 14:05:57 -07:00
daanx	043df00a97	Merge branch 'dev' into dev-slice	2024-06-03 11:43:49 -07:00
daanx	1a9cf7bce2	switch between OS and arena allocation in stress test	2024-06-03 11:43:35 -07:00
Daan	3f2b6e6df9	merge from dev	2024-06-03 11:34:54 -07:00
Daan	7e23576efa	remove old mi_abandoned_await_readers	2024-06-03 09:57:03 -07:00
Daan	2ed97f3ebb	whitespace	2024-06-03 09:55:11 -07:00
Daan	f17ddc3395	increase thread data cache to32 entries	2024-06-03 09:55:02 -07:00
Daan	84334e480a	decrease meta allocation zone to 4k (to reduce .bss)	2024-06-03 09:54:41 -07:00
Daan	52a4ff2cb9	Merge branch 'dev' into dev-slice	2024-06-03 09:26:08 -07:00
Daan	58fbb67963	fix c++ compilation	2024-06-03 09:25:53 -07:00
Daan	f77adf4a18	merge from dev (visit abandoned, upstream of python/cpython#114133)	2024-06-02 17:03:13 -07:00
Daan	6b15342709	fix pthread initalization of mutexes	2024-06-02 16:41:07 -07:00
Daan	768872e4e0	typo in stress test	2024-06-02 16:24:13 -07:00
daanx	e4c8f42bb6	always include sys/prctl.h on linux to disable THP if large_os_pages are not enabled	2024-06-02 16:10:08 -07:00
daanx	f9076a5cf8	use EFAULT if a target heap tag cannot be found on reclaim	2024-06-02 15:54:49 -07:00
daanx	f87ec74bb3	reduce delayed output from redirection to 16KiB to reduce the .bss size	2024-06-02 15:10:17 -07:00
daanx	e8f4bdd1ea	fix cast; make segment map static	2024-06-02 14:59:37 -07:00
daanx	a964322a21	revise the segment map to only apply to OS allocated segments and reduce the .BSS footprint	2024-06-02 14:46:59 -07:00
daanx	5501f59f6c	only reclaim for exclusive heaps in their associated arena	2024-06-02 13:16:20 -07:00
daanx	635d626c82	fix leak in abandoned block visiting	2024-06-02 10:43:41 -07:00
daanx	f7fe5bf20e	optimize heap walks, by Sam Gross, upstream of python/cpython#114133	2024-06-02 10:28:30 -07:00
daanx	855e3b2549	add support to visit _all_ abandoned segment blocks per sub-process, upstream for python/cpython#114133	2024-06-02 09:41:12 -07:00
daanx	8f874555d5	add initial support for visiting abandoned segments per subprocess, upstream for python/cpython#114133	2024-06-02 07:47:08 -07:00
Daan Leijen	f93fb900b7	move lock code to atomic.h	2024-06-01 17:25:45 -07:00
Daan Leijen	0b3cd51249	add initial primitive api for locks	2024-06-01 16:45:20 -07:00