Dennis Zhou (Facebook) b185cd0dc6 percpu: update free path to take advantage of contig hints ... The bitmap allocator must keep metadata consistent. The easiest way is to scan after every allocation for each affected block and the entire chunk. This is rather expensive. The free path can take advantage of current contig hints to prevent scanning within the start and end block. If a scan is needed, it can be done by scanning backwards from the start and forwards from the end to identify the entire free area this can be combined with. The blocks can then be updated by some basic checks rather than complete block scans. A chunk scan happens when the freed area makes a page free, a block free, or spans across blocks. This is necessary as the contig hint at this point could span across blocks. The check uses the minimum of page size and the block size to allow for variable sized blocks. There is a tradeoff here with not updating after every free. It is possible a contig hint in one block can be merged with the contig hint in the next block. This means the contig hint can be off by up to a page. However, if the chunk's contig hint is contained in one block, the contig hint will be accurate. Signed-off-by: Dennis Zhou <dennisszhou@gmail.com> Reviewed-by: Josef Bacik <jbacik@fb.com> Signed-off-by: Tejun Heo <tj@kernel.org>		2017-07-26 17:41:06 -04:00
..
kasan	kasan: make get_wild_bug_type() static	2017-07-10 16:32:33 -07:00
backing-dev.c
balloon_compaction.c	mm/balloon_compaction.c: enqueue zero page to balloon device	2017-07-10 16:32:32 -07:00
bootmem.c
cleancache.c
cma_debug.c
cma.c	cma: fix calculation of aligned offset	2017-07-10 16:32:32 -07:00
cma.h
compaction.c	mm, compaction: skip over holes in __reset_isolation_suitable	2017-07-06 16:24:32 -07:00
debug_page_ref.c
debug.c
dmapool.c
early_ioremap.c
fadvise.c
failslab.c
filemap.c	mm: hugetlb: return immediately for hugetlb page in __delete_from_page_cache()	2017-07-10 16:32:30 -07:00
frame_vector.c
frontswap.c
gup.c	mm, gup: ensure real head page is ref-counted when using hugepages	2017-07-06 16:24:34 -07:00
highmem.c
huge_memory.c	mm, THP, swap: check whether THP can be split firstly	2017-07-06 16:24:31 -07:00
hugetlb_cgroup.c
hugetlb.c	mm, tree wide: replace __GFP_REPEAT by __GFP_RETRY_MAYFAIL with more useful semantic	2017-07-12 16:26:03 -07:00
hwpoison-inject.c
init-mm.c
internal.h	mm, tree wide: replace __GFP_REPEAT by __GFP_RETRY_MAYFAIL with more useful semantic	2017-07-12 16:26:03 -07:00
interval_tree.c
Kconfig	mm/kasan: add support for memory hotplug	2017-07-10 16:32:33 -07:00
Kconfig.debug
khugepaged.c	mm: make PR_SET_THP_DISABLE immediately active	2017-07-10 16:32:31 -07:00
kmemcheck.c
kmemleak-test.c
kmemleak.c	mm: kmemleak: treat vm_struct as alternative reference to vmalloc'ed objects	2017-07-06 16:24:34 -07:00
ksm.c	ksm: optimize refile of stable_node_dup at the head of the chain	2017-07-06 16:24:31 -07:00
list_lru.c	mm/list_lru.c: fix list_lru_count_node() to be race free	2017-07-10 16:32:33 -07:00
maccess.c
madvise.c	userfaultfd: non-cooperative: add madvise() event for MADV_FREE request	2017-07-10 16:32:32 -07:00
Makefile
memblock.c	mm, memory_hotplug: move movable_node to the hotplug proper	2017-07-06 16:24:35 -07:00
memcontrol.c	mm, memcg: fix potential undefined behavior in mem_cgroup_event_ratelimit()	2017-07-10 16:32:32 -07:00
memory_hotplug.c	mm/memory-hotplug: switch locking to a percpu rwsem	2017-07-10 16:32:33 -07:00
memory-failure.c	mm, hugetlb, soft_offline: use new_page_nodemask for soft offline migration	2017-07-10 16:32:32 -07:00
memory.c	mm/memory.c: mark create_huge_pmd() inline to prevent build failure	2017-07-12 16:25:59 -07:00
mempolicy.c	mm, migration: do not trigger OOM killer when migrating memory	2017-07-12 16:26:04 -07:00
mempool.c
memtest.c
migrate.c	mm/migrate.c: stabilise page count when migrating transparent hugepages	2017-07-10 16:32:31 -07:00
mincore.c
mlock.c
mm_init.c
mmap.c	mm: fix overflow check in expand_upwards()	2017-07-14 15:05:12 -07:00
mmu_context.c
mmu_notifier.c
mmzone.c
mprotect.c	mm: drop NULL return check of pte_offset_map_lock()	2017-07-06 16:24:33 -07:00
mremap.c
msync.c
nobootmem.c	mm/nobootmem.c: return 0 when start_pfn equals end_pfn	2017-07-06 16:24:31 -07:00
nommu.c
oom_kill.c	mm/oom_kill.c: add tracepoints for oom reaper-related events	2017-07-10 16:32:32 -07:00
page_alloc.c	mm, tree wide: replace __GFP_REPEAT by __GFP_RETRY_MAYFAIL with more useful semantic	2017-07-12 16:26:03 -07:00
page_counter.c
page_ext.c
page_idle.c
page_io.c	swap: add block io poll in swapin path	2017-07-10 16:32:30 -07:00
page_isolation.c	mm: unify new_node_page and alloc_migrate_target	2017-07-10 16:32:31 -07:00
page_owner.c	mm: avoid taking zone lock in pagetypeinfo_showmixed()	2017-07-10 16:32:32 -07:00
page_poison.c
page_vma_mapped.c	mm/hugetlb: add size parameter to huge_pte_offset()	2017-07-06 16:24:34 -07:00
page-writeback.c	writeback: rework wb_[dec|inc]_stat family of functions	2017-07-12 16:26:05 -07:00
pagewalk.c	mm/hugetlb: add size parameter to huge_pte_offset()	2017-07-06 16:24:34 -07:00
percpu-internal.h	percpu: skip chunks if the alloc does not fit in the contig hint	2017-07-26 17:41:05 -04:00
percpu-km.c	percpu: replace area map allocator with bitmap	2017-07-26 17:41:05 -04:00
percpu-stats.c	percpu: add first_bit to keep track of the first free in the bitmap	2017-07-26 17:41:05 -04:00
percpu-vm.c
percpu.c	percpu: update free path to take advantage of contig hints	2017-07-26 17:41:06 -04:00
pgtable-generic.c
process_vm_access.c
quicklist.c
readahead.c
rmap.c	mm: memcontrol: per-lruvec stats infrastructure	2017-07-06 16:24:35 -07:00
rodata_test.c
shmem.c	mm: make PR_SET_THP_DISABLE immediately active	2017-07-10 16:32:31 -07:00
slab_common.c	mm: allow slab_nomerge to be set at build time	2017-07-06 16:24:31 -07:00
slab.c	mm: memcontrol: account slab stats per lruvec	2017-07-06 16:24:35 -07:00
slab.h	mm: memcontrol: account slab stats per lruvec	2017-07-06 16:24:35 -07:00
slob.c
slub.c	mm: memcontrol: account slab stats per lruvec	2017-07-06 16:24:35 -07:00
sparse-vmemmap.c	mm, tree wide: replace __GFP_REPEAT by __GFP_RETRY_MAYFAIL with more useful semantic	2017-07-12 16:26:03 -07:00
sparse.c	mm, memory_hotplug: do not associate hotadded memory to zones until online	2017-07-06 16:24:32 -07:00
swap_cgroup.c	mm, THP, swap: delay splitting THP during swap out	2017-07-06 16:24:31 -07:00
swap_slots.c	mm/swap_slots.c: don't disable preemption while taking the per-CPU cache	2017-07-10 16:32:32 -07:00
swap_state.c	swap: add block io poll in swapin path	2017-07-10 16:32:30 -07:00
swap.c	mm: swap: provide lru_add_drain_all_cpuslocked()	2017-07-10 16:32:33 -07:00
swapfile.c	swap: add block io poll in swapin path	2017-07-10 16:32:30 -07:00
truncate.c	mm/truncate.c: fix THP handling in invalidate_mapping_pages()	2017-07-10 16:32:32 -07:00
usercopy.c
userfaultfd.c
util.c	Merge branch 'work.mount' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs	2017-07-15 12:00:42 -07:00
vmacache.c
vmalloc.c	mm, tree wide: replace __GFP_REPEAT by __GFP_RETRY_MAYFAIL with more useful semantic	2017-07-12 16:26:03 -07:00
vmpressure.c	mm, vmpressure: pass-through notification support	2017-07-10 16:32:31 -07:00
vmscan.c	mm, tree wide: replace __GFP_REPEAT by __GFP_RETRY_MAYFAIL with more useful semantic	2017-07-12 16:26:03 -07:00
vmstat.c	mm: avoid taking zone lock in pagetypeinfo_showmixed()	2017-07-10 16:32:32 -07:00
workingset.c	mm: memcontrol: per-lruvec stats infrastructure	2017-07-06 16:24:35 -07:00
z3fold.c
zbud.c
zpool.c
zsmalloc.c	mm/zsmalloc: simplify zs_max_alloc_size handling	2017-07-10 16:32:33 -07:00
zswap.c	mm/zswap.c: delete an error message for a failed memory allocation in zswap_dstmem_prepare()	2017-07-06 16:24:35 -07:00