kernel_optimize_test/mm
Mike Kravetz 22146c3ce9 hugetlbfs: dirty pages as they are added to pagecache
Some test systems were experiencing negative huge page reserve counts and
incorrect file block counts.  This was traced to /proc/sys/vm/drop_caches
removing clean pages from hugetlbfs file pagecaches.  When non-hugetlbfs
explicit code removes the pages, the appropriate accounting is not
performed.

This can be recreated as follows:
 fallocate -l 2M /dev/hugepages/foo
 echo 1 > /proc/sys/vm/drop_caches
 fallocate -l 2M /dev/hugepages/foo
 grep -i huge /proc/meminfo
   AnonHugePages:         0 kB
   ShmemHugePages:        0 kB
   HugePages_Total:    2048
   HugePages_Free:     2047
   HugePages_Rsvd:    18446744073709551615
   HugePages_Surp:        0
   Hugepagesize:       2048 kB
   Hugetlb:         4194304 kB
 ls -lsh /dev/hugepages/foo
   4.0M -rw-r--r--. 1 root root 2.0M Oct 17 20:05 /dev/hugepages/foo

To address this issue, dirty pages as they are added to pagecache.  This
can easily be reproduced with fallocate as shown above.  Read faulted
pages will eventually end up being marked dirty.  But there is a window
where they are clean and could be impacted by code such as drop_caches.
So, just dirty them all as they are added to the pagecache.

Link: http://lkml.kernel.org/r/b5be45b8-5afe-56cd-9482-28384699a049@oracle.com
Fixes: 6bda666a03 ("hugepages: fold find_or_alloc_pages into huge_no_page()")
Signed-off-by: Mike Kravetz <mike.kravetz@oracle.com>
Acked-by: Mihcla Hocko <mhocko@suse.com>
Reviewed-by: Khalid Aziz <khalid.aziz@oracle.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>
Cc: "Aneesh Kumar K . V" <aneesh.kumar@linux.vnet.ibm.com>
Cc: Andrea Arcangeli <aarcange@redhat.com>
Cc: "Kirill A . Shutemov" <kirill.shutemov@linux.intel.com>
Cc: Davidlohr Bueso <dave@stgolabs.net>
Cc: Alexander Viro <viro@zeniv.linux.org.uk>
Cc: <stable@vger.kernel.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2018-10-26 16:38:16 -07:00
..
kasan mm/kasan/quarantine.c: make quarantine_lock a raw_spinlock_t 2018-10-26 16:38:15 -07:00
backing-dev.c
balloon_compaction.c
bootmem.c
cleancache.c
cma_debug.c
cma.c
cma.h
compaction.c psi: pressure stall information for CPU, memory, and IO 2018-10-26 16:26:32 -07:00
debug_page_ref.c
debug.c mm: provide kernel parameter to allow disabling page init poisoning 2018-10-26 16:26:34 -07:00
dmapool.c
early_ioremap.c
fadvise.c
failslab.c
filemap.c mm/filemap.c: use vmf_error() 2018-10-26 16:26:35 -07:00
frame_vector.c
frontswap.c
gup_benchmark.c mm/gup_benchmark.c: add additional pinning methods 2018-10-26 16:38:15 -07:00
gup.c mm/gup: cache dev_pagemap while pinning pages 2018-10-26 16:38:15 -07:00
highmem.c
hmm.c mm: defer ZONE_DEVICE page initialization to the point where we init pgmap 2018-10-26 16:26:34 -07:00
huge_memory.c mm: thp: fix mmu_notifier in migrate_misplaced_transhuge_page() 2018-10-26 16:38:15 -07:00
hugetlb_cgroup.c
hugetlb.c hugetlbfs: dirty pages as they are added to pagecache 2018-10-26 16:38:16 -07:00
hwpoison-inject.c
init-mm.c
internal.h
interval_tree.c
Kconfig
Kconfig.debug
khugepaged.c
kmemleak-test.c
kmemleak.c kmemleak: add module param to print warnings to dmesg 2018-10-26 16:25:19 -07:00
ksm.c
list_lru.c
maccess.c
madvise.c
Makefile arm64 updates for 4.20: 2018-10-22 17:30:06 +01:00
memblock.c mm: provide kernel parameter to allow disabling page init poisoning 2018-10-26 16:26:34 -07:00
memcontrol.c mm: don't raise MEMCG_OOM event due to failed high-order allocation 2018-10-26 16:38:14 -07:00
memfd.c
memory_hotplug.c mm/memory_hotplug.c: clean up node_states_check_changes_offline() 2018-10-26 16:26:33 -07:00
memory-failure.c
memory.c mm/memory.c: recheck page table entry with page table lock held 2018-10-26 16:26:35 -07:00
mempolicy.c mm/mempolicy.c: use match_string() helper to simplify the code 2018-10-26 16:26:33 -07:00
mempool.c
memtest.c
migrate.c mm: thp: relocate flush_cache_range() in migrate_misplaced_transhuge_page() 2018-10-26 16:38:15 -07:00
mincore.c
mlock.c
mm_init.c
mmap.c mm: brk: downgrade mmap_sem to read when shrinking 2018-10-26 16:26:35 -07:00
mmu_context.c
mmu_gather.c
mmu_notifier.c Revert "mm, mmu_notifier: annotate mmu notifiers with blockable invalidate callbacks" 2018-10-26 16:25:19 -07:00
mmzone.c
mprotect.c
mremap.c mm: mremap: downgrade mmap_sem to read when shrinking 2018-10-26 16:26:35 -07:00
msync.c
nobootmem.c
nommu.c mm/gup: cache dev_pagemap while pinning pages 2018-10-26 16:38:15 -07:00
oom_kill.c Merge branch 'siginfo-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/ebiederm/user-namespace 2018-10-24 11:22:39 +01:00
page_alloc.c mm: return zero_resv_unavail optimization 2018-10-26 16:38:15 -07:00
page_counter.c
page_ext.c
page_idle.c
page_io.c mm: split SWP_FILE into SWP_ACTIVATED and SWP_FS 2018-10-26 16:38:15 -07:00
page_isolation.c
page_owner.c
page_poison.c
page_vma_mapped.c
page-writeback.c mm/page-writeback.c: fix range_cyclic writeback vs writepages deadlock 2018-10-26 16:38:14 -07:00
pagewalk.c
percpu-internal.h
percpu-km.c
percpu-stats.c
percpu-vm.c
percpu.c
pgtable-generic.c
process_vm_access.c
quicklist.c
readahead.c
rmap.c
rodata_test.c
shmem.c
slab_common.c mm, slab: shorten kmalloc cache names for large sizes 2018-10-26 16:26:32 -07:00
slab.c mm, slab: combine kmalloc_caches and kmalloc_dma_caches 2018-10-26 16:26:31 -07:00
slab.h
slob.c
slub.c mm, slab: combine kmalloc_caches and kmalloc_dma_caches 2018-10-26 16:26:31 -07:00
sparse-vmemmap.c
sparse.c mm: provide kernel parameter to allow disabling page init poisoning 2018-10-26 16:26:34 -07:00
swap_cgroup.c
swap_slots.c
swap_state.c mm: workingset: tell cache transitions from workingset thrashing 2018-10-26 16:26:32 -07:00
swap.c mm/swap.c: remove duplicated include 2018-10-26 16:26:33 -07:00
swapfile.c mm: export add_swap_extent() 2018-10-26 16:38:15 -07:00
truncate.c
usercopy.c
userfaultfd.c
util.c kvfree(): fix misleading comment 2018-10-26 16:26:33 -07:00
vmacache.c
vmalloc.c vfree: add debug might_sleep() 2018-10-26 16:26:33 -07:00
vmpressure.c
vmscan.c mm: zero-seek shrinkers 2018-10-26 16:26:33 -07:00
vmstat.c mm/vmstat.c: assert that vmstat_text is in sync with stat_items_size 2018-10-26 16:26:35 -07:00
workingset.c mm: zero-seek shrinkers 2018-10-26 16:26:33 -07:00
z3fold.c
zbud.c
zpool.c
zsmalloc.c mm/zsmalloc.c: fix fall-through annotation 2018-10-26 16:26:35 -07:00
zswap.c