vmscan: split LRU lists into anon & file sets

Split the LRU lists in two, one set for pages that are backed by real file
systems ("file") and one for pages that are backed by memory and swap
("anon").  The latter includes tmpfs.

The advantage of doing this is that the VM will not have to scan over lots
of anonymous pages (which we generally do not want to swap out), just to
find the page cache pages that it should evict.

This patch has the infrastructure and a basic policy to balance how much
we scan the anon lists and how much we scan the file lists.  The big
policy changes are in separate patches.

[lee.schermerhorn@hp.com: collect lru meminfo statistics from correct offset]
[kosaki.motohiro@jp.fujitsu.com: prevent incorrect oom under split_lru]
[kosaki.motohiro@jp.fujitsu.com: fix pagevec_move_tail() doesn't treat unevictable page]
[hugh@veritas.com: memcg swapbacked pages active]
[hugh@veritas.com: splitlru: BDI_CAP_SWAP_BACKED]
[akpm@linux-foundation.org: fix /proc/vmstat units]
[nishimura@mxp.nes.nec.co.jp: memcg: fix handling of shmem migration]
[kosaki.motohiro@jp.fujitsu.com: adjust Quicklists field of /proc/meminfo]
[kosaki.motohiro@jp.fujitsu.com: fix style issue of get_scan_ratio()]
Signed-off-by: Rik van Riel <riel@redhat.com>
Signed-off-by: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
Signed-off-by: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
Signed-off-by: Hugh Dickins <hugh@veritas.com>
Signed-off-by: Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>

1 files changed, 11 insertions, 3 deletions

diff --git a/mm/swap.c b/mm/swap.c
index 88a394872677..0b1974a08974 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -116,7 +116,8 @@ static void pagevec_move_tail(struct pagevec *pvec)
                         spin_lock(&zone->lru_lock);
                 }
                 if (PageLRU(page) && !PageActive(page)) {
-                        list_move_tail(&page->lru, &zone->lru[LRU_INACTIVE].list);
+                        int lru = page_is_file_cache(page);
+                        list_move_tail(&page->lru, &zone->lru[lru].list);
                         pgmoved++;
                 }
         }
@@ -157,11 +158,18 @@ void activate_page(struct page *page)
 
         spin_lock_irq(&zone->lru_lock);
         if (PageLRU(page) && !PageActive(page)) {
-                del_page_from_inactive_list(zone, page);
+                int file = page_is_file_cache(page);
+                int lru = LRU_BASE + file;
+                del_page_from_lru_list(zone, page, lru);
+
                 SetPageActive(page);
-                add_page_to_active_list(zone, page);
+                lru += LRU_ACTIVE;
+                add_page_to_lru_list(zone, page, lru);
                 __count_vm_event(PGACTIVATE);
                 mem_cgroup_move_lists(page, true);
+
+                zone->recent_rotated[!!file]++;
+                zone->recent_scanned[!!file]++;
         }
         spin_unlock_irq(&zone->lru_lock);
 }