aboutsummaryrefslogtreecommitdiffstats
path: root/Documentation/filesystems
diff options
context:
space:
mode:
Diffstat (limited to 'Documentation/filesystems')
-rw-r--r--Documentation/filesystems/00-INDEX5
-rw-r--r--Documentation/filesystems/Locking3
-rw-r--r--Documentation/filesystems/dax.txt94
-rw-r--r--Documentation/filesystems/ext2.txt5
-rw-r--r--Documentation/filesystems/ext4.txt4
-rw-r--r--Documentation/filesystems/vfs.txt7
-rw-r--r--Documentation/filesystems/xip.txt71
7 files changed, 104 insertions, 85 deletions
diff --git a/Documentation/filesystems/00-INDEX b/Documentation/filesystems/00-INDEX
index ac28149aede4..9922939e7d99 100644
--- a/Documentation/filesystems/00-INDEX
+++ b/Documentation/filesystems/00-INDEX
@@ -34,6 +34,9 @@ configfs/
34 - directory containing configfs documentation and example code. 34 - directory containing configfs documentation and example code.
35cramfs.txt 35cramfs.txt
36 - info on the cram filesystem for small storage (ROMs etc). 36 - info on the cram filesystem for small storage (ROMs etc).
37dax.txt
38 - info on avoiding the page cache for files stored on CPU-addressable
39 storage devices.
37debugfs.txt 40debugfs.txt
38 - info on the debugfs filesystem. 41 - info on the debugfs filesystem.
39devpts.txt 42devpts.txt
@@ -154,5 +157,3 @@ xfs-self-describing-metadata.txt
154 - info on XFS Self Describing Metadata. 157 - info on XFS Self Describing Metadata.
155xfs.txt 158xfs.txt
156 - info and mount options for the XFS filesystem. 159 - info and mount options for the XFS filesystem.
157xip.txt
158 - info on execute-in-place for file mappings.
diff --git a/Documentation/filesystems/Locking b/Documentation/filesystems/Locking
index b30753cbf431..2ca3d17eee56 100644
--- a/Documentation/filesystems/Locking
+++ b/Documentation/filesystems/Locking
@@ -199,8 +199,6 @@ prototypes:
199 int (*releasepage) (struct page *, int); 199 int (*releasepage) (struct page *, int);
200 void (*freepage)(struct page *); 200 void (*freepage)(struct page *);
201 int (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset); 201 int (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset);
202 int (*get_xip_mem)(struct address_space *, pgoff_t, int, void **,
203 unsigned long *);
204 int (*migratepage)(struct address_space *, struct page *, struct page *); 202 int (*migratepage)(struct address_space *, struct page *, struct page *);
205 int (*launder_page)(struct page *); 203 int (*launder_page)(struct page *);
206 int (*is_partially_uptodate)(struct page *, unsigned long, unsigned long); 204 int (*is_partially_uptodate)(struct page *, unsigned long, unsigned long);
@@ -225,7 +223,6 @@ invalidatepage: yes
225releasepage: yes 223releasepage: yes
226freepage: yes 224freepage: yes
227direct_IO: 225direct_IO:
228get_xip_mem: maybe
229migratepage: yes (both) 226migratepage: yes (both)
230launder_page: yes 227launder_page: yes
231is_partially_uptodate: yes 228is_partially_uptodate: yes
diff --git a/Documentation/filesystems/dax.txt b/Documentation/filesystems/dax.txt
new file mode 100644
index 000000000000..baf41118660d
--- /dev/null
+++ b/Documentation/filesystems/dax.txt
@@ -0,0 +1,94 @@
1Direct Access for files
2-----------------------
3
4Motivation
5----------
6
7The page cache is usually used to buffer reads and writes to files.
8It is also used to provide the pages which are mapped into userspace
9by a call to mmap.
10
11For block devices that are memory-like, the page cache pages would be
12unnecessary copies of the original storage. The DAX code removes the
13extra copy by performing reads and writes directly to the storage device.
14For file mappings, the storage device is mapped directly into userspace.
15
16
17Usage
18-----
19
20If you have a block device which supports DAX, you can make a filesystem
21on it as usual. When mounting it, use the -o dax option manually
22or add 'dax' to the options in /etc/fstab.
23
24
25Implementation Tips for Block Driver Writers
26--------------------------------------------
27
28To support DAX in your block driver, implement the 'direct_access'
29block device operation. It is used to translate the sector number
30(expressed in units of 512-byte sectors) to a page frame number (pfn)
31that identifies the physical page for the memory. It also returns a
32kernel virtual address that can be used to access the memory.
33
34The direct_access method takes a 'size' parameter that indicates the
35number of bytes being requested. The function should return the number
36of bytes that can be contiguously accessed at that offset. It may also
37return a negative errno if an error occurs.
38
39In order to support this method, the storage must be byte-accessible by
40the CPU at all times. If your device uses paging techniques to expose
41a large amount of memory through a smaller window, then you cannot
42implement direct_access. Equally, if your device can occasionally
43stall the CPU for an extended period, you should also not attempt to
44implement direct_access.
45
46These block devices may be used for inspiration:
47- axonram: Axon DDR2 device driver
48- brd: RAM backed block device driver
49- dcssblk: s390 dcss block device driver
50
51
52Implementation Tips for Filesystem Writers
53------------------------------------------
54
55Filesystem support consists of
56- adding support to mark inodes as being DAX by setting the S_DAX flag in
57 i_flags
58- implementing the direct_IO address space operation, and calling
59 dax_do_io() instead of blockdev_direct_IO() if S_DAX is set
60- implementing an mmap file operation for DAX files which sets the
61 VM_MIXEDMAP flag on the VMA, and setting the vm_ops to include handlers
62 for fault and page_mkwrite (which should probably call dax_fault() and
63 dax_mkwrite(), passing the appropriate get_block() callback)
64- calling dax_truncate_page() instead of block_truncate_page() for DAX files
65- calling dax_zero_page_range() instead of zero_user() for DAX files
66- ensuring that there is sufficient locking between reads, writes,
67 truncates and page faults
68
69The get_block() callback passed to the DAX functions may return
70uninitialised extents. If it does, it must ensure that simultaneous
71calls to get_block() (for example by a page-fault racing with a read()
72or a write()) work correctly.
73
74These filesystems may be used for inspiration:
75- ext2: the second extended filesystem, see Documentation/filesystems/ext2.txt
76- ext4: the fourth extended filesystem, see Documentation/filesystems/ext4.txt
77
78
79Shortcomings
80------------
81
82Even if the kernel or its modules are stored on a filesystem that supports
83DAX on a block device that supports DAX, they will still be copied into RAM.
84
85The DAX code does not work correctly on architectures which have virtually
86mapped caches such as ARM, MIPS and SPARC.
87
88Calling get_user_pages() on a range of user memory that has been mmaped
89from a DAX file will fail as there are no 'struct page' to describe
90those pages. This problem is being worked on. That means that O_DIRECT
91reads/writes to those memory ranges from a non-DAX file will fail (note
92that O_DIRECT reads/writes _of a DAX file_ do work, it is the memory
93that is being accessed that is key here). Other things that will not
94work include RDMA, sendfile() and splice().
diff --git a/Documentation/filesystems/ext2.txt b/Documentation/filesystems/ext2.txt
index 67639f905f10..b9714569e472 100644
--- a/Documentation/filesystems/ext2.txt
+++ b/Documentation/filesystems/ext2.txt
@@ -20,6 +20,9 @@ minixdf Makes `df' act like Minix.
20check=none, nocheck (*) Don't do extra checking of bitmaps on mount 20check=none, nocheck (*) Don't do extra checking of bitmaps on mount
21 (check=normal and check=strict options removed) 21 (check=normal and check=strict options removed)
22 22
23dax Use direct access (no page cache). See
24 Documentation/filesystems/dax.txt.
25
23debug Extra debugging information is sent to the 26debug Extra debugging information is sent to the
24 kernel syslog. Useful for developers. 27 kernel syslog. Useful for developers.
25 28
@@ -56,8 +59,6 @@ noacl Don't support POSIX ACLs.
56 59
57nobh Do not attach buffer_heads to file pagecache. 60nobh Do not attach buffer_heads to file pagecache.
58 61
59xip Use execute in place (no caching) if possible
60
61grpquota,noquota,quota,usrquota Quota options are silently ignored by ext2. 62grpquota,noquota,quota,usrquota Quota options are silently ignored by ext2.
62 63
63 64
diff --git a/Documentation/filesystems/ext4.txt b/Documentation/filesystems/ext4.txt
index 919a3293aaa4..6c0108eb0137 100644
--- a/Documentation/filesystems/ext4.txt
+++ b/Documentation/filesystems/ext4.txt
@@ -386,6 +386,10 @@ max_dir_size_kb=n This limits the size of directories so that any
386i_version Enable 64-bit inode version support. This option is 386i_version Enable 64-bit inode version support. This option is
387 off by default. 387 off by default.
388 388
389dax Use direct access (no page cache). See
390 Documentation/filesystems/dax.txt. Note that
391 this option is incompatible with data=journal.
392
389Data Mode 393Data Mode
390========= 394=========
391There are 3 different data modes: 395There are 3 different data modes:
diff --git a/Documentation/filesystems/vfs.txt b/Documentation/filesystems/vfs.txt
index 43ce0507ee25..966b22829f3b 100644
--- a/Documentation/filesystems/vfs.txt
+++ b/Documentation/filesystems/vfs.txt
@@ -591,8 +591,6 @@ struct address_space_operations {
591 int (*releasepage) (struct page *, int); 591 int (*releasepage) (struct page *, int);
592 void (*freepage)(struct page *); 592 void (*freepage)(struct page *);
593 ssize_t (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset); 593 ssize_t (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset);
594 struct page* (*get_xip_page)(struct address_space *, sector_t,
595 int);
596 /* migrate the contents of a page to the specified target */ 594 /* migrate the contents of a page to the specified target */
597 int (*migratepage) (struct page *, struct page *); 595 int (*migratepage) (struct page *, struct page *);
598 int (*launder_page) (struct page *); 596 int (*launder_page) (struct page *);
@@ -748,11 +746,6 @@ struct address_space_operations {
748 and transfer data directly between the storage and the 746 and transfer data directly between the storage and the
749 application's address space. 747 application's address space.
750 748
751 get_xip_page: called by the VM to translate a block number to a page.
752 The page is valid until the corresponding filesystem is unmounted.
753 Filesystems that want to use execute-in-place (XIP) need to implement
754 it. An example implementation can be found in fs/ext2/xip.c.
755
756 migrate_page: This is used to compact the physical memory usage. 749 migrate_page: This is used to compact the physical memory usage.
757 If the VM wants to relocate a page (maybe off a memory card 750 If the VM wants to relocate a page (maybe off a memory card
758 that is signalling imminent failure) it will pass a new page 751 that is signalling imminent failure) it will pass a new page
diff --git a/Documentation/filesystems/xip.txt b/Documentation/filesystems/xip.txt
deleted file mode 100644
index b77472949ede..000000000000
--- a/Documentation/filesystems/xip.txt
+++ /dev/null
@@ -1,71 +0,0 @@
1Execute-in-place for file mappings
2----------------------------------
3
4Motivation
5----------
6File mappings are performed by mapping page cache pages to userspace. In
7addition, read&write type file operations also transfer data from/to the page
8cache.
9
10For memory backed storage devices that use the block device interface, the page
11cache pages are in fact copies of the original storage. Various approaches
12exist to work around the need for an extra copy. The ramdisk driver for example
13does read the data into the page cache, keeps a reference, and discards the
14original data behind later on.
15
16Execute-in-place solves this issue the other way around: instead of keeping
17data in the page cache, the need to have a page cache copy is eliminated
18completely. With execute-in-place, read&write type operations are performed
19directly from/to the memory backed storage device. For file mappings, the
20storage device itself is mapped directly into userspace.
21
22This implementation was initially written for shared memory segments between
23different virtual machines on s390 hardware to allow multiple machines to
24share the same binaries and libraries.
25
26Implementation
27--------------
28Execute-in-place is implemented in three steps: block device operation,
29address space operation, and file operations.
30
31A block device operation named direct_access is used to translate the
32block device sector number to a page frame number (pfn) that identifies
33the physical page for the memory. It also returns a kernel virtual
34address that can be used to access the memory.
35
36The direct_access method takes a 'size' parameter that indicates the
37number of bytes being requested. The function should return the number
38of bytes that can be contiguously accessed at that offset. It may also
39return a negative errno if an error occurs.
40
41The block device operation is optional, these block devices support it as of
42today:
43- dcssblk: s390 dcss block device driver
44
45An address space operation named get_xip_mem is used to retrieve references
46to a page frame number and a kernel address. To obtain these values a reference
47to an address_space is provided. This function assigns values to the kmem and
48pfn parameters. The third argument indicates whether the function should allocate
49blocks if needed.
50
51This address space operation is mutually exclusive with readpage&writepage that
52do page cache read/write operations.
53The following filesystems support it as of today:
54- ext2: the second extended filesystem, see Documentation/filesystems/ext2.txt
55
56A set of file operations that do utilize get_xip_page can be found in
57mm/filemap_xip.c . The following file operation implementations are provided:
58- aio_read/aio_write
59- readv/writev
60- sendfile
61
62The generic file operations do_sync_read/do_sync_write can be used to implement
63classic synchronous IO calls.
64
65Shortcomings
66------------
67This implementation is limited to storage devices that are cpu addressable at
68all times (no highmem or such). It works well on rom/ram, but enhancements are
69needed to make it work with flash in read+write mode.
70Putting the Linux kernel and/or its modules on a xip filesystem does not mean
71they are not copied.