aboutsummaryrefslogtreecommitdiffstats
path: root/Documentation/filesystems
diff options
context:
space:
mode:
authorMatthew Wilcox <willy@linux.intel.com>2015-02-16 18:59:09 -0500
committerLinus Torvalds <torvalds@linux-foundation.org>2015-02-16 20:56:03 -0500
commit95ec8daba310b44302d2977dd54b16886527b681 (patch)
tree4f10e6ffa9ef935381d87ee1450b644d74eecb64 /Documentation/filesystems
parent4c0ccfef2e9f7418a6eb0bf07a2fc8f216365b18 (diff)
dax: replace XIP documentation with DAX documentation
Based on the original XIP documentation, this documents the current state of affairs, and includes instructions on how users can enable DAX if their devices and kernel support it. Signed-off-by: Matthew Wilcox <willy@linux.intel.com> Reviewed-by: Randy Dunlap <rdunlap@infradead.org> Cc: Andreas Dilger <andreas.dilger@intel.com> Cc: Boaz Harrosh <boaz@plexistor.com> Cc: Christoph Hellwig <hch@lst.de> Cc: Dave Chinner <david@fromorbit.com> Cc: Jan Kara <jack@suse.cz> Cc: Jens Axboe <axboe@kernel.dk> Cc: Kirill A. Shutemov <kirill.shutemov@linux.intel.com> Cc: Mathieu Desnoyers <mathieu.desnoyers@efficios.com> Cc: Ross Zwisler <ross.zwisler@linux.intel.com> Cc: Theodore Ts'o <tytso@mit.edu> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
Diffstat (limited to 'Documentation/filesystems')
-rw-r--r--Documentation/filesystems/00-INDEX5
-rw-r--r--Documentation/filesystems/dax.txt89
-rw-r--r--Documentation/filesystems/xip.txt71
3 files changed, 92 insertions, 73 deletions
diff --git a/Documentation/filesystems/00-INDEX b/Documentation/filesystems/00-INDEX
index ac28149aede4..9922939e7d99 100644
--- a/Documentation/filesystems/00-INDEX
+++ b/Documentation/filesystems/00-INDEX
@@ -34,6 +34,9 @@ configfs/
34 - directory containing configfs documentation and example code. 34 - directory containing configfs documentation and example code.
35cramfs.txt 35cramfs.txt
36 - info on the cram filesystem for small storage (ROMs etc). 36 - info on the cram filesystem for small storage (ROMs etc).
37dax.txt
38 - info on avoiding the page cache for files stored on CPU-addressable
39 storage devices.
37debugfs.txt 40debugfs.txt
38 - info on the debugfs filesystem. 41 - info on the debugfs filesystem.
39devpts.txt 42devpts.txt
@@ -154,5 +157,3 @@ xfs-self-describing-metadata.txt
154 - info on XFS Self Describing Metadata. 157 - info on XFS Self Describing Metadata.
155xfs.txt 158xfs.txt
156 - info and mount options for the XFS filesystem. 159 - info and mount options for the XFS filesystem.
157xip.txt
158 - info on execute-in-place for file mappings.
diff --git a/Documentation/filesystems/dax.txt b/Documentation/filesystems/dax.txt
new file mode 100644
index 000000000000..635adaa1e425
--- /dev/null
+++ b/Documentation/filesystems/dax.txt
@@ -0,0 +1,89 @@
1Direct Access for files
2-----------------------
3
4Motivation
5----------
6
7The page cache is usually used to buffer reads and writes to files.
8It is also used to provide the pages which are mapped into userspace
9by a call to mmap.
10
11For block devices that are memory-like, the page cache pages would be
12unnecessary copies of the original storage. The DAX code removes the
13extra copy by performing reads and writes directly to the storage device.
14For file mappings, the storage device is mapped directly into userspace.
15
16
17Usage
18-----
19
20If you have a block device which supports DAX, you can make a filesystem
21on it as usual. When mounting it, use the -o dax option manually
22or add 'dax' to the options in /etc/fstab.
23
24
25Implementation Tips for Block Driver Writers
26--------------------------------------------
27
28To support DAX in your block driver, implement the 'direct_access'
29block device operation. It is used to translate the sector number
30(expressed in units of 512-byte sectors) to a page frame number (pfn)
31that identifies the physical page for the memory. It also returns a
32kernel virtual address that can be used to access the memory.
33
34The direct_access method takes a 'size' parameter that indicates the
35number of bytes being requested. The function should return the number
36of bytes that can be contiguously accessed at that offset. It may also
37return a negative errno if an error occurs.
38
39In order to support this method, the storage must be byte-accessible by
40the CPU at all times. If your device uses paging techniques to expose
41a large amount of memory through a smaller window, then you cannot
42implement direct_access. Equally, if your device can occasionally
43stall the CPU for an extended period, you should also not attempt to
44implement direct_access.
45
46These block devices may be used for inspiration:
47- axonram: Axon DDR2 device driver
48- brd: RAM backed block device driver
49- dcssblk: s390 dcss block device driver
50
51
52Implementation Tips for Filesystem Writers
53------------------------------------------
54
55Filesystem support consists of
56- adding support to mark inodes as being DAX by setting the S_DAX flag in
57 i_flags
58- implementing the direct_IO address space operation, and calling
59 dax_do_io() instead of blockdev_direct_IO() if S_DAX is set
60- implementing an mmap file operation for DAX files which sets the
61 VM_MIXEDMAP flag on the VMA, and setting the vm_ops to include handlers
62 for fault and page_mkwrite (which should probably call dax_fault() and
63 dax_mkwrite(), passing the appropriate get_block() callback)
64- calling dax_truncate_page() instead of block_truncate_page() for DAX files
65- ensuring that there is sufficient locking between reads, writes,
66 truncates and page faults
67
68The get_block() callback passed to the DAX functions may return
69uninitialised extents. If it does, it must ensure that simultaneous
70calls to get_block() (for example by a page-fault racing with a read()
71or a write()) work correctly.
72
73These filesystems may be used for inspiration:
74- ext2: the second extended filesystem, see Documentation/filesystems/ext2.txt
75
76
77Shortcomings
78------------
79
80Even if the kernel or its modules are stored on a filesystem that supports
81DAX on a block device that supports DAX, they will still be copied into RAM.
82
83Calling get_user_pages() on a range of user memory that has been mmaped
84from a DAX file will fail as there are no 'struct page' to describe
85those pages. This problem is being worked on. That means that O_DIRECT
86reads/writes to those memory ranges from a non-DAX file will fail (note
87that O_DIRECT reads/writes _of a DAX file_ do work, it is the memory
88that is being accessed that is key here). Other things that will not
89work include RDMA, sendfile() and splice().
diff --git a/Documentation/filesystems/xip.txt b/Documentation/filesystems/xip.txt
deleted file mode 100644
index b77472949ede..000000000000
--- a/Documentation/filesystems/xip.txt
+++ /dev/null
@@ -1,71 +0,0 @@
1Execute-in-place for file mappings
2----------------------------------
3
4Motivation
5----------
6File mappings are performed by mapping page cache pages to userspace. In
7addition, read&write type file operations also transfer data from/to the page
8cache.
9
10For memory backed storage devices that use the block device interface, the page
11cache pages are in fact copies of the original storage. Various approaches
12exist to work around the need for an extra copy. The ramdisk driver for example
13does read the data into the page cache, keeps a reference, and discards the
14original data behind later on.
15
16Execute-in-place solves this issue the other way around: instead of keeping
17data in the page cache, the need to have a page cache copy is eliminated
18completely. With execute-in-place, read&write type operations are performed
19directly from/to the memory backed storage device. For file mappings, the
20storage device itself is mapped directly into userspace.
21
22This implementation was initially written for shared memory segments between
23different virtual machines on s390 hardware to allow multiple machines to
24share the same binaries and libraries.
25
26Implementation
27--------------
28Execute-in-place is implemented in three steps: block device operation,
29address space operation, and file operations.
30
31A block device operation named direct_access is used to translate the
32block device sector number to a page frame number (pfn) that identifies
33the physical page for the memory. It also returns a kernel virtual
34address that can be used to access the memory.
35
36The direct_access method takes a 'size' parameter that indicates the
37number of bytes being requested. The function should return the number
38of bytes that can be contiguously accessed at that offset. It may also
39return a negative errno if an error occurs.
40
41The block device operation is optional, these block devices support it as of
42today:
43- dcssblk: s390 dcss block device driver
44
45An address space operation named get_xip_mem is used to retrieve references
46to a page frame number and a kernel address. To obtain these values a reference
47to an address_space is provided. This function assigns values to the kmem and
48pfn parameters. The third argument indicates whether the function should allocate
49blocks if needed.
50
51This address space operation is mutually exclusive with readpage&writepage that
52do page cache read/write operations.
53The following filesystems support it as of today:
54- ext2: the second extended filesystem, see Documentation/filesystems/ext2.txt
55
56A set of file operations that do utilize get_xip_page can be found in
57mm/filemap_xip.c . The following file operation implementations are provided:
58- aio_read/aio_write
59- readv/writev
60- sendfile
61
62The generic file operations do_sync_read/do_sync_write can be used to implement
63classic synchronous IO calls.
64
65Shortcomings
66------------
67This implementation is limited to storage devices that are cpu addressable at
68all times (no highmem or such). It works well on rom/ram, but enhancements are
69needed to make it work with flash in read+write mode.
70Putting the Linux kernel and/or its modules on a xip filesystem does not mean
71they are not copied.