diff options
Diffstat (limited to 'Documentation/filesystems')
-rw-r--r-- | Documentation/filesystems/00-INDEX | 5 | ||||
-rw-r--r-- | Documentation/filesystems/Locking | 3 | ||||
-rw-r--r-- | Documentation/filesystems/dax.txt | 94 | ||||
-rw-r--r-- | Documentation/filesystems/ext2.txt | 5 | ||||
-rw-r--r-- | Documentation/filesystems/ext4.txt | 4 | ||||
-rw-r--r-- | Documentation/filesystems/vfs.txt | 7 | ||||
-rw-r--r-- | Documentation/filesystems/xip.txt | 71 |
7 files changed, 104 insertions, 85 deletions
diff --git a/Documentation/filesystems/00-INDEX b/Documentation/filesystems/00-INDEX index ac28149aede4..9922939e7d99 100644 --- a/Documentation/filesystems/00-INDEX +++ b/Documentation/filesystems/00-INDEX | |||
@@ -34,6 +34,9 @@ configfs/ | |||
34 | - directory containing configfs documentation and example code. | 34 | - directory containing configfs documentation and example code. |
35 | cramfs.txt | 35 | cramfs.txt |
36 | - info on the cram filesystem for small storage (ROMs etc). | 36 | - info on the cram filesystem for small storage (ROMs etc). |
37 | dax.txt | ||
38 | - info on avoiding the page cache for files stored on CPU-addressable | ||
39 | storage devices. | ||
37 | debugfs.txt | 40 | debugfs.txt |
38 | - info on the debugfs filesystem. | 41 | - info on the debugfs filesystem. |
39 | devpts.txt | 42 | devpts.txt |
@@ -154,5 +157,3 @@ xfs-self-describing-metadata.txt | |||
154 | - info on XFS Self Describing Metadata. | 157 | - info on XFS Self Describing Metadata. |
155 | xfs.txt | 158 | xfs.txt |
156 | - info and mount options for the XFS filesystem. | 159 | - info and mount options for the XFS filesystem. |
157 | xip.txt | ||
158 | - info on execute-in-place for file mappings. | ||
diff --git a/Documentation/filesystems/Locking b/Documentation/filesystems/Locking index b30753cbf431..2ca3d17eee56 100644 --- a/Documentation/filesystems/Locking +++ b/Documentation/filesystems/Locking | |||
@@ -199,8 +199,6 @@ prototypes: | |||
199 | int (*releasepage) (struct page *, int); | 199 | int (*releasepage) (struct page *, int); |
200 | void (*freepage)(struct page *); | 200 | void (*freepage)(struct page *); |
201 | int (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset); | 201 | int (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset); |
202 | int (*get_xip_mem)(struct address_space *, pgoff_t, int, void **, | ||
203 | unsigned long *); | ||
204 | int (*migratepage)(struct address_space *, struct page *, struct page *); | 202 | int (*migratepage)(struct address_space *, struct page *, struct page *); |
205 | int (*launder_page)(struct page *); | 203 | int (*launder_page)(struct page *); |
206 | int (*is_partially_uptodate)(struct page *, unsigned long, unsigned long); | 204 | int (*is_partially_uptodate)(struct page *, unsigned long, unsigned long); |
@@ -225,7 +223,6 @@ invalidatepage: yes | |||
225 | releasepage: yes | 223 | releasepage: yes |
226 | freepage: yes | 224 | freepage: yes |
227 | direct_IO: | 225 | direct_IO: |
228 | get_xip_mem: maybe | ||
229 | migratepage: yes (both) | 226 | migratepage: yes (both) |
230 | launder_page: yes | 227 | launder_page: yes |
231 | is_partially_uptodate: yes | 228 | is_partially_uptodate: yes |
diff --git a/Documentation/filesystems/dax.txt b/Documentation/filesystems/dax.txt new file mode 100644 index 000000000000..baf41118660d --- /dev/null +++ b/Documentation/filesystems/dax.txt | |||
@@ -0,0 +1,94 @@ | |||
1 | Direct Access for files | ||
2 | ----------------------- | ||
3 | |||
4 | Motivation | ||
5 | ---------- | ||
6 | |||
7 | The page cache is usually used to buffer reads and writes to files. | ||
8 | It is also used to provide the pages which are mapped into userspace | ||
9 | by a call to mmap. | ||
10 | |||
11 | For block devices that are memory-like, the page cache pages would be | ||
12 | unnecessary copies of the original storage. The DAX code removes the | ||
13 | extra copy by performing reads and writes directly to the storage device. | ||
14 | For file mappings, the storage device is mapped directly into userspace. | ||
15 | |||
16 | |||
17 | Usage | ||
18 | ----- | ||
19 | |||
20 | If you have a block device which supports DAX, you can make a filesystem | ||
21 | on it as usual. When mounting it, use the -o dax option manually | ||
22 | or add 'dax' to the options in /etc/fstab. | ||
23 | |||
24 | |||
25 | Implementation Tips for Block Driver Writers | ||
26 | -------------------------------------------- | ||
27 | |||
28 | To support DAX in your block driver, implement the 'direct_access' | ||
29 | block device operation. It is used to translate the sector number | ||
30 | (expressed in units of 512-byte sectors) to a page frame number (pfn) | ||
31 | that identifies the physical page for the memory. It also returns a | ||
32 | kernel virtual address that can be used to access the memory. | ||
33 | |||
34 | The direct_access method takes a 'size' parameter that indicates the | ||
35 | number of bytes being requested. The function should return the number | ||
36 | of bytes that can be contiguously accessed at that offset. It may also | ||
37 | return a negative errno if an error occurs. | ||
38 | |||
39 | In order to support this method, the storage must be byte-accessible by | ||
40 | the CPU at all times. If your device uses paging techniques to expose | ||
41 | a large amount of memory through a smaller window, then you cannot | ||
42 | implement direct_access. Equally, if your device can occasionally | ||
43 | stall the CPU for an extended period, you should also not attempt to | ||
44 | implement direct_access. | ||
45 | |||
46 | These block devices may be used for inspiration: | ||
47 | - axonram: Axon DDR2 device driver | ||
48 | - brd: RAM backed block device driver | ||
49 | - dcssblk: s390 dcss block device driver | ||
50 | |||
51 | |||
52 | Implementation Tips for Filesystem Writers | ||
53 | ------------------------------------------ | ||
54 | |||
55 | Filesystem support consists of | ||
56 | - adding support to mark inodes as being DAX by setting the S_DAX flag in | ||
57 | i_flags | ||
58 | - implementing the direct_IO address space operation, and calling | ||
59 | dax_do_io() instead of blockdev_direct_IO() if S_DAX is set | ||
60 | - implementing an mmap file operation for DAX files which sets the | ||
61 | VM_MIXEDMAP flag on the VMA, and setting the vm_ops to include handlers | ||
62 | for fault and page_mkwrite (which should probably call dax_fault() and | ||
63 | dax_mkwrite(), passing the appropriate get_block() callback) | ||
64 | - calling dax_truncate_page() instead of block_truncate_page() for DAX files | ||
65 | - calling dax_zero_page_range() instead of zero_user() for DAX files | ||
66 | - ensuring that there is sufficient locking between reads, writes, | ||
67 | truncates and page faults | ||
68 | |||
69 | The get_block() callback passed to the DAX functions may return | ||
70 | uninitialised extents. If it does, it must ensure that simultaneous | ||
71 | calls to get_block() (for example by a page-fault racing with a read() | ||
72 | or a write()) work correctly. | ||
73 | |||
74 | These filesystems may be used for inspiration: | ||
75 | - ext2: the second extended filesystem, see Documentation/filesystems/ext2.txt | ||
76 | - ext4: the fourth extended filesystem, see Documentation/filesystems/ext4.txt | ||
77 | |||
78 | |||
79 | Shortcomings | ||
80 | ------------ | ||
81 | |||
82 | Even if the kernel or its modules are stored on a filesystem that supports | ||
83 | DAX on a block device that supports DAX, they will still be copied into RAM. | ||
84 | |||
85 | The DAX code does not work correctly on architectures which have virtually | ||
86 | mapped caches such as ARM, MIPS and SPARC. | ||
87 | |||
88 | Calling get_user_pages() on a range of user memory that has been mmaped | ||
89 | from a DAX file will fail as there are no 'struct page' to describe | ||
90 | those pages. This problem is being worked on. That means that O_DIRECT | ||
91 | reads/writes to those memory ranges from a non-DAX file will fail (note | ||
92 | that O_DIRECT reads/writes _of a DAX file_ do work, it is the memory | ||
93 | that is being accessed that is key here). Other things that will not | ||
94 | work include RDMA, sendfile() and splice(). | ||
diff --git a/Documentation/filesystems/ext2.txt b/Documentation/filesystems/ext2.txt index 67639f905f10..b9714569e472 100644 --- a/Documentation/filesystems/ext2.txt +++ b/Documentation/filesystems/ext2.txt | |||
@@ -20,6 +20,9 @@ minixdf Makes `df' act like Minix. | |||
20 | check=none, nocheck (*) Don't do extra checking of bitmaps on mount | 20 | check=none, nocheck (*) Don't do extra checking of bitmaps on mount |
21 | (check=normal and check=strict options removed) | 21 | (check=normal and check=strict options removed) |
22 | 22 | ||
23 | dax Use direct access (no page cache). See | ||
24 | Documentation/filesystems/dax.txt. | ||
25 | |||
23 | debug Extra debugging information is sent to the | 26 | debug Extra debugging information is sent to the |
24 | kernel syslog. Useful for developers. | 27 | kernel syslog. Useful for developers. |
25 | 28 | ||
@@ -56,8 +59,6 @@ noacl Don't support POSIX ACLs. | |||
56 | 59 | ||
57 | nobh Do not attach buffer_heads to file pagecache. | 60 | nobh Do not attach buffer_heads to file pagecache. |
58 | 61 | ||
59 | xip Use execute in place (no caching) if possible | ||
60 | |||
61 | grpquota,noquota,quota,usrquota Quota options are silently ignored by ext2. | 62 | grpquota,noquota,quota,usrquota Quota options are silently ignored by ext2. |
62 | 63 | ||
63 | 64 | ||
diff --git a/Documentation/filesystems/ext4.txt b/Documentation/filesystems/ext4.txt index 919a3293aaa4..6c0108eb0137 100644 --- a/Documentation/filesystems/ext4.txt +++ b/Documentation/filesystems/ext4.txt | |||
@@ -386,6 +386,10 @@ max_dir_size_kb=n This limits the size of directories so that any | |||
386 | i_version Enable 64-bit inode version support. This option is | 386 | i_version Enable 64-bit inode version support. This option is |
387 | off by default. | 387 | off by default. |
388 | 388 | ||
389 | dax Use direct access (no page cache). See | ||
390 | Documentation/filesystems/dax.txt. Note that | ||
391 | this option is incompatible with data=journal. | ||
392 | |||
389 | Data Mode | 393 | Data Mode |
390 | ========= | 394 | ========= |
391 | There are 3 different data modes: | 395 | There are 3 different data modes: |
diff --git a/Documentation/filesystems/vfs.txt b/Documentation/filesystems/vfs.txt index 43ce0507ee25..966b22829f3b 100644 --- a/Documentation/filesystems/vfs.txt +++ b/Documentation/filesystems/vfs.txt | |||
@@ -591,8 +591,6 @@ struct address_space_operations { | |||
591 | int (*releasepage) (struct page *, int); | 591 | int (*releasepage) (struct page *, int); |
592 | void (*freepage)(struct page *); | 592 | void (*freepage)(struct page *); |
593 | ssize_t (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset); | 593 | ssize_t (*direct_IO)(int, struct kiocb *, struct iov_iter *iter, loff_t offset); |
594 | struct page* (*get_xip_page)(struct address_space *, sector_t, | ||
595 | int); | ||
596 | /* migrate the contents of a page to the specified target */ | 594 | /* migrate the contents of a page to the specified target */ |
597 | int (*migratepage) (struct page *, struct page *); | 595 | int (*migratepage) (struct page *, struct page *); |
598 | int (*launder_page) (struct page *); | 596 | int (*launder_page) (struct page *); |
@@ -748,11 +746,6 @@ struct address_space_operations { | |||
748 | and transfer data directly between the storage and the | 746 | and transfer data directly between the storage and the |
749 | application's address space. | 747 | application's address space. |
750 | 748 | ||
751 | get_xip_page: called by the VM to translate a block number to a page. | ||
752 | The page is valid until the corresponding filesystem is unmounted. | ||
753 | Filesystems that want to use execute-in-place (XIP) need to implement | ||
754 | it. An example implementation can be found in fs/ext2/xip.c. | ||
755 | |||
756 | migrate_page: This is used to compact the physical memory usage. | 749 | migrate_page: This is used to compact the physical memory usage. |
757 | If the VM wants to relocate a page (maybe off a memory card | 750 | If the VM wants to relocate a page (maybe off a memory card |
758 | that is signalling imminent failure) it will pass a new page | 751 | that is signalling imminent failure) it will pass a new page |
diff --git a/Documentation/filesystems/xip.txt b/Documentation/filesystems/xip.txt deleted file mode 100644 index b77472949ede..000000000000 --- a/Documentation/filesystems/xip.txt +++ /dev/null | |||
@@ -1,71 +0,0 @@ | |||
1 | Execute-in-place for file mappings | ||
2 | ---------------------------------- | ||
3 | |||
4 | Motivation | ||
5 | ---------- | ||
6 | File mappings are performed by mapping page cache pages to userspace. In | ||
7 | addition, read&write type file operations also transfer data from/to the page | ||
8 | cache. | ||
9 | |||
10 | For memory backed storage devices that use the block device interface, the page | ||
11 | cache pages are in fact copies of the original storage. Various approaches | ||
12 | exist to work around the need for an extra copy. The ramdisk driver for example | ||
13 | does read the data into the page cache, keeps a reference, and discards the | ||
14 | original data behind later on. | ||
15 | |||
16 | Execute-in-place solves this issue the other way around: instead of keeping | ||
17 | data in the page cache, the need to have a page cache copy is eliminated | ||
18 | completely. With execute-in-place, read&write type operations are performed | ||
19 | directly from/to the memory backed storage device. For file mappings, the | ||
20 | storage device itself is mapped directly into userspace. | ||
21 | |||
22 | This implementation was initially written for shared memory segments between | ||
23 | different virtual machines on s390 hardware to allow multiple machines to | ||
24 | share the same binaries and libraries. | ||
25 | |||
26 | Implementation | ||
27 | -------------- | ||
28 | Execute-in-place is implemented in three steps: block device operation, | ||
29 | address space operation, and file operations. | ||
30 | |||
31 | A block device operation named direct_access is used to translate the | ||
32 | block device sector number to a page frame number (pfn) that identifies | ||
33 | the physical page for the memory. It also returns a kernel virtual | ||
34 | address that can be used to access the memory. | ||
35 | |||
36 | The direct_access method takes a 'size' parameter that indicates the | ||
37 | number of bytes being requested. The function should return the number | ||
38 | of bytes that can be contiguously accessed at that offset. It may also | ||
39 | return a negative errno if an error occurs. | ||
40 | |||
41 | The block device operation is optional, these block devices support it as of | ||
42 | today: | ||
43 | - dcssblk: s390 dcss block device driver | ||
44 | |||
45 | An address space operation named get_xip_mem is used to retrieve references | ||
46 | to a page frame number and a kernel address. To obtain these values a reference | ||
47 | to an address_space is provided. This function assigns values to the kmem and | ||
48 | pfn parameters. The third argument indicates whether the function should allocate | ||
49 | blocks if needed. | ||
50 | |||
51 | This address space operation is mutually exclusive with readpage&writepage that | ||
52 | do page cache read/write operations. | ||
53 | The following filesystems support it as of today: | ||
54 | - ext2: the second extended filesystem, see Documentation/filesystems/ext2.txt | ||
55 | |||
56 | A set of file operations that do utilize get_xip_page can be found in | ||
57 | mm/filemap_xip.c . The following file operation implementations are provided: | ||
58 | - aio_read/aio_write | ||
59 | - readv/writev | ||
60 | - sendfile | ||
61 | |||
62 | The generic file operations do_sync_read/do_sync_write can be used to implement | ||
63 | classic synchronous IO calls. | ||
64 | |||
65 | Shortcomings | ||
66 | ------------ | ||
67 | This implementation is limited to storage devices that are cpu addressable at | ||
68 | all times (no highmem or such). It works well on rom/ram, but enhancements are | ||
69 | needed to make it work with flash in read+write mode. | ||
70 | Putting the Linux kernel and/or its modules on a xip filesystem does not mean | ||
71 | they are not copied. | ||