1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677787980 |
- inotify
- a powerful yet simple file change notification system
- Document started 15 Mar 2005 by Robert Love <rml@novell.com>
- Document updated 4 Jan 2015 by Zhang Zhen <zhenzhang.zhang@huawei.com>
- --Deleted obsoleted interface, just refer to manpages for user interface.
- (i) Rationale
- Q: What is the design decision behind not tying the watch to the open fd of
- the watched object?
- A: Watches are associated with an open inotify device, not an open file.
- This solves the primary problem with dnotify: keeping the file open pins
- the file and thus, worse, pins the mount. Dnotify is therefore infeasible
- for use on a desktop system with removable media as the media cannot be
- unmounted. Watching a file should not require that it be open.
- Q: What is the design decision behind using an-fd-per-instance as opposed to
- an fd-per-watch?
- A: An fd-per-watch quickly consumes more file descriptors than are allowed,
- more fd's than are feasible to manage, and more fd's than are optimally
- select()-able. Yes, root can bump the per-process fd limit and yes, users
- can use epoll, but requiring both is a silly and extraneous requirement.
- A watch consumes less memory than an open file, separating the number
- spaces is thus sensible. The current design is what user-space developers
- want: Users initialize inotify, once, and add n watches, requiring but one
- fd and no twiddling with fd limits. Initializing an inotify instance two
- thousand times is silly. If we can implement user-space's preferences
- cleanly--and we can, the idr layer makes stuff like this trivial--then we
- should.
- There are other good arguments. With a single fd, there is a single
- item to block on, which is mapped to a single queue of events. The single
- fd returns all watch events and also any potential out-of-band data. If
- every fd was a separate watch,
- - There would be no way to get event ordering. Events on file foo and
- file bar would pop poll() on both fd's, but there would be no way to tell
- which happened first. A single queue trivially gives you ordering. Such
- ordering is crucial to existing applications such as Beagle. Imagine
- "mv a b ; mv b a" events without ordering.
- - We'd have to maintain n fd's and n internal queues with state,
- versus just one. It is a lot messier in the kernel. A single, linear
- queue is the data structure that makes sense.
- - User-space developers prefer the current API. The Beagle guys, for
- example, love it. Trust me, I asked. It is not a surprise: Who'd want
- to manage and block on 1000 fd's via select?
- - No way to get out of band data.
- - 1024 is still too low. ;-)
- When you talk about designing a file change notification system that
- scales to 1000s of directories, juggling 1000s of fd's just does not seem
- the right interface. It is too heavy.
- Additionally, it _is_ possible to more than one instance and
- juggle more than one queue and thus more than one associated fd. There
- need not be a one-fd-per-process mapping; it is one-fd-per-queue and a
- process can easily want more than one queue.
- Q: Why the system call approach?
- A: The poor user-space interface is the second biggest problem with dnotify.
- Signals are a terrible, terrible interface for file notification. Or for
- anything, for that matter. The ideal solution, from all perspectives, is a
- file descriptor-based one that allows basic file I/O and poll/select.
- Obtaining the fd and managing the watches could have been done either via a
- device file or a family of new system calls. We decided to implement a
- family of system calls because that is the preferred approach for new kernel
- interfaces. The only real difference was whether we wanted to use open(2)
- and ioctl(2) or a couple of new system calls. System calls beat ioctls.
|