sysfs-fs-lustre 18 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544
  1. What: /sys/fs/lustre/version
  2. Date: May 2015
  3. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  4. Description:
  5. Shows current running lustre version.
  6. What: /sys/fs/lustre/pinger
  7. Date: May 2015
  8. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  9. Description:
  10. Shows if the lustre module has pinger support.
  11. "on" means yes and "off" means no.
  12. What: /sys/fs/lustre/health
  13. Date: May 2015
  14. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  15. Description:
  16. Shows whenever current system state believed to be "healthy",
  17. "NOT HEALTHY", or "LBUG" whenever lustre has experienced
  18. an internal assertion failure
  19. What: /sys/fs/lustre/jobid_name
  20. Date: May 2015
  21. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  22. Description:
  23. Currently running job "name" for this node to be transferred
  24. to Lustre servers for purposes of QoS and statistics gathering.
  25. Writing into this file will change the name, reading outputs
  26. currently set value.
  27. What: /sys/fs/lustre/jobid_var
  28. Date: May 2015
  29. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  30. Description:
  31. Control file for lustre "jobstats" functionality, write new
  32. value from the list below to change the mode:
  33. disable - disable job name reporting to the servers (default)
  34. procname_uid - form the job name as the current running
  35. command name and pid with a dot in between
  36. e.g. dd.1253
  37. nodelocal - use jobid_name value from above.
  38. What: /sys/fs/lustre/llite/<fsname>-<uuid>/blocksize
  39. Date: May 2015
  40. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  41. Description:
  42. Biggest blocksize on object storage server for this filesystem.
  43. What: /sys/fs/lustre/llite/<fsname>-<uuid>/kbytestotal
  44. Date: May 2015
  45. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  46. Description:
  47. Shows total number of kilobytes of space on this filesystem
  48. What: /sys/fs/lustre/llite/<fsname>-<uuid>/kbytesfree
  49. Date: May 2015
  50. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  51. Description:
  52. Shows total number of free kilobytes of space on this filesystem
  53. What: /sys/fs/lustre/llite/<fsname>-<uuid>/kbytesavail
  54. Date: May 2015
  55. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  56. Description:
  57. Shows total number of free kilobytes of space on this filesystem
  58. actually available for use (taking into account per-client
  59. grants and filesystem reservations).
  60. What: /sys/fs/lustre/llite/<fsname>-<uuid>/filestotal
  61. Date: May 2015
  62. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  63. Description:
  64. Shows total number of inodes on the filesystem.
  65. What: /sys/fs/lustre/llite/<fsname>-<uuid>/filesfree
  66. Date: May 2015
  67. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  68. Description:
  69. Shows estimated number of free inodes on the filesystem
  70. What: /sys/fs/lustre/llite/<fsname>-<uuid>/client_type
  71. Date: May 2015
  72. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  73. Description:
  74. Shows whenever this filesystem considers this client to be
  75. compute cluster-local or remote. Remote clients have
  76. additional uid/gid convrting logic applied.
  77. What: /sys/fs/lustre/llite/<fsname>-<uuid>/fstype
  78. Date: May 2015
  79. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  80. Description:
  81. Shows filesystem type of the filesystem
  82. What: /sys/fs/lustre/llite/<fsname>-<uuid>/uuid
  83. Date: May 2015
  84. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  85. Description:
  86. Shows this filesystem superblock uuid
  87. What: /sys/fs/lustre/llite/<fsname>-<uuid>/max_read_ahead_mb
  88. Date: May 2015
  89. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  90. Description:
  91. Sets maximum number of megabytes in system memory to be
  92. given to read-ahead cache.
  93. What: /sys/fs/lustre/llite/<fsname>-<uuid>/max_read_ahead_per_file_mb
  94. Date: May 2015
  95. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  96. Description:
  97. Sets maximum number of megabytes to read-ahead for a single file
  98. What: /sys/fs/lustre/llite/<fsname>-<uuid>/max_read_ahead_whole_mb
  99. Date: May 2015
  100. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  101. Description:
  102. For small reads, how many megabytes to actually request from
  103. the server as initial read-ahead.
  104. What: /sys/fs/lustre/llite/<fsname>-<uuid>/checksum_pages
  105. Date: May 2015
  106. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  107. Description:
  108. Enables or disables per-page checksum at llite layer, before
  109. the pages are actually given to lower level for network transfer
  110. What: /sys/fs/lustre/llite/<fsname>-<uuid>/stats_track_pid
  111. Date: May 2015
  112. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  113. Description:
  114. Limit Lustre vfs operations gathering to just a single pid.
  115. 0 to track everything.
  116. What: /sys/fs/lustre/llite/<fsname>-<uuid>/stats_track_ppid
  117. Date: May 2015
  118. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  119. Description:
  120. Limit Lustre vfs operations gathering to just a single ppid.
  121. 0 to track everything.
  122. What: /sys/fs/lustre/llite/<fsname>-<uuid>/stats_track_gid
  123. Date: May 2015
  124. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  125. Description:
  126. Limit Lustre vfs operations gathering to just a single gid.
  127. 0 to track everything.
  128. What: /sys/fs/lustre/llite/<fsname>-<uuid>/statahead_max
  129. Date: May 2015
  130. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  131. Description:
  132. Controls maximum number of statahead requests to send when
  133. sequential readdir+stat pattern is detected.
  134. What: /sys/fs/lustre/llite/<fsname>-<uuid>/statahead_agl
  135. Date: May 2015
  136. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  137. Description:
  138. Controls if AGL (async glimpse ahead - obtain object information
  139. from OSTs in parallel with MDS during statahead) should be
  140. enabled or disabled.
  141. 0 to disable, 1 to enable.
  142. What: /sys/fs/lustre/llite/<fsname>-<uuid>/lazystatfs
  143. Date: May 2015
  144. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  145. Description:
  146. Controls statfs(2) behaviour in the face of down servers.
  147. If 0, always wait for all servers to come online,
  148. if 1, ignote inactive servers.
  149. What: /sys/fs/lustre/llite/<fsname>-<uuid>/max_easize
  150. Date: May 2015
  151. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  152. Description:
  153. Shows maximum number of bytes file striping data could be
  154. in current configuration of storage.
  155. What: /sys/fs/lustre/llite/<fsname>-<uuid>/default_easize
  156. Date: May 2015
  157. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  158. Description:
  159. Shows maximum observed file striping data seen by this
  160. filesystem client instance.
  161. What: /sys/fs/lustre/llite/<fsname>-<uuid>/xattr_cache
  162. Date: May 2015
  163. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  164. Description:
  165. Controls extended attributes client-side cache.
  166. 1 to enable, 0 to disable.
  167. What: /sys/fs/lustre/ldlm/cancel_unused_locks_before_replay
  168. Date: May 2015
  169. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  170. Description:
  171. Controls if client should replay unused locks during recovery
  172. If a client tends to have a lot of unused locks in LRU,
  173. recovery times might become prolonged.
  174. 1 - just locally cancel unused locks (default)
  175. 0 - replay unused locks.
  176. What: /sys/fs/lustre/ldlm/namespaces/<name>/resource_count
  177. Date: May 2015
  178. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  179. Description:
  180. Displays number of lock resources (objects on which individual
  181. locks are taken) currently allocated in this namespace.
  182. What: /sys/fs/lustre/ldlm/namespaces/<name>/lock_count
  183. Date: May 2015
  184. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  185. Description:
  186. Displays number or locks allocated in this namespace.
  187. What: /sys/fs/lustre/ldlm/namespaces/<name>/lru_size
  188. Date: May 2015
  189. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  190. Description:
  191. Controls and displays LRU size limit for unused locks for this
  192. namespace.
  193. 0 - LRU size is unlimited, controlled by server resources
  194. positive number - number of locks to allow in lock LRU list
  195. What: /sys/fs/lustre/ldlm/namespaces/<name>/lock_unused_count
  196. Date: May 2015
  197. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  198. Description:
  199. Display number of locks currently sitting in the LRU list
  200. of this namespace
  201. What: /sys/fs/lustre/ldlm/namespaces/<name>/lru_max_age
  202. Date: May 2015
  203. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  204. Description:
  205. Maximum number of milliseconds a lock could sit in LRU list
  206. before client would voluntarily cancel it as unused.
  207. What: /sys/fs/lustre/ldlm/namespaces/<name>/early_lock_cancel
  208. Date: May 2015
  209. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  210. Description:
  211. Controls "early lock cancellation" feature on this namespace
  212. if supported by the server.
  213. When enabled, tries to preemtively cancel locks that would be
  214. cancelled by verious operations and bundle the cancellation
  215. requests in the same RPC as the main operation, which results
  216. in significant speedups due to reduced lock-pingpong RPCs.
  217. 0 - disabled
  218. 1 - enabled (default)
  219. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/granted
  220. Date: May 2015
  221. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  222. Description:
  223. Displays number of granted locks in this namespace
  224. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/grant_rate
  225. Date: May 2015
  226. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  227. Description:
  228. Number of granted locks in this namespace during last
  229. time interval
  230. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/cancel_rate
  231. Date: May 2015
  232. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  233. Description:
  234. Number of lock cancellations in this namespace during
  235. last time interval
  236. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/grant_speed
  237. Date: May 2015
  238. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  239. Description:
  240. Calculated speed of lock granting (grant_rate - cancel_rate)
  241. in this namespace
  242. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/grant_plan
  243. Date: May 2015
  244. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  245. Description:
  246. Estimated number of locks to be granted in the next time
  247. interval in this namespace
  248. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/limit
  249. Date: May 2015
  250. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  251. Description:
  252. Controls number of allowed locks in this pool.
  253. When lru_size is 0, this is the actual limit then.
  254. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/lock_volume_factor
  255. Date: May 2015
  256. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  257. Description:
  258. Multiplier for all lock volume calculations above.
  259. Default is 1. Increase to make the client to more agressively
  260. clean it's lock LRU list for this namespace.
  261. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/server_lock_volume
  262. Date: May 2015
  263. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  264. Description:
  265. Calculated server lock volume.
  266. What: /sys/fs/lustre/ldlm/namespaces/<name>/pool/recalc_period
  267. Date: May 2015
  268. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  269. Description:
  270. Controls length of time between recalculation of above
  271. values (in seconds).
  272. What: /sys/fs/lustre/ldlm/services/ldlm_cbd/threads_min
  273. Date: May 2015
  274. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  275. Description:
  276. Controls minimum number of ldlm callback threads to start.
  277. What: /sys/fs/lustre/ldlm/services/ldlm_cbd/threads_max
  278. Date: May 2015
  279. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  280. Description:
  281. Controls maximum number of ldlm callback threads to start.
  282. What: /sys/fs/lustre/ldlm/services/ldlm_cbd/threads_started
  283. Date: May 2015
  284. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  285. Description:
  286. Shows actual number of ldlm callback threads running.
  287. What: /sys/fs/lustre/ldlm/services/ldlm_cbd/high_priority_ratio
  288. Date: May 2015
  289. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  290. Description:
  291. Controls what percentage of ldlm callback threads is dedicated
  292. to "high priority" incoming requests.
  293. What: /sys/fs/lustre/{obdtype}/{connection_name}/blocksize
  294. Date: May 2015
  295. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  296. Description:
  297. Blocksize on backend filesystem for service behind this obd
  298. device (or biggest blocksize for compound devices like lov
  299. and lmv)
  300. What: /sys/fs/lustre/{obdtype}/{connection_name}/kbytestotal
  301. Date: May 2015
  302. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  303. Description:
  304. Total number of kilobytes of space on backend filesystem
  305. for service behind this obd (or total amount for compound
  306. devices like lov lmv)
  307. What: /sys/fs/lustre/{obdtype}/{connection_name}/kbytesfree
  308. Date: May 2015
  309. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  310. Description:
  311. Number of free kilobytes on backend filesystem for service
  312. behind this obd (or total amount for compound devices
  313. like lov lmv)
  314. What: /sys/fs/lustre/{obdtype}/{connection_name}/kbytesavail
  315. Date: May 2015
  316. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  317. Description:
  318. Number of kilobytes of free space on backend filesystem
  319. for service behind this obd (or total amount for compound
  320. devices like lov lmv) that is actually available for use
  321. (taking into account per-client and filesystem reservations).
  322. What: /sys/fs/lustre/{obdtype}/{connection_name}/filestotal
  323. Date: May 2015
  324. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  325. Description:
  326. Number of inodes on backend filesystem for service behind this
  327. obd.
  328. What: /sys/fs/lustre/{obdtype}/{connection_name}/filesfree
  329. Date: May 2015
  330. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  331. Description:
  332. Number of free inodes on backend filesystem for service
  333. behind this obd.
  334. What: /sys/fs/lustre/mdc/{connection_name}/max_pages_per_rpc
  335. Date: May 2015
  336. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  337. Description:
  338. Maximum number of readdir pages to fit into a single readdir
  339. RPC.
  340. What: /sys/fs/lustre/{mdc,osc}/{connection_name}/max_rpcs_in_flight
  341. Date: May 2015
  342. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  343. Description:
  344. Maximum number of parallel RPCs on the wire to allow on
  345. this connection. Increasing this number would help on higher
  346. latency links, but has a chance of overloading a server
  347. if you have too many clients like this.
  348. Default: 8
  349. What: /sys/fs/lustre/osc/{connection_name}/max_pages_per_rpc
  350. Date: May 2015
  351. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  352. Description:
  353. Maximum number of pages to fit into a single RPC.
  354. Typically bigger RPCs allow for better performance.
  355. Default: however many pages to form 1M of data (256 pages
  356. for 4K page sized platforms)
  357. What: /sys/fs/lustre/osc/{connection_name}/active
  358. Date: May 2015
  359. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  360. Description:
  361. Controls accessibility of this connection. If set to 0,
  362. fail all accesses immediately.
  363. What: /sys/fs/lustre/osc/{connection_name}/checksums
  364. Date: May 2015
  365. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  366. Description:
  367. Controls whenever to checksum bulk RPC data over the wire
  368. to this target.
  369. 1: enable (default) ; 0: disable
  370. What: /sys/fs/lustre/osc/{connection_name}/contention_seconds
  371. Date: May 2015
  372. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  373. Description:
  374. Controls for how long to consider a file contended once
  375. indicated as such by the server.
  376. When a file is considered contended, all operations switch to
  377. synchronous lockless mode to avoid cache and lock pingpong.
  378. What: /sys/fs/lustre/osc/{connection_name}/cur_dirty_bytes
  379. Date: May 2015
  380. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  381. Description:
  382. Displays how many dirty bytes is presently in the cache for this
  383. target.
  384. What: /sys/fs/lustre/osc/{connection_name}/cur_grant_bytes
  385. Date: May 2015
  386. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  387. Description:
  388. Shows how many bytes we have as a "dirty cache" grant from the
  389. server. Writing a value smaller than shown allows to release
  390. some grant back to the server.
  391. Dirty cache grant is a way Lustre ensures that cached successful
  392. writes on client do not end up discarded by the server due to
  393. lack of space later on.
  394. What: /sys/fs/lustre/osc/{connection_name}/cur_lost_grant_bytes
  395. Date: May 2015
  396. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  397. Description:
  398. Shows how many granted bytes were released to the server due
  399. to lack of write activity on this client.
  400. What: /sys/fs/lustre/osc/{connection_name}/grant_shrink_interval
  401. Date: May 2015
  402. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  403. Description:
  404. Number of seconds with no write activity for this target
  405. to start releasing dirty grant back to the server.
  406. What: /sys/fs/lustre/osc/{connection_name}/destroys_in_flight
  407. Date: May 2015
  408. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  409. Description:
  410. Number of DESTROY RPCs currently in flight to this target.
  411. What: /sys/fs/lustre/osc/{connection_name}/lockless_truncate
  412. Date: May 2015
  413. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  414. Description:
  415. Controls whether lockless truncate RPCs are allowed to this
  416. target.
  417. Lockless truncate causes server to perform the locking which
  418. is beneficial if the truncate is not followed by a write
  419. immediately.
  420. 1: enable ; 0: disable (default)
  421. What: /sys/fs/lustre/osc/{connection_name}/max_dirty_mb
  422. Date: May 2015
  423. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  424. Description:
  425. Controls how much dirty data this client can accumulate
  426. for this target. This is orthogonal to dirty grant and is
  427. a hard limit even if the server would allow a bigger dirty
  428. cache.
  429. While allowing higher dirty cache is beneficial for write
  430. performance, flushing write cache takes longer and as such
  431. the node might be more prone to OOMs.
  432. Having this value set too low might result in not being able
  433. to sent too many parallel WRITE RPCs.
  434. Default: 32
  435. What: /sys/fs/lustre/osc/{connection_name}/resend_count
  436. Date: May 2015
  437. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  438. Description:
  439. Controls how many times to try and resend RPCs to this target
  440. that failed with "recoverable" status, such as EAGAIN,
  441. ENOMEM.
  442. What: /sys/fs/lustre/lov/{connection_name}/numobd
  443. Date: May 2015
  444. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  445. Description:
  446. Number of OSC targets managed by this LOV instance.
  447. What: /sys/fs/lustre/lov/{connection_name}/activeobd
  448. Date: May 2015
  449. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  450. Description:
  451. Number of OSC targets managed by this LOV instance that are
  452. actually active.
  453. What: /sys/fs/lustre/lmv/{connection_name}/numobd
  454. Date: May 2015
  455. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  456. Description:
  457. Number of MDC targets managed by this LMV instance.
  458. What: /sys/fs/lustre/lmv/{connection_name}/activeobd
  459. Date: May 2015
  460. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  461. Description:
  462. Number of MDC targets managed by this LMV instance that are
  463. actually active.
  464. What: /sys/fs/lustre/lmv/{connection_name}/placement
  465. Date: May 2015
  466. Contact: "Oleg Drokin" <oleg.drokin@intel.com>
  467. Description:
  468. Determines policy of inode placement in case of multiple
  469. metadata servers:
  470. CHAR - based on a hash of the file name used at creation time
  471. (Default)
  472. NID - based on a hash of creating client network id.