dm-service-time.txt 3.2 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091
  1. dm-service-time
  2. ===============
  3. dm-service-time is a path selector module for device-mapper targets,
  4. which selects a path with the shortest estimated service time for
  5. the incoming I/O.
  6. The service time for each path is estimated by dividing the total size
  7. of in-flight I/Os on a path with the performance value of the path.
  8. The performance value is a relative throughput value among all paths
  9. in a path-group, and it can be specified as a table argument.
  10. The path selector name is 'service-time'.
  11. Table parameters for each path: [<repeat_count> [<relative_throughput>]]
  12. <repeat_count>: The number of I/Os to dispatch using the selected
  13. path before switching to the next path.
  14. If not given, internal default is used. To check
  15. the default value, see the activated table.
  16. <relative_throughput>: The relative throughput value of the path
  17. among all paths in the path-group.
  18. The valid range is 0-100.
  19. If not given, minimum value '1' is used.
  20. If '0' is given, the path isn't selected while
  21. other paths having a positive value are available.
  22. Status for each path: <status> <fail-count> <in-flight-size> \
  23. <relative_throughput>
  24. <status>: 'A' if the path is active, 'F' if the path is failed.
  25. <fail-count>: The number of path failures.
  26. <in-flight-size>: The size of in-flight I/Os on the path.
  27. <relative_throughput>: The relative throughput value of the path
  28. among all paths in the path-group.
  29. Algorithm
  30. =========
  31. dm-service-time adds the I/O size to 'in-flight-size' when the I/O is
  32. dispatched and subtracts when completed.
  33. Basically, dm-service-time selects a path having minimum service time
  34. which is calculated by:
  35. ('in-flight-size' + 'size-of-incoming-io') / 'relative_throughput'
  36. However, some optimizations below are used to reduce the calculation
  37. as much as possible.
  38. 1. If the paths have the same 'relative_throughput', skip
  39. the division and just compare the 'in-flight-size'.
  40. 2. If the paths have the same 'in-flight-size', skip the division
  41. and just compare the 'relative_throughput'.
  42. 3. If some paths have non-zero 'relative_throughput' and others
  43. have zero 'relative_throughput', ignore those paths with zero
  44. 'relative_throughput'.
  45. If such optimizations can't be applied, calculate service time, and
  46. compare service time.
  47. If calculated service time is equal, the path having maximum
  48. 'relative_throughput' may be better. So compare 'relative_throughput'
  49. then.
  50. Examples
  51. ========
  52. In case that 2 paths (sda and sdb) are used with repeat_count == 128
  53. and sda has an average throughput 1GB/s and sdb has 4GB/s,
  54. 'relative_throughput' value may be '1' for sda and '4' for sdb.
  55. # echo "0 10 multipath 0 0 1 1 service-time 0 2 2 8:0 128 1 8:16 128 4" \
  56. dmsetup create test
  57. #
  58. # dmsetup table
  59. test: 0 10 multipath 0 0 1 1 service-time 0 2 2 8:0 128 1 8:16 128 4
  60. #
  61. # dmsetup status
  62. test: 0 10 multipath 2 0 0 0 1 1 E 0 2 2 8:0 A 0 0 1 8:16 A 0 0 4
  63. Or '2' for sda and '8' for sdb would be also true.
  64. # echo "0 10 multipath 0 0 1 1 service-time 0 2 2 8:0 128 2 8:16 128 8" \
  65. dmsetup create test
  66. #
  67. # dmsetup table
  68. test: 0 10 multipath 0 0 1 1 service-time 0 2 2 8:0 128 2 8:16 128 8
  69. #
  70. # dmsetup status
  71. test: 0 10 multipath 2 0 0 0 1 1 E 0 2 2 8:0 A 0 0 2 8:16 A 0 0 8