kmemleak.txt 8.5 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203
  1. Kernel Memory Leak Detector
  2. ===========================
  3. Introduction
  4. ------------
  5. Kmemleak provides a way of detecting possible kernel memory leaks in a
  6. way similar to a tracing garbage collector
  7. (https://en.wikipedia.org/wiki/Garbage_collection_%28computer_science%29#Tracing_garbage_collectors),
  8. with the difference that the orphan objects are not freed but only
  9. reported via /sys/kernel/debug/kmemleak. A similar method is used by the
  10. Valgrind tool (memcheck --leak-check) to detect the memory leaks in
  11. user-space applications.
  12. Kmemleak is supported on x86, arm, powerpc, sparc, sh, microblaze, ppc, mips, s390, metag and tile.
  13. Usage
  14. -----
  15. CONFIG_DEBUG_KMEMLEAK in "Kernel hacking" has to be enabled. A kernel
  16. thread scans the memory every 10 minutes (by default) and prints the
  17. number of new unreferenced objects found. To display the details of all
  18. the possible memory leaks:
  19. # mount -t debugfs nodev /sys/kernel/debug/
  20. # cat /sys/kernel/debug/kmemleak
  21. To trigger an intermediate memory scan:
  22. # echo scan > /sys/kernel/debug/kmemleak
  23. To clear the list of all current possible memory leaks:
  24. # echo clear > /sys/kernel/debug/kmemleak
  25. New leaks will then come up upon reading /sys/kernel/debug/kmemleak
  26. again.
  27. Note that the orphan objects are listed in the order they were allocated
  28. and one object at the beginning of the list may cause other subsequent
  29. objects to be reported as orphan.
  30. Memory scanning parameters can be modified at run-time by writing to the
  31. /sys/kernel/debug/kmemleak file. The following parameters are supported:
  32. off - disable kmemleak (irreversible)
  33. stack=on - enable the task stacks scanning (default)
  34. stack=off - disable the tasks stacks scanning
  35. scan=on - start the automatic memory scanning thread (default)
  36. scan=off - stop the automatic memory scanning thread
  37. scan=<secs> - set the automatic memory scanning period in seconds
  38. (default 600, 0 to stop the automatic scanning)
  39. scan - trigger a memory scan
  40. clear - clear list of current memory leak suspects, done by
  41. marking all current reported unreferenced objects grey,
  42. or free all kmemleak objects if kmemleak has been disabled.
  43. dump=<addr> - dump information about the object found at <addr>
  44. Kmemleak can also be disabled at boot-time by passing "kmemleak=off" on
  45. the kernel command line.
  46. Memory may be allocated or freed before kmemleak is initialised and
  47. these actions are stored in an early log buffer. The size of this buffer
  48. is configured via the CONFIG_DEBUG_KMEMLEAK_EARLY_LOG_SIZE option.
  49. If CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF are enabled, the kmemleak is
  50. disabled by default. Passing "kmemleak=on" on the kernel command
  51. line enables the function.
  52. Basic Algorithm
  53. ---------------
  54. The memory allocations via kmalloc, vmalloc, kmem_cache_alloc and
  55. friends are traced and the pointers, together with additional
  56. information like size and stack trace, are stored in a rbtree.
  57. The corresponding freeing function calls are tracked and the pointers
  58. removed from the kmemleak data structures.
  59. An allocated block of memory is considered orphan if no pointer to its
  60. start address or to any location inside the block can be found by
  61. scanning the memory (including saved registers). This means that there
  62. might be no way for the kernel to pass the address of the allocated
  63. block to a freeing function and therefore the block is considered a
  64. memory leak.
  65. The scanning algorithm steps:
  66. 1. mark all objects as white (remaining white objects will later be
  67. considered orphan)
  68. 2. scan the memory starting with the data section and stacks, checking
  69. the values against the addresses stored in the rbtree. If
  70. a pointer to a white object is found, the object is added to the
  71. gray list
  72. 3. scan the gray objects for matching addresses (some white objects
  73. can become gray and added at the end of the gray list) until the
  74. gray set is finished
  75. 4. the remaining white objects are considered orphan and reported via
  76. /sys/kernel/debug/kmemleak
  77. Some allocated memory blocks have pointers stored in the kernel's
  78. internal data structures and they cannot be detected as orphans. To
  79. avoid this, kmemleak can also store the number of values pointing to an
  80. address inside the block address range that need to be found so that the
  81. block is not considered a leak. One example is __vmalloc().
  82. Testing specific sections with kmemleak
  83. ---------------------------------------
  84. Upon initial bootup your /sys/kernel/debug/kmemleak output page may be
  85. quite extensive. This can also be the case if you have very buggy code
  86. when doing development. To work around these situations you can use the
  87. 'clear' command to clear all reported unreferenced objects from the
  88. /sys/kernel/debug/kmemleak output. By issuing a 'scan' after a 'clear'
  89. you can find new unreferenced objects; this should help with testing
  90. specific sections of code.
  91. To test a critical section on demand with a clean kmemleak do:
  92. # echo clear > /sys/kernel/debug/kmemleak
  93. ... test your kernel or modules ...
  94. # echo scan > /sys/kernel/debug/kmemleak
  95. Then as usual to get your report with:
  96. # cat /sys/kernel/debug/kmemleak
  97. Freeing kmemleak internal objects
  98. ---------------------------------
  99. To allow access to previously found memory leaks after kmemleak has been
  100. disabled by the user or due to an fatal error, internal kmemleak objects
  101. won't be freed when kmemleak is disabled, and those objects may occupy
  102. a large part of physical memory.
  103. In this situation, you may reclaim memory with:
  104. # echo clear > /sys/kernel/debug/kmemleak
  105. Kmemleak API
  106. ------------
  107. See the include/linux/kmemleak.h header for the functions prototype.
  108. kmemleak_init - initialize kmemleak
  109. kmemleak_alloc - notify of a memory block allocation
  110. kmemleak_alloc_percpu - notify of a percpu memory block allocation
  111. kmemleak_free - notify of a memory block freeing
  112. kmemleak_free_part - notify of a partial memory block freeing
  113. kmemleak_free_percpu - notify of a percpu memory block freeing
  114. kmemleak_update_trace - update object allocation stack trace
  115. kmemleak_not_leak - mark an object as not a leak
  116. kmemleak_ignore - do not scan or report an object as leak
  117. kmemleak_scan_area - add scan areas inside a memory block
  118. kmemleak_no_scan - do not scan a memory block
  119. kmemleak_erase - erase an old value in a pointer variable
  120. kmemleak_alloc_recursive - as kmemleak_alloc but checks the recursiveness
  121. kmemleak_free_recursive - as kmemleak_free but checks the recursiveness
  122. Dealing with false positives/negatives
  123. --------------------------------------
  124. The false negatives are real memory leaks (orphan objects) but not
  125. reported by kmemleak because values found during the memory scanning
  126. point to such objects. To reduce the number of false negatives, kmemleak
  127. provides the kmemleak_ignore, kmemleak_scan_area, kmemleak_no_scan and
  128. kmemleak_erase functions (see above). The task stacks also increase the
  129. amount of false negatives and their scanning is not enabled by default.
  130. The false positives are objects wrongly reported as being memory leaks
  131. (orphan). For objects known not to be leaks, kmemleak provides the
  132. kmemleak_not_leak function. The kmemleak_ignore could also be used if
  133. the memory block is known not to contain other pointers and it will no
  134. longer be scanned.
  135. Some of the reported leaks are only transient, especially on SMP
  136. systems, because of pointers temporarily stored in CPU registers or
  137. stacks. Kmemleak defines MSECS_MIN_AGE (defaulting to 1000) representing
  138. the minimum age of an object to be reported as a memory leak.
  139. Limitations and Drawbacks
  140. -------------------------
  141. The main drawback is the reduced performance of memory allocation and
  142. freeing. To avoid other penalties, the memory scanning is only performed
  143. when the /sys/kernel/debug/kmemleak file is read. Anyway, this tool is
  144. intended for debugging purposes where the performance might not be the
  145. most important requirement.
  146. To keep the algorithm simple, kmemleak scans for values pointing to any
  147. address inside a block's address range. This may lead to an increased
  148. number of false negatives. However, it is likely that a real memory leak
  149. will eventually become visible.
  150. Another source of false negatives is the data stored in non-pointer
  151. values. In a future version, kmemleak could only scan the pointer
  152. members in the allocated structures. This feature would solve many of
  153. the false negative cases described above.
  154. The tool can report false positives. These are cases where an allocated
  155. block doesn't need to be freed (some cases in the init_call functions),
  156. the pointer is calculated by other methods than the usual container_of
  157. macro or the pointer is stored in a location not scanned by kmemleak.
  158. Page allocations and ioremap are not tracked.