diff options
author | Paul E. McKenney <paul.mckenney@linaro.org> | 2012-04-13 15:54:22 -0400 |
---|---|---|
committer | Paul E. McKenney <paulmck@linux.vnet.ibm.com> | 2012-05-02 17:48:27 -0400 |
commit | 9dd8fb16c36178df2066387d2abd44d8b4dca8c8 (patch) | |
tree | 330ac5704044c12bcc94ec6bf96dbb27d1057f5d /include/linux/rcutree.h | |
parent | 616c310e83b872024271c915c1b9ab505b9efad9 (diff) |
rcu: Make exit_rcu() more precise and consolidate
When running preemptible RCU, if a task exits in an RCU read-side
critical section having blocked within that same RCU read-side critical
section, the task must be removed from the list of tasks blocking a
grace period (perhaps the current grace period, perhaps the next grace
period, depending on timing). The exit() path invokes exit_rcu() to
do this cleanup.
However, the current implementation of exit_rcu() needlessly does the
cleanup even if the task did not block within the current RCU read-side
critical section, which wastes time and needlessly increases the size
of the state space. Fix this by only doing the cleanup if the current
task is actually on the list of tasks blocking some grace period.
While we are at it, consolidate the two identical exit_rcu() functions
into a single function.
Signed-off-by: Paul E. McKenney <paul.mckenney@linaro.org>
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Tested-by: Linus Torvalds <torvalds@linux-foundation.org>
Conflicts:
kernel/rcupdate.c
Diffstat (limited to 'include/linux/rcutree.h')
-rw-r--r-- | include/linux/rcutree.h | 12 |
1 files changed, 0 insertions, 12 deletions
diff --git a/include/linux/rcutree.h b/include/linux/rcutree.h index e8ee5dd0854c..782a8ab51bc1 100644 --- a/include/linux/rcutree.h +++ b/include/linux/rcutree.h | |||
@@ -45,18 +45,6 @@ static inline void rcu_virt_note_context_switch(int cpu) | |||
45 | rcu_note_context_switch(cpu); | 45 | rcu_note_context_switch(cpu); |
46 | } | 46 | } |
47 | 47 | ||
48 | #ifdef CONFIG_TREE_PREEMPT_RCU | ||
49 | |||
50 | extern void exit_rcu(void); | ||
51 | |||
52 | #else /* #ifdef CONFIG_TREE_PREEMPT_RCU */ | ||
53 | |||
54 | static inline void exit_rcu(void) | ||
55 | { | ||
56 | } | ||
57 | |||
58 | #endif /* #else #ifdef CONFIG_TREE_PREEMPT_RCU */ | ||
59 | |||
60 | extern void synchronize_rcu_bh(void); | 48 | extern void synchronize_rcu_bh(void); |
61 | extern void synchronize_sched_expedited(void); | 49 | extern void synchronize_sched_expedited(void); |
62 | extern void synchronize_rcu_expedited(void); | 50 | extern void synchronize_rcu_expedited(void); |