kernel_optimize_test/include/asm-um
Jeff Dike c14b84949e uml: iRQ stacks
Add a separate IRQ stack.  This differs from i386 in having the entire
interrupt run on a separate stack rather than starting on the normal kernel
stack and switching over once some preparation has been done.  The underlying
mechanism, is of course, sigaltstack.

Another difference is that interrupts that happen in userspace are handled on
the normal kernel stack.  These cause a wait wakeup instead of a signal
delivery so there is no point in trying to switch stacks for these.  There's
no other stuff on the stack, so there is no extra stack consumption.

This quirk makes it possible to have the entire interrupt run on a separate
stack - process preemption (and calls to schedule()) happens on a normal
kernel stack.  If we enable CONFIG_PREEMPT, this will need to be rethought.

The IRQ stack for CPU 0 is declared in the same way as the initial kernel
stack.  IRQ stacks for other CPUs will be allocated dynamically.

An extra field was added to the thread_info structure.  When the active
thread_info is copied to the IRQ stack, the real_thread field points back to
the original stack.  This makes it easy to tell where to copy the thread_info
struct back to when the interrupt is finished.  It also serves as a marker of
a nested interrupt.  It is NULL for the first interrupt on the stack, and
non-NULL for any nested interrupts.

Care is taken to behave correctly if a second interrupt comes in when the
thread_info structure is being set up or taken down.  I could just disable
interrupts here, but I don't feel like giving up any of the performance gained
by not flipping signals on and off.

If an interrupt comes in during these critical periods, the handler can't run
because it has no idea what shape the stack is in.  So, it sets a bit for its
signal in a global mask and returns.  The outer handler will deal with this
signal itself.

Atomicity is had with xchg.  A nested interrupt that needs to bail out will
xchg its signal mask into pending_mask and repeat in case yet another
interrupt hit at the same time, until the mask stabilizes.

The outermost interrupt will set up the thread_info and xchg a zero into
pending_mask when it is done.  At this point, nested interrupts will look at
->real_thread and see that no setup needs to be done.  They can just continue
normally.

Similar care needs to be taken when exiting the outer handler.  If another
interrupt comes in while it is copying the thread_info, it will drop a bit
into pending_mask.  The outer handler will check this and if it is non-zero,
will loop, set up the stack again, and handle the interrupt.

Signed-off-by: Jeff Dike <jdike@linux.intel.com>
Cc: Paolo 'Blaisorblade' Giarrusso <blaisorblade@yahoo.it>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2007-05-11 08:29:34 -07:00
..
a.out.h Don't include linux/config.h from anywhere else in include/ 2006-04-26 12:56:16 +01:00
alternative-asm.i [PATCH] i386: Redo semaphore and rwlock assembly helpers 2006-09-26 10:52:29 +02:00
alternative.h
apic.h
archparam-i386.h
archparam-ppc.h [PATCH] uml: remove some leftover PPC code 2006-10-20 10:26:36 -07:00
archparam-x86_64.h
atomic.h
auxvec.h
bitops.h
boot.h
bug.h [PATCH] UML: add generic BUG support 2006-12-08 08:28:39 -08:00
bugs.h
byteorder.h
cache.h Don't include linux/config.h from anywhere else in include/ 2006-04-26 12:56:16 +01:00
cacheflush.h
calling.h
checksum.h
cmpxchg.h x86: create asm/cmpxchg.h 2007-05-08 11:15:20 -07:00
cobalt.h
common.lds.S [PATCH] uml: fix static linking for real 2007-03-30 19:21:30 -07:00
cpufeature.h
cputime.h
current.h
delay.h [PATCH] uml: fix unreasonably long udelay 2007-04-02 10:06:08 -07:00
desc.h [PATCH] uml: implement {get,set}_thread_area for i386 2006-03-31 12:18:52 -08:00
device.h Driver core: add dev_archdata to struct device 2006-12-01 14:52:01 -08:00
div64.h [NET]: div64_64 consolidate (rev3) 2007-04-25 22:23:33 -07:00
dma-mapping.h [PATCH] Pass struct dev pointer to dma_cache_sync() 2006-12-07 08:39:41 -08:00
dma.h
dwarf2.h
elf-i386.h
elf-ppc.h [PATCH] uml: fix apparent "CONFIG_64_BIT" typo. 2007-02-11 10:51:23 -08:00
elf-x86_64.h
emergency-restart.h
errno.h
fcntl.h
fixmap.h Don't include linux/config.h from anywhere else in include/ 2006-04-26 12:56:16 +01:00
floppy.h
frame.i [PATCH] i386: Redo semaphore and rwlock assembly helpers 2006-09-26 10:52:29 +02:00
futex.h
hardirq.h Don't include linux/config.h from anywhere else in include/ 2006-04-26 12:56:16 +01:00
highmem.h
host_ldt-i386.h [PATCH] uml: split ldt.h in arch-independent and arch-dependant code 2006-03-31 12:18:51 -08:00
host_ldt-x86_64.h [PATCH] uml: split ldt.h in arch-independent and arch-dependant code 2006-03-31 12:18:51 -08:00
hw_irq.h [PATCH] genirq: add ->retrigger() irq op to consolidate hw_irq_resend() 2006-06-29 10:26:23 -07:00
ide.h
io.h [PATCH] uml: add __raw_writeq definition 2006-06-30 11:25:38 -07:00
ioctl.h
ioctls.h
ipc.h
ipcbuf.h
irq_regs.h [PATCH] um: irq changes break build 2006-10-06 08:53:42 -07:00
irq_vectors.h
irq.h
irqflags.h [PATCH] uml: add asm/irqflags.h 2006-06-05 12:29:17 -07:00
kdebug.h move die notifier handling to common code 2007-05-08 11:15:04 -07:00
keyboard.h
kmap_types.h [PATCH] uml: make copy_*_user atomic 2006-07-01 09:56:03 -07:00
ldt.h [PATCH] uml: split ldt.h in arch-independent and arch-dependant code 2006-03-31 12:18:51 -08:00
linkage.h Don't include linux/config.h from anywhere else in include/ 2006-04-26 12:56:16 +01:00
local.h
locks.h
mca_dma.h
mman.h
mmu_context.h [PATCH] x86: PARAVIRT: add hooks to intercept mm creation and destruction 2007-05-02 19:27:14 +02:00
mmu.h
module-generic.h
module-i386.h
module-x86_64.h
msgbuf.h
mtrr.h
mutex.h
namei.h
page_offset.h
page.h uml: more page fault path trimming 2007-05-07 12:13:04 -07:00
param.h
pci.h
pda.h
percpu.h
pgalloc.h Don't include linux/config.h from anywhere else in include/ 2006-04-26 12:56:16 +01:00
pgtable-2level.h [PATCH] uml: fix pte bit collision 2007-03-29 08:22:24 -07:00
pgtable-3level.h [PATCH] Standardize pxx_page macros 2006-09-26 08:48:51 -07:00
pgtable.h [PATCH] uml: pte_mkread fix 2007-03-01 14:53:38 -08:00
poll.h
posix_types.h
prctl.h
processor-generic.h [PATCH] uml: thread creation tidying 2006-09-27 08:26:16 -07:00
processor-i386.h [PATCH] uml: implement {get,set}_thread_area for i386 2006-03-31 12:18:52 -08:00
processor-ppc.h
processor-x86_64.h [PATCH] uml: x86_64 thread fixes 2007-02-11 10:51:24 -08:00
ptrace-generic.h [PATCH] Make UML use ptrace-abi.h 2006-09-26 08:49:10 -07:00
ptrace-i386.h [PATCH] uml: fix "extern-vs-static" proto conflict in TLS code 2006-04-11 06:18:36 -07:00
ptrace-x86_64.h [PATCH] uml: x86_64 ptrace fixes 2007-02-11 10:51:24 -08:00
required-features.h uml: fix build breakage 2007-05-09 12:30:48 -07:00
resource.h
rwlock.h
rwsem.h
scatterlist.h
sections.h
segment.h [PATCH] uml: check for differences in host support 2006-03-31 12:18:52 -08:00
semaphore.h
sembuf.h
serial.h
setup.h
shmbuf.h
shmparam.h
sigcontext-generic.h
sigcontext-i386.h
sigcontext-ppc.h
sigcontext-x86_64.h
siginfo.h
signal.h
smp.h Remove hardcoding of hard_smp_processor_id on UP systems 2007-05-09 12:30:48 -07:00
socket.h
sockios.h
spinlock_types.h
spinlock.h
stat.h
statfs.h
string.h
suspend.h
system-generic.h
system-i386.h
system-ppc.h
system-x86_64.h
termbits.h
termios.h
thread_info.h uml: iRQ stacks 2007-05-11 08:29:34 -07:00
timex.h
tlb.h
tlbflush.h uml: more page fault path trimming 2007-05-07 12:13:04 -07:00
topology.h
types.h
uaccess.h [PATCH] uml: more __user annotations 2006-06-05 12:29:17 -07:00
ucontext.h
unaligned.h
unistd.h [PATCH] rename the provided execve functions to kernel_execve 2006-10-02 07:57:23 -07:00
user.h
vga.h
vm-flags-i386.h
vm-flags-x86_64.h
vm86.h
xor.h