123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105 |
- This file documents some of the kernel entries in
- arch/x86/entry/entry_64.S. A lot of this explanation is adapted from
- an email from Ingo Molnar:
- http://lkml.kernel.org/r/<20110529191055.GC9835%40elte.hu>
- The x86 architecture has quite a few different ways to jump into
- kernel code. Most of these entry points are registered in
- arch/x86/kernel/traps.c and implemented in arch/x86/entry/entry_64.S
- for 64-bit, arch/x86/entry/entry_32.S for 32-bit and finally
- arch/x86/entry/entry_64_compat.S which implements the 32-bit compatibility
- syscall entry points and thus provides for 32-bit processes the
- ability to execute syscalls when running on 64-bit kernels.
- The IDT vector assignments are listed in arch/x86/include/asm/irq_vectors.h.
- Some of these entries are:
- - system_call: syscall instruction from 64-bit code.
- - entry_INT80_compat: int 0x80 from 32-bit or 64-bit code; compat syscall
- either way.
- - entry_INT80_compat, ia32_sysenter: syscall and sysenter from 32-bit
- code
- - interrupt: An array of entries. Every IDT vector that doesn't
- explicitly point somewhere else gets set to the corresponding
- value in interrupts. These point to a whole array of
- magically-generated functions that make their way to do_IRQ with
- the interrupt number as a parameter.
- - APIC interrupts: Various special-purpose interrupts for things
- like TLB shootdown.
- - Architecturally-defined exceptions like divide_error.
- There are a few complexities here. The different x86-64 entries
- have different calling conventions. The syscall and sysenter
- instructions have their own peculiar calling conventions. Some of
- the IDT entries push an error code onto the stack; others don't.
- IDT entries using the IST alternative stack mechanism need their own
- magic to get the stack frames right. (You can find some
- documentation in the AMD APM, Volume 2, Chapter 8 and the Intel SDM,
- Volume 3, Chapter 6.)
- Dealing with the swapgs instruction is especially tricky. Swapgs
- toggles whether gs is the kernel gs or the user gs. The swapgs
- instruction is rather fragile: it must nest perfectly and only in
- single depth, it should only be used if entering from user mode to
- kernel mode and then when returning to user-space, and precisely
- so. If we mess that up even slightly, we crash.
- So when we have a secondary entry, already in kernel mode, we *must
- not* use SWAPGS blindly - nor must we forget doing a SWAPGS when it's
- not switched/swapped yet.
- Now, there's a secondary complication: there's a cheap way to test
- which mode the CPU is in and an expensive way.
- The cheap way is to pick this info off the entry frame on the kernel
- stack, from the CS of the ptregs area of the kernel stack:
- xorl %ebx,%ebx
- testl $3,CS+8(%rsp)
- je error_kernelspace
- SWAPGS
- The expensive (paranoid) way is to read back the MSR_GS_BASE value
- (which is what SWAPGS modifies):
- movl $1,%ebx
- movl $MSR_GS_BASE,%ecx
- rdmsr
- testl %edx,%edx
- js 1f /* negative -> in kernel */
- SWAPGS
- xorl %ebx,%ebx
- 1: ret
- If we are at an interrupt or user-trap/gate-alike boundary then we can
- use the faster check: the stack will be a reliable indicator of
- whether SWAPGS was already done: if we see that we are a secondary
- entry interrupting kernel mode execution, then we know that the GS
- base has already been switched. If it says that we interrupted
- user-space execution then we must do the SWAPGS.
- But if we are in an NMI/MCE/DEBUG/whatever super-atomic entry context,
- which might have triggered right after a normal entry wrote CS to the
- stack but before we executed SWAPGS, then the only safe way to check
- for GS is the slower method: the RDMSR.
- Therefore, super-atomic entries (except NMI, which is handled separately)
- must use idtentry with paranoid=1 to handle gsbase correctly. This
- triggers three main behavior changes:
- - Interrupt entry will use the slower gsbase check.
- - Interrupt entry from user mode will switch off the IST stack.
- - Interrupt exit to kernel mode will not attempt to reschedule.
- We try to only use IST entries and the paranoid entry code for vectors
- that absolutely need the more expensive check for the GS base - and we
- generate all 'normal' entry points with the regular (faster) paranoid=0
- variant.
|