Maverick on ESXi, Opteron Board

[Donk]

Hi

 

Bad news this won't work. I had a bunch of additional tests setup for you but I won't waste your time. I had a reply from a VMware engineer and the MSR registers would also need masking as they are different between AMD and Intel processors. Looking at the xnu kernel source code, plus the patches for AMD kernels shows that I cannot mask this out using just VMX settings.

 

Sorry for that, but appreciate you trying this out. 

[kwiksilver]

No worries at all. I really appreciate you looking into this. You are an asset to this community. I know you're retiring, but know your help is always appreciated. 

 

I wonder why some people were able to do CPUID masking on newer AM3+ or FM2 based AMD systems.

Here for example: http://zensonic.dk/?p=653

I see a few random reports of people making it work with CPU masking. 

 

 If you want me to try any other tests or have any random strokes of genius let me know.  

[Donk]

No worries at all. I really appreciate you looking into this. You are an asset to this community. I know you're retiring, but know your help is always appreciated. 

 

I wonder why some people were able to do CPUID masking on newer AM3+ or FM2 based AMD systems.

Here for example: http://zensonic.dk/?p=653

I see a few random reports of people making it work with CPU masking. 

 

 If you want me to try any other tests or have any random strokes of genius let me know.

 

 

Well I had seen that before but as you said variable results, and only for Snow Leopard. The big issues for AMD and running darwin kernel are:

 

1. Missing opcodes especially SSE/SSSE instructions. The need for SSE 4 was added post Snow Leopard, but many AMD CPUs don't have that set of instructions so AMD kernels have an emulator that runs when an invalid opcode is trapped.

2. CPUID is also used extensively in OS X and of course Intel and AMD have some CPUID leaves in common but a bunch of others which are different.

3. MSRs and power management.

 

I was hoping that:

 

1. Would be OK on an AMD CPU with the latest instruction sets including SSE3, SSSE3.1 and SSE4.

2. The VMX masks would report CPUIDs values that OS X was expecting

3. That's the issue - it is possible to mask MSR values as well in VMX file, but not the ones we need to report on.

 

I will have one more think about this, but in the meantime if you are still interested we need to capture the CPUID from the guest during boot.

 

1. Edit the OS X guest's VMX file and add these lines to setup serial port outputting to file in VMFS guests folder:

serial0.fileType = "file"
serial0.fileName = "osxdebug.txt"
serial0.present = "TRUE"
msg.autoAnswer = "TRUE" 
msg.serial.file.open = "Append"  

2. Boot to the EFI shell and then run:

fs<x>:\usr\standalone\i386\boot.efi -v -cpuid -topo debug=0x128

You will have to find the correct x value from the mount volumes in the shell.

 

3. Close VM down and attach the vmware.log and osxdebug.txt files to a post.

[crurer]

FYI:

 

I also tried to get running an already virtualized 10.9.4 on one of our ESX 5.5 servers. The ESX host is a 2x 8 Core 6132HE CPU with 128GB of RAM. The MACOS guest is running well on ESX 5.5 with 2x E5420 Xeons. I just transfered the VM to the Opteron based ESX server and added the lines to the vmx file from here. The VM will start but stops with kernel panic.

I'm happy to assist to find a final solution for solving that issue. 

 

cheers Chris 

 

 

[kwiksilver]

Alright so I had to change hardware. That opteron box I was using had bad RAM and was crashing every few hours as a result. Until I get it sorted I'm using an ASRock 970 extreme4 motherboard with a FX-4130 Quad (AM3+).

 

The errors seem to be similar/the same though. 

 

All of the logs I post will come from the ASRock board now. I moved my ESXi install and datastore HDD over to the new hardware so there aren't any changes with that.

 

 

osxdebug.txt

vmware.log.txt

[Donk]

Alright so I had to change hardware. That opteron box I was using had bad RAM and was crashing every few hours as a result. Until I get it sorted I'm using an ASRock 970 extreme4 motherboard with a FX-4130 Quad (AM3+).

 

The errors seem to be similar/the same though. 

 

All of the logs I post will come from the ASRock board now. I moved my ESXi install and datastore HDD over to the new hardware so there aren't any changes with that.

 

Thanks for this and the code on xnu kernel going wrong is:

 

    /*
     * Compute the number of dies per package.
     */
     DIVISOR_GUARD(topoParms.nCoresSharingLLC);
    topoParms.nLDiesPerPackage = cpuinfo->core_count / topoParms.nCoresSharingLLC;
    DIVISOR_GUARD(topoParms.nPThreadsPerCore);
    DIVISOR_GUARD(topoParms.maxSharingLLC / topoParms.nPThreadsPerCore);
    topoParms.nPDiesPerPackage = cpuinfo->cpuid_cores_per_package / (topoParms.maxSharingLLC / topoParms.nPThreadsPerCore);

So I think I have screwed up CPU topology on CPUID masks. I will look into this over weekend.

 

UPDATE:

 

Can you run the test again but leave off the -topo and -cpuid flags please?

[kwiksilver]

Here is what you asked for. I hope this helps. 

osxdebug.txt

vmware.log.txt

[Donk]

Here is what you asked for. I hope this helps. 

 

Hi - didn't have anything useful. I need to look at the code for the xnu kernel in more detail. Work is crazy busy, so will have to fit it in when I can. The first trace was very useful though and has at least pointed me in the right direction.

[Donk]

OK next test can you add these lines to the VMX. You will need to remove any other lines to make sure there are no duplicates.

 

Thanks

# Spoof an iMac 5,1 with Intel Core 2 CPU on AMD
board-id.reflectHost = "FALSE"
board-id = "Mac-F2268CC8"
hw.model.reflectHost = "FALSE"
hw.model = "iMac10,1"
serialNumber.reflectHost = "FALSE"
serialNumber = "CK029R6WB9U"
smbios.reflectHost = "FALSE"
SMBIOS.use12CharSerialNumber = "TRUE"


# Capture kprintf to serial file
serial0.fileType = "file"
serial0.fileName = "osxdebug.txt"
serial0.present = "TRUE"
msg.autoAnswer = "TRUE" 
msg.serial.file.open = "Append" 


# Start CPUID Masks
numvcpus = "1"
featureCompat.enable = FALSE
cpuid.inhibitDarwinMasks = "TRUE"
monitor_control.enable_fullcpuid = "TRUE"
cpuid.0.eax.amd = "0000:0000:0000:0000:0000:0000:0000:1010"
cpuid.0.ebx.amd = "0111:0101:0110:1110:0110:0101:0100:0111"
cpuid.0.ecx.amd = "0110:1100:0110:0101:0111:0100:0110:1110"
cpuid.0.edx.amd = "0100:1001:0110:0101:0110:1110:0110:1001"
cpuid.1.eax.amd = "0000:0000:0000:0000:0000:0110:1111:0110"
cpuid.1.ebx.amd = "0000:0001:0000:0010:0000:1000:0000:0000"
cpuid.1.ecx.amd = "0000:0000:0000:0000:1110:0011:1011:1101"
cpuid.1.edx.amd = "1011:1111:1110:1011:1111:1011:1111:1111"
#cpuid.2.eax.amd = "0000:0101:1011:0000:1011:0001:0000:0001"
#cpuid.2.ebx.amd = "0000:0000:0101:0110:0101:0111:1111:0000"
#cpuid.2.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.2.edx.amd = "0010:1100:1011:0100:0011:0000:0100:1001"
#cpuid.3.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.3.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.3.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.3.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.4.0.eax.amd = "0000:0100:0000:0000:0000:0001:0010:0001"
cpuid.4.0.ebx.amd = "0000:0001:1100:0000:0000:0000:0011:1111"
cpuid.4.0.ecx.amd = "0000:0000:0000:0000:0000:0000:0011:1111"
cpuid.4.0.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0001"
cpuid.4.1.eax.amd = "0000:0100:0000:0000:0000:0001:0010:0010"
cpuid.4.1.ebx.amd = "0000:0001:1100:0000:0000:0000:0011:1111"
cpuid.4.1.ecx.amd = "0000:0000:0000:0000:0000:0000:0011:1111"
cpuid.4.1.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0001"
cpuid.4.2.eax.amd = "0000:0100:0000:0000:0100:0001:0100:0011"
cpuid.4.2.ebx.amd = "0000:0011:1100:0000:0000:0000:0011:1111"
cpuid.4.2.ecx.amd = "0000:0000:0000:0000:0000:1111:1111:1111"
cpuid.4.2.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0001"
cpuid.4.3.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.4.3.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.4.3.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.4.3.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.5.eax.amd = "0000:0000:0000:0000:0000:0000:0100:0000"
#cpuid.5.ebx.amd = "0000:0000:0000:0000:0000:0000:0100:0000"
#cpuid.5.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0011"
#cpuid.5.edx.amd = "0000:0000:0000:0010:0010:0010:0010:0000"
#cpuid.6.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0001"
#cpuid.6.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0010"
#cpuid.6.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0001"
#cpuid.6.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.7.0.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.7.0.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.7.0.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.7.0.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.8.eax.amd = "0000:0000:0000:0000:0000:0100:0000:0000"
#cpuid.8.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.8.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.8.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.9.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.9.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.9.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.9.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.a.eax.amd = "0000:0111:0010:1000:0000:0010:0000:0010"
#cpuid.a.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.a.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.a.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.80000000.eax.amd = "1000:0000:0000:0000:0000:0000:0000:1000"
cpuid.80000000.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.80000000.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.80000000.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.80000001.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.80000001.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
cpuid.80000001.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0001"
cpuid.80000001.edx.amd = "0010:0000:0001:0000:0000:1000:0000:0000"
cpuid.80000002.eax.amd = "0110:0101:0111:0100:0110:1110:0100:1001"
cpuid.80000002.ebx.amd = "0010:1001:0101:0010:0010:1000:0110:1100"
cpuid.80000002.ecx.amd = "0111:0010:0110:1111:0100:0011:0010:0000"
cpuid.80000002.edx.amd = "0100:1101:0101:0100:0010:1000:0110:0101"
cpuid.80000003.eax.amd = "0100:0011:0010:0000:0011:0010:0010:1001"
cpuid.80000003.ebx.amd = "0010:0000:0010:0000:0101:0101:0101:0000"
cpuid.80000003.ecx.amd = "0010:0000:0010:0000:0010:0000:0010:0000"
cpuid.80000003.edx.amd = "0101:0100:0010:0000:0010:0000:0010:0000"
cpuid.80000004.eax.amd = "0011:0000:0011:0000:0011:0110:0011:0111"
cpuid.80000004.ebx.amd = "0010:0000:0100:0000:0010:0000:0010:0000"
cpuid.80000004.ecx.amd = "0011:0011:0011:0011:0010:1110:0011:0010"
cpuid.80000004.edx.amd = "0000:0000:0111:1010:0100:1000:0100:0111"
#cpuid.80000005.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000005.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000005.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000005.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000006.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000006.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000006.ecx.amd = "0001:0000:0000:0000:1000:0000:0100:0000"
#cpuid.80000006.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000007.eax.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000007.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000007.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000007.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000008.eax.amd = "0000:0000:0000:0000:0011:0000:0010:0100"
#cpuid.80000008.ebx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000008.ecx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
#cpuid.80000008.edx.amd = "0000:0000:0000:0000:0000:0000:0000:0000"
# End CPUID Masks

[kwiksilver]

DONK! You're a genius! It worked. My old Lion VM boots! 

 

Now I have access to a few Mac Minis, iMacs, and Mac Pros of various generations. Would it be helpful to have the CPUID masks from any of those to try out different configurations?

 

EDIT:

 

I am trying a new VM to start fresh mavericks install to see if that works too. 

[Donk]

Fantastic! I have been wanting to try this out for a couple of years.

 

CPUID dumps would be good. I have a version of a CPUID program I use for dumping raw data into VMware format. I will upload it and write up some instructions tomorrow

 

Many thanks for you kind help, I will update the first post with the details and credit you with helping me out.

[kwiksilver]

Okay so in using my Lion (10.7) VM. I have noticed some erratic behavior. I can't launch Chrome. It crashes instantly. I can browse the web on safari, but if I try to download anything using safari it just hangs. If I try to install packages it freezes. It doesn't see vmware tools as installed because it continually crashes.

 

My console logs are full of app crashes.

 

Chrome crash example:

 

Process:         Google Chrome [366]
Path:            /Applications/Google Chrome.app/Contents/MacOS/Google Chrome
Identifier:      Google Chrome
Version:         ??? (???)
Code Type:       X86 (Native)
Parent Process:  launchd [116]
 
Date/Time:       2014-08-14 17:01:57.352 -0400
OS Version:      Mac OS X 10.7.5 (11G63)
Report Version:  9
 
Interval Since Last Report:          51290209 sec
Crashes Since Last Report:           811
Per-App Crashes Since Last Report:   9
Anonymous UUID:                      97ACCE59-5F3E-4BE9-8482-5972D93B8ECC
 
Crashed Thread:  0
 
Exception Type:  EXC_BAD_INSTRUCTION (SIGILL)
Exception Codes: 0x0000000000000001, 0x0000000000000000
 
Thread 0 Crashed:
0   dyld                           0x8feaf38d _sysenter_trap + 3
1   dyld                           0x8fe8b1e6 dyldbootstrap::start(macho_header const*, int, char const**, long, macho_header const*) + 372
2   dyld                           0x8fe8b063 _dyld_start + 51
 
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe4  ebx: 0x00000002  ecx: 0xc0089c9c  edx: 0x8feaeb8a
  edi: 0x0008a000  esi: 0x8feaea05  ebp: 0xc0089ca8  esp: 0xc0089c9c
   ss: 0x00000023  efl: 0x00010246  eip: 0x8feaf38d   cs: 0x0000001b
   ds: 0x00000023   es: 0x00000023   fs: 0x00000000   gs: 0x00000000
  cr2: 0x8feaf38a
Logical CPU: 0
 
Binary Images:
0x8fe8a000 - 0x8febcaa7  dyld (195.6 - ???) <60FD3471-A1D7-342E-99A7-3EDECDAEC6EC> /usr/lib/dyld
 
External Modification Summary:
  Calls made by other processes targeting this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by all processes on this machine:
    task_for_pid: 182
    thread_create: 0
    thread_set_state: 0
 
VM Region Summary:
ReadOnly portion of Libraries: Total=280K resident=216K(77%) swapped_out_or_unallocated=64K(23%)
Writable regions: Total=8368K written=12K(0%) resident=20K(0%) swapped_out=0K(0%) unallocated=8348K(100%)
 
REGION TYPE                      VIRTUAL
===========                      =======
Stack                              64.0M
VM_ALLOCATE                         556K
__DATA                              172K
__LINKEDIT                           76K
__TEXT                              204K
mapped file                          16K
shared memory                        12K
===========                      =======
TOTAL                              65.0M
 
Model: iMac10,1, BootROM VMW71.00V.0.B64.1311080549, 2 processors, Intel Core 2 Duo, 3.62 GHz, 2 GB, SMC 1.16f8
Graphics: Display, PCI, 64 MB
Memory Module: RAM slot #0/RAM slot #0, 2 GB, DRAM, 0 MHz, VMware Virtual RAM, VMW-2048MB
Network Service: Ethernet, Ethernet, en0
Parallel ATA Device: VMware Virtual IDE CDROM Drive
SCSI Device: SCSI Target Device @ 0
USB Device: VMware Virtual USB Hub, 0x0e0f  (VMWare, Inc.), 0x0002, 0x11200000 / 3
USB Device: VMware Virtual USB Keyboard, apple_vendor_id, 0x020b, 0x11210000 / 4
USB Device: VMware Virtual USB Mouse, 0x0e0f  (VMWare, Inc.), 0x0003, 0x11100000 / 2

 

For example vmware tools:

Process:         vmware-tools-daemon [4108]
Path:            /Library/Application Support/VMware Tools/vmware-tools-daemon
Identifier:      vmware-tools-daemon
Version:         ??? (???)
Code Type:       X86 (Native)
Parent Process:  launchd [115]
 
Date/Time:       2014-08-14 16:27:28.614 -0400
OS Version:      Mac OS X 10.7.5 (11G63)
Report Version:  9
 
Crashed Thread:  0
 
Exception Type:  EXC_BAD_INSTRUCTION (SIGILL)
Exception Codes: 0x0000000000000001, 0x0000000000000000
 
Thread 0 Crashed:
0   dyld                           0x8fe2f38d _sysenter_trap + 3
1   dyld                           0x8fe0b1e6 dyldbootstrap::start(macho_header const*, int, char const**, long, macho_header const*) + 372
2   dyld                           0x8fe0b063 _dyld_start + 51
 
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe4  ebx: 0x00000002  ecx: 0xbffffc3c  edx: 0x8fe2eb8a
  edi: 0x0000a000  esi: 0x8fe2ea05  ebp: 0xbffffc48  esp: 0xbffffc3c
   ss: 0x00000023  efl: 0x00010246  eip: 0x8fe2f38d   cs: 0x0000001b
   ds: 0x00000023   es: 0x00000023   fs: 0x00000000   gs: 0x00000000
  cr2: 0x8fe2f38a
Logical CPU: 0
 
Binary Images:
0x8fe0a000 - 0x8fe3caa7  dyld (195.6 - ???) <60FD3471-A1D7-342E-99A7-3EDECDAEC6EC> /usr/lib/dyld
 
External Modification Summary:
  Calls made by other processes targeting this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by all processes on this machine:
    task_for_pid: 572
    thread_create: 0
    thread_set_state: 0
 
VM Region Summary:
ReadOnly portion of Libraries: Total=280K resident=216K(77%) swapped_out_or_unallocated=64K(23%)
Writable regions: Total=8368K written=12K(0%) resident=20K(0%) swapped_out=0K(0%) unallocated=8348K(100%)
 
REGION TYPE                      VIRTUAL
===========                      =======
Stack                              64.0M
VM_ALLOCATE                           4K
__DATA                              172K
__LINKEDIT                           76K
__TEXT                              204K
mapped file                          48K
shared memory                        12K
===========                      =======
TOTAL                              64.5M

[Donk]

 

Okay so in using my Lion (10.7) VM. I have noticed some erratic behavior. I can't launch Chrome. It crashes instantly. I can browse the web on safari, but if I try to download anything using safari it just hangs. If I try to install packages it freezes. It doesn't see vmware tools as installed because it continually crashes.

 

My console logs are full of app crashes.

 

Chrome crash example:

 

 

OK having a look into it. This is still on the Lion VM on FX-4130 CPU?

[effbee]

 

 

OK next test can you add these lines to the VMX. You will need to remove any other lines to make sure there are no duplicates.

 

Thanks

[...]

 

Donk,

just to be sure - does it make sense to test those settings on Opteron as well?

[Donk]

Donk,

just to be sure - does it make sense to test those settings on Opteron as well?

 

I would be interested to see if it works. ANy help is appreciated as I have no access to AMD kit.

[kwiksilver]

OK having a look into it. This is still on the Lion VM on FX-4130 CPU?

 

Yes that is correct. Sorry, I should have specified.

[Donk]

Yes that is correct. Sorry, I should have specified.

 

No problem - just wanted to make sure. I did find that error with Chrome on real AMD based Hackintoshes and seems to be due to Flash. However the vmtoolsd issue is not known. I think the code that crashes is calling CPUID from user space and then making some decisions based on that. I wonder if the kernel versus user worlds are reporting something different?

[kwiksilver]

Last night I left the VM running and I woke up to a kernel panic

Interval Since Last Panic Report:  51290122 sec
Panics Since Last Report:          1
Anonymous UUID:                    97ACCE59-5F3E-4BE9-8482-5972D93B8ECC
 
Fri Aug 15 11:05:42 2014
Panic(CPU 1): Unresponsive processor (this CPU did not acknowledge interrupts) TLB state:0x0
RAX: 0x00000000000001fc, RBX: 0x00000000000002fc, RCX: 0x00000001c154e3ec, RDX: 0x000000010353290c
RSP: 0x00007fff629d22b8, RBP: 0x00007fff629d22e0, RSI: 0x00000000ffededed, RDI: 0x00000001c156cc28
R8:  0x00000001c156cc28, R9:  0x00000000000015e0, R10: 0x0000000000000080, R11: 0x0000000000000002
R12: 0x0000000000000001, R13: 0x00007fff629d2530, R14: 0x0000000000000422, R15: 0x0000000000004000
RFL: 0x0000000000000206, RIP: 0x00007fff892c481f, CS:  0x000000000000002b, SS:  0x0000000000000023
Backtrace (CPU 1), Frame : Return Address
0xffffff8041962f50 : 0xffffff80002c9a7c 
0xffffff8041962f80 : 0xffffff80002c48d0 
0xffffff8041962fd0 : 0xffffff80002da712 
 
BSD process name corresponding to current thread: WindowServer
 
Mac OS version:
11G63
 
Kernel version:
Darwin Kernel Version 11.4.2: Thu Aug 23 16:25:48 PDT 2012; root:xnu-1699.32.7~1/RELEASE_X86_64
Kernel UUID: FF3BB088-60A4-349C-92EA-CA649C698CE5
System model name: iMac10,1 (Mac-F2268CC8)
 
System uptime in nanoseconds: 14064883265113
last loaded kext at 12963489742: com.apple.filesystems.smbfs 1.7.2 (addr 0xffffff7f8087c000, size 241664)
last unloaded kext at 90237793028: com.apple.driver.AppleFileSystemDriver 13 (addr 0xffffff7f81507000, size 12288)
loaded kexts:
com.vmware.kext.vmhgfs 1.0.0
com.vmware.kext.vmmemctl 1.0.0
com.Cycling74.driver.Soundflower 1.5.1
com.vmware.kext.VMwareGfx 1.0.0
at.obdev.nke.LittleSnitch 3876
com.apple.filesystems.smbfs 1.7.2
com.apple.driver.AppleHWSensor 1.9.5d0
com.apple.filesystems.autofs 3.0
com.apple.driver.AGPM 100.12.75
com.apple.driver.AppleUpstreamUserClient 3.5.9
com.apple.driver.AppleMCCSControl 1.0.33
com.apple.iokit.IOUserEthernet 1.0.0d1
com.apple.iokit.IOBluetoothSerialManager 4.0.8f17
com.apple.Dont_Steal_Mac_OS_X 7.0.0
com.apple.driver.AudioIPCDriver 1.2.3
com.apple.driver.ApplePolicyControl 3.1.33
com.apple.driver.ACPI_SMC_PlatformPlugin 5.0.0d8
com.apple.driver.Apple16X50ACPI 3.0
com.apple.driver.XsanFilter 404
com.apple.iokit.SCSITaskUserClient 3.2.1
com.apple.driver.AppleUSBHub 5.1.0
com.apple.AppleFSCompression.AppleFSCompressionTypeDataless 1.0.0d1
com.apple.AppleFSCompression.AppleFSCompressionTypeZlib 1.0.0d1
com.apple.BootCache 33
com.apple.driver.AppleUSBEHCI 5.1.0
com.apple.driver.AppleIntel8254XEthernet 2.1.3b1
com.apple.driver.AppleUSBUHCI 5.1.0
com.apple.driver.AppleLSIFusionMPT 3.0.5
com.apple.driver.AppleIntelPIIXATA 2.5.1
com.apple.driver.AppleEFINVRAM 1.6.1
com.apple.driver.AppleACPIButtons 1.5
com.apple.driver.AppleHPET 1.7
com.apple.driver.AppleRTC 1.5
com.apple.driver.AppleSMBIOS 1.9
com.apple.driver.AppleAPIC 1.6
com.apple.driver.AppleIntelCPUPowerManagementClient 195.0.0
com.apple.nke.applicationfirewall 3.2.30
com.apple.security.quarantine 1.4
com.apple.security.TMSafetyNet 8
com.apple.driver.AppleIntelCPUPowerManagement 195.0.0
com.apple.driver.AppleUSBMergeNub 5.1.0
com.apple.iokit.IOUSBHIDDriver 5.0.0
com.apple.driver.AppleUSBComposite 5.0.0
com.apple.kext.triggers 1.0
com.apple.driver.AppleSMBusController 1.0.10d0
com.apple.iokit.IOSMBusFamily 1.1
com.apple.iokit.IOSurface 80.0.2
com.apple.iokit.IOAudioFamily 1.8.6fc18
com.apple.kext.OSvKernDSPLib 1.3
com.apple.driver.AppleGraphicsControl 3.1.33
com.apple.driver.AppleSMC 3.1.3d10
com.apple.driver.IOPlatformPluginLegacy 5.0.0d8
com.apple.driver.IOPlatformPluginFamily 5.1.1d6
com.apple.driver.Apple16X50Serial 3.0
com.apple.iokit.IOSerialFamily 10.0.5
com.apple.iokit.IONDRVSupport 2.3.4
com.apple.iokit.IOGraphicsFamily 2.3.4
com.apple.iokit.IOSCSIMultimediaCommandsDevice 3.2.1
com.apple.iokit.IOBDStorageFamily 1.7
com.apple.iokit.IODVDStorageFamily 1.7.1
com.apple.iokit.IOCDStorageFamily 1.7.1
com.apple.iokit.IOSCSIBlockCommandsDevice 3.2.1
com.apple.iokit.IOATAPIProtocolTransport 3.0.0
com.apple.iokit.IOUSBUserClient 5.0.0
com.apple.iokit.IONetworkingFamily 2.1
com.apple.iokit.IOUSBFamily 5.1.0
com.apple.iokit.IOSCSIParallelFamily 2.5.1
com.apple.iokit.IOSCSIArchitectureModelFamily 3.2.1
com.apple.iokit.IOATAFamily 2.5.1
com.apple.driver.AppleEFIRuntime 1.6.1
com.apple.iokit.IOHIDFamily 1.7.1
com.apple.security.sandbox 177.11
com.apple.kext.AppleMatch 1.0.0d1
com.apple.driver.DiskImages 331.7
com.apple.iokit.IOStorageFamily 1.7.2
com.apple.driver.AppleKeyStore 28.18
com.apple.driver.AppleACPIPlatform 1.5
com.apple.iokit.IOPCIFamily 2.7
com.apple.iokit.IOACPIFamily 1.4
panic(cpu 0 caller 0xffffff80002a7fbe): "TLB invalidation IPI timeout: " "CPU(s) failed to respond to interrupts, unresponsive CPU bitmap: 0x2, NMIPI acks: orig: 0x0, now: 0x1"@/SourceCache/xnu/xnu-1699.32.7/osfmk/x86_64/pmap.c:2184
Backtrace (CPU 0), Frame : Return Address
0xffffff804682b850 : 0xffffff8000220792 
0xffffff804682b8d0 : 0xffffff80002a7fbe 
0xffffff804682b940 : 0xffffff80002ab6a7 
0xffffff804682b9e0 : 0xffffff80002abeca 
0xffffff804682ba20 : 0xffffff8000273c46 
0xffffff804682bb10 : 0xffffff8000274a3a 
0xffffff804682bb40 : 0xffffff800026e812 
0xffffff804682bb70 : 0xffffff8000226282 
0xffffff804682bb90 : 0xffffff80002264dd 
0xffffff804682bbb0 : 0xffffff7f80925650 
0xffffff804682bbe0 : 0xffffff80006565fe 
0xffffff804682bc40 : 0xffffff8000656fbb 
0xffffff804682bd80 : 0xffffff80002a3f08 
0xffffff804682be80 : 0xffffff8000223096 
0xffffff804682beb0 : 0xffffff80002148a9 
0xffffff804682bf10 : 0xffffff800021bbd8 
0xffffff804682bf70 : 0xffffff80002aef10 
0xffffff804682bfb0 : 0xffffff80002daec3 
      Kernel Extensions in backtrace:
         at.obdev.nke.LittleSnitch(3876.0)[C70779FA-9258-3BB3-AEDD-07B9BD09EF98]@0xffffff7f8091b000->0xffffff7f8095ffff
 
BSD process name corresponding to current thread: Little Snitch Ne
Model: iMac10,1, BootROM VMW71.00V.0.B64.1311080549, 2 processors, Intel Core 2 Duo, 3.62 GHz, 2 GB, SMC 1.16f8
Graphics: Display, PCI, 64 MB
Memory Module: RAM slot #0/RAM slot #0, 2 GB, DRAM, 0 MHz, VMware Virtual RAM, VMW-2048MB
Network Service: Ethernet, Ethernet, en0
Parallel ATA Device: VMware Virtual IDE CDROM Drive
SCSI Device: SCSI Target Device @ 0
USB Device: VMware Virtual USB Hub, 0x0e0f  (VMWare, Inc.), 0x0002, 0x11200000 / 3
USB Device: VMware Virtual USB Keyboard, apple_vendor_id, 0x020b, 0x11210000 / 4
USB Device: VMware Virtual USB Mouse, 0x0e0f  (VMWare, Inc.), 0x0003, 0x11100000 / 2

I suspect some instruction set is not working correctly. I am looking for a mac utility to tell me what CPU it thinks is in the VM that can also list the cpu capabilities. (SSE3/4, Vt-x, etc) just to see what seems to be going wrong. 

 

 

EDIT:

After some more looking around any 32bit app seems to not run. Any 64bit app seems to run just fine. 

 

To confirm further, I downloaded Chrome Canary which is a 64 bit app and it runs perfectly. So it's something to do with x86 apps or maybe even x86_64 apps.

If I open up Activity Monitor, the only apps running listed under "Kind" are "Intel (64bit)" whereas on my other (real) macs it's a mix of 32bit and 64bit macs.

 

EDIT2:

100% confirmation. If I open Chess.app it launches no problem. If I right click Chess.app and select the "Open in 32 bit mode" option from the "Get Info" page and then try to launch it, the app crashes on launch.

[Donk]

Last night I left the VM running and I woke up to a kernel panicI suspect some instruction set is not working correctly. I am looking for a mac utility to tell me what CPU it thinks is in the VM that can also list the cpu capabilities. (SSE3/4, Vt-x, etc) just to see what seems to be going wrong. 

 

 

EDIT:

After some more looking around any 32bit app seems to not run. Any 64bit app seems to run just fine. 

 

To confirm further, I downloaded Chrome Canary which is a 64 bit app and it runs perfectly. So it's something to do with x86 apps or maybe even x86_64 apps.

If I open up Activity Monitor, the only apps running listed under "Kind" are "Intel (64bit)" whereas on my other (real) macs it's a mix of 32bit and 64bit macs.

 

EDIT2:

100% confirmation. If I open Chess.app it launches no problem. If I right click Chess.app and select the "Open in 32 bit mode" option from the "Get Info" page and then try to launch it, the app crashes on launch.

 

EDIT1: Seems to be a known issue http://www.insanelymac.com/forum/topic/285677-mac-osx-1073-32bit-apps-crashes/

 

EDIT2: Try boot in 32-bit mode http://support.apple.com/kb/ht3773

 

That's interesting information, must be some difference on how the instruction set is used. The kernel panic could be sleep states.

 

I have a command line utility which I have uploaded here. http://www.mediafire.com/download/jxpshszib516di0/cpuid

 

You will need to chmod +x the file then run:

./cpuid -d > dump.txt

You can name the file whatever you want. Run it from the guest and attach it to a post. 

 

It would be great if you can also get the dumps from the other real Mac hardware sometime. I already have some from various macs, but always useful to have more.

[kwiksilver]

Here is some other info, I'll be attaching the cpuid dumps as I generate them to this post.

 

lion-vm:~ kwiksilver$ sysctl -a | grep machdep.cpu

machdep.cpu.max_basic: 10

machdep.cpu.max_ext: 2147483656

machdep.cpu.vendor: GenuineIntel

machdep.cpu.brand_string: Intel(R) Core(TM)2 CPU         T7600  @ 2.33GHz

machdep.cpu.family: 6

machdep.cpu.model: 15

machdep.cpu.extmodel: 0

machdep.cpu.extfamily: 0

machdep.cpu.stepping: 6

machdep.cpu.feature_bits: 3219913727 58269

machdep.cpu.extfeature_bits: 537921792 1

machdep.cpu.signature: 1782

machdep.cpu.brand: 0

machdep.cpu.features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL EST TM2 SSSE3 CX16 TPR PDCM

machdep.cpu.extfeatures: SYSCALL XD EM64T LAHF TSCI

machdep.cpu.logical_per_package: 2

machdep.cpu.cores_per_package: 2

machdep.cpu.microcode_version: 0

machdep.cpu.processor_flag: 0

machdep.cpu.mwait.linesize_min: 4096

machdep.cpu.mwait.linesize_max: 4096

machdep.cpu.mwait.extensions: 3

machdep.cpu.mwait.sub_Cstates: 0

machdep.cpu.thermal.sensor: 0

machdep.cpu.thermal.dynamic_acceleration: 0

machdep.cpu.thermal.invariant_APIC_timer: 0

machdep.cpu.thermal.thresholds: 0

machdep.cpu.thermal.ACNT_MCNT: 1

machdep.cpu.thermal.core_power_limits: 0

machdep.cpu.thermal.fine_grain_clock_mod: 0

machdep.cpu.thermal.package_thermal_intr: 0

machdep.cpu.thermal.hardware_feedback: 0

machdep.cpu.thermal.energy_policy: 0

machdep.cpu.arch_perf.version: 0

machdep.cpu.arch_perf.number: 0

machdep.cpu.arch_perf.width: 0

machdep.cpu.arch_perf.events_number: 0

machdep.cpu.arch_perf.events: 0

machdep.cpu.arch_perf.fixed_number: 0

machdep.cpu.arch_perf.fixed_width: 0

machdep.cpu.cache.linesize: 64

machdep.cpu.cache.L2_associativity: 16

machdep.cpu.cache.size: 2048

machdep.cpu.address_bits.physical: 40

machdep.cpu.address_bits.virtual: 48

machdep.cpu.core_count: 2

machdep.cpu.thread_count: 2

dump-2012-retina-macbook-pro.txt

dump-lionvm.txt

dump-2010-macpro.txt

dump-late2012-macmini.txt

[Donk]

That's great. Add the guest one when you are ready and I can compare with the kernel dump during boot. I will need a clean boot with the serial file and the kernel params from earlier post.

Did you see the edit on the previous post I made? probably crossed-posts

 

EDIT1: Seems to be a known issue http://www.insanelym...t-apps-crashes/

 

EDIT2: Try boot in 32-bit mode http://support.apple.com/kb/ht3773

[kwiksilver]

Here is the latest osxdebug.txt

 

Did you want the vmware.log too?

 

I will check out your latest edits and try booting in 32 bit mode. 

 

 

EDIT: After running "sudo systemsetup -setkernelbootarchitecture i386" my "/Library/Preferences/SystemConfiguration/com.apple.Boot.plist " looks like this:

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/Prope$
<plist version="1.0">
<dict>
        <key>Kernel Architecture</key>
        <string>i386</string>
        <key>Kernel Flags</key>
        <string></string>
</dict>
</plist>
 

It does not seem to have any real effect though. The only apps in activity monitor are 64 bit apps only and 32 bit apps still crash. 

osxdebug.txt

vmware.log.txt

[kwiksilver]

Well tonight I installed mavericks and it installed, but nothing 32bit works.  Any thoughts on how to proceed?

[Donk]

Well tonight I installed mavericks and it installed, but nothing 32bit works.  Any thoughts on how to proceed?

 

It is a problem with FX CPUs and also is shown when using an AMD kernel. There is a utility to by AndyV which might help, http://www.insanelymac.com/forum/topic/286043-autoamdtool-10-automatic-system-decrypter-cpuid-patchert/ I am still trying to work out if there is anything else that can be done at the CPUID mask level.

[kwiksilver]

I saw that utility the other day during my troubleshooting, but I was reluctant to try it given the response on the next post of that thread. I could take a snapshot of the VM and try it though. 

 

I may also install Windows and use your the CPUID masks and see what CPU it detects, and try to see where the AMD parts are bleeding through.

 

 

I did pick up some replacement Intel hardware to switch back to, but I'd like to see if we can make this work if we can. I think the challenge is half of the fun.