OpenCL fix for non-GF100/GF110 cards (aka CC/SM 2.1+)

Sanky18 · July 31, 2012

Hi i have a lenovo g460 running 10.8 having following configuration:

Intel core i5 520m

4 gb ram

500 gb hdd

nvidia geforce 310m

I have succcessfully installed 10.8 and also booted up without any problems but the system hangs after a couple of minutes after boot. I can move the mouse but everything else is frozen. In the system log i get this:

NVDA(OpenGL): Channel exception! exception type = 0xd = GR: SW Notify Error

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: IOVendorGLContext::ReportGPURestart

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 0000006e

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00200000 00008597 00000474 00000040

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 0000047e 000017b4 00000001 0000000a

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00000000 00000000 00000002

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00000040 00000000

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: NVDA(OpenGL): Channel exception! exception type = 0xd = GR: SW Notify Error

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 0000006e

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00200000 00008597 00000474 00000010

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 0000047e 00000dfc 0000002b 0000000a

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00000000 00000000 00000403

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00000010 00000000

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: NVDA(OpenGL): Channel exception! exception type = 0xd = GR: SW Notify Error

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 0000006e

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00200000 00008597 00000474 00000010

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 0000047e 00000dfc 0000006e 0000000a

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00000000 00000000 00000403

Jul 18 20:20:49 Sankets-MacBook-Pro kernel[0]: 00000010 00000000

How do i solve this?? In 0.7.4 the gpu worked just fine. Thanks in advance.

rfwagner · August 21, 2012

Hello to all, i want to make a request for anyone that have Final Cut Pro X installed, and is using this kind of video card, if the OPENCL ativated by this method is used by the FCPX for rendering video, because some people reported that especialy in FCP the GPU is not activated to render, just the CPU, and after make this procedure.

Can someone please test and post here?

I know that some guys post in tonymac forum that they can see what i wrote, with a system temperatu monitor, the gpu temp stay the same after some time in rendering, only the cpu temp raises, reaching the conclusion that the OPENCL activated did not work for Final Cut.

Sincerely thanks since now.

RobertX · September 12, 2012

seems that i need this fix again(or a new fix?)

after using these drivers http://www.nvidia.co...f20-driver.html running 10.8.1, OpenCLOceanWave errors again... :moil:

Edited September 12, 2012 by robertx

RobertX · September 12, 2012

from oclinfo:

1 OpenCL platform found!
[Platform 0]
Name:   Apple
Vendor:  Apple
Version:  OpenCL 1.2 (Jun 20 2012 14:18:19)
Profile:  FULL_PROFILE
Extensions:	cl_APPLE_SetMemObjectDestructor cl_APPLE_ContextLoggingFunctions cl_APPLE_clut cl_APPLE_query_kernel_names cl_APPLE_gl_sharing cl_khr_gl_event

[OpenCL-only Context]
2 OpenCL devices found!
[Device 0]
Name:	Intel® Core™2 Duo CPU	 E6550  @ 2.33GHz
Vendor:   Intel
Type:	CPU
Device Version:  OpenCL 1.2
Driver Version:  1.1
Compute Units:   2
Work Group Size:  1024
Clock:	2327 MHz
Global Memory (Total):  8192 MB
Global Memory (Host):  8192 MB
Global Memory (PCIe):  0 MB
Local Memory:   32 KB
Cache Size:   0.0625 KB
Cache Line Size:  4194304 Bytes
Available:   Yes
Double-Precision:  Yes
Extensions:
cl_APPLE_SetMemObjectDestructor
cl_APPLE_ContextLoggingFunctions
cl_APPLE_clut
cl_APPLE_query_kernel_names
cl_APPLE_gl_sharing
cl_khr_gl_event
cl_khr_fp64
cl_khr_global_int32_base_atomics
cl_khr_global_int32_extended_atomics
cl_khr_local_int32_base_atomics
cl_khr_local_int32_extended_atomics
cl_khr_byte_addressable_store
cl_khr_int64_base_atomics
cl_khr_int64_extended_atomics
cl_khr_3d_image_writes
cl_APPLE_fp64_basic_ops
cl_APPLE_fixed_alpha_channel_orders
cl_APPLE_biased_fixed_point_image_formats
[Device 1]
Name:	GeForce GT 520
Vendor:   NVIDIA
Type:	GPU
Device Version:  OpenCL 1.1
Driver Version:  CLH 1.0
Compute Units:   1
Work Group Size:  1024
Clock:	1620 MHz
Global Memory:   1024 MB
Local Memory:   48 KB
Cache Size:   0 KB
Cache Line Size:  0 Bytes
Available:   Yes
Double-Precision:  No
Extensions:
cl_APPLE_SetMemObjectDestructor
cl_APPLE_ContextLoggingFunctions
cl_APPLE_clut
cl_APPLE_query_kernel_names
cl_APPLE_gl_sharing
cl_khr_gl_event
cl_khr_byte_addressable_store
cl_khr_global_int32_base_atomics
cl_khr_global_int32_extended_atomics
cl_khr_local_int32_base_atomics
cl_khr_local_int32_extended_atomics
cl_APPLE_fp64_basic_ops
[shared OpenCL+OpenGL Context]
2 OpenCL devices found!
[Device 0]
Name:	GeForce GT 520
Vendor:   NVIDIA
Type:	GPU
Device Version:  OpenCL 1.1
Driver Version:  CLH 1.0
Compute Units:   1
Work Group Size:  1024
Clock:	1620 MHz
Global Memory:   1024 MB
Local Memory:   48 KB
Cache Size:   0 KB
Cache Line Size:  0 Bytes
Available:   Yes
Double-Precision:  No
Extensions:
cl_APPLE_SetMemObjectDestructor
cl_APPLE_ContextLoggingFunctions
cl_APPLE_clut
cl_APPLE_query_kernel_names
cl_APPLE_gl_sharing
cl_khr_gl_event
cl_khr_byte_addressable_store
cl_khr_global_int32_base_atomics
cl_khr_global_int32_extended_atomics
cl_khr_local_int32_base_atomics
cl_khr_local_int32_extended_atomics
cl_APPLE_fp64_basic_ops
[Device 1]
Name:	Intel® Core™2 Duo CPU	 E6550  @ 2.33GHz
Vendor:   Intel
Type:	CPU
Device Version:  OpenCL 1.2
Driver Version:  1.1
Compute Units:   2
Work Group Size:  1024
Clock:	2327 MHz
Global Memory (Total):  8192 MB
Global Memory (Host):  8192 MB
Global Memory (PCIe):  0 MB
Local Memory:   32 KB
Cache Size:   0.0625 KB
Cache Line Size:  4194304 Bytes
Available:   Yes
Double-Precision:  Yes
Extensions:
cl_APPLE_SetMemObjectDestructor
cl_APPLE_ContextLoggingFunctions
cl_APPLE_clut
cl_APPLE_query_kernel_names
cl_APPLE_gl_sharing
cl_khr_gl_event
cl_khr_fp64
cl_khr_global_int32_base_atomics
cl_khr_global_int32_extended_atomics
cl_khr_local_int32_base_atomics
cl_khr_local_int32_extended_atomics
cl_khr_byte_addressable_store
cl_khr_int64_base_atomics
cl_khr_int64_extended_atomics
cl_khr_3d_image_writes
cl_APPLE_fp64_basic_ops
cl_APPLE_fixed_alpha_channel_orders
cl_APPLE_biased_fixed_point_image_formats
logout
[Process completed]

...so i have something... :whistle: ...just not sure what

and from displacement, run from terminal

Downloads/Release/displacement
----------------------------------------------------------------------
Setting up Graphics...
----------------------------------------------------------------------
Creating Shadow FrameBuffer...
Creating Jitter Texture...
Loading Light Probe "stpeters_probe.pfm"
Creating Light Probe Texture (1500 x 1500)....
----------------------------------------------------------------------
Filling Sphere 1040384 bytes 65024 elements (127 x 512) => (127 x 512)
Loading Shader Program "fresnel.vert"...
Loading Shader Program "fresnel.frag"...
Loading Shader Program "phong.vert"...
Loading Shader Program "phong.frag"...
Loading Shader Program "skybox.vert"...
Loading Shader Program "skybox.frag"...
----------------------------------------------------------------------
Setting up Compute...
----------------------------------------------------------------------
Using active OpenGL context...
----------------------------------------------------------------------
Connecting to NVIDIA GeForce GT 520...
----------------------------------------------------------------------
Allocating buffers on compute device...
----------------------------------------------------------------------
Loading kernel source from file 'displacement_kernel.cl'...
----------------------------------------------------------------------
Building compute program...
OpenCL Build Warning : Compiler build log:
<program source>:107:5: warning: no previous prototype for function 'mod'
int mod(int x, int a)
^
<program source>:116:7: warning: no previous prototype for function 'mix1d'
float mix1d(float a, float b, float t)
  ^
<program source>:124:8: warning: no previous prototype for function 'mix2d'
float2 mix2d(float2 a, float2 b, float t)
   ^
<program source>:132:8: warning: no previous prototype for function 'mix3d'
float4 mix3d(float4 a, float4 b, float t)
   ^
<program source>:140:7: warning: no previous prototype for function 'smooth'
float smooth(float t)
  ^
<program source>:145:5: warning: no previous prototype for function 'lattice3d'
int lattice3d(int4 i)
^
<program source>:150:7: warning: no previous prototype for function 'gradient3d'
float gradient3d(int4 i, float4 v)
  ^
<program source>:157:8: warning: no previous prototype for function 'normalized'
float4 normalized(float4 v)
   ^
<program source>:166:7: warning: no previous prototype for function 'gradient_noise3d'
float gradient_noise3d(float4 position)
  ^
<program source>:214:7: warning: no previous prototype for function 'ridgedmultifractal3d'
float ridgedmultifractal3d(
  ^
<program source>:223:8: warning: unused variable 'remainder'
	float remainder = 0.0f;
		  ^
<program source>:224:8: warning: unused variable 'sample'
	float sample = 0.0f;  
		  ^
<program source>:252:8: warning: no previous prototype for function 'cross3'
float4 cross3(float4 va, float4 vb)
   ^
<program source>:280:14: warning: comparison of integers of different signs: 'int' and 'uint' (aka 'unsigned int')
if(index >= count)
   ~~~~~ ^  ~~~~~
<program source>:283:10: warning: unused variable 'di'
int2 di = (int2)(tx, ty);
	 ^
<program source>:275:9: warning: unused variable 'ix'
int ix = (int) dimx;
	^

Break on OpenCLWarningBreak to debug.
Creating kernel 'displace'...
Maximum Workgroup Size '768'
----------------------------------------------------------------------
Starting event loop...
----------------------------------------------------------------------
Leslies-Mac-Pro:Release leslie$

a screen from displacement...

here's a screenshot of an OpenCL based screensaver...

m_coffee · September 13, 2012

Is there any solution for enabling OpenCL for this new driver from NVIDIA?

I have GT 430 with 1GB memory.

RobertX · September 14, 2012

...think i've got the fix now...from "the other place"

"Anyway I just wanted to share this patch for libclh.dylib since the old one doesn't work anymore and it's quite frustrating that OpenCL isn't working out of the box so to speak. And it took some time to work it out since Nvidia anonymized the function names in the library.

Just copy and paste this in a terminal window (don't forget to backup libclh.dylib beforehand).

Code:

sudo perl -pi -e '$c+=s/\x8b\x81\x1c\x0c\x00\x00\xeb\x06\x8b\x81\x20\x0c\x00\x00/\xb8\x02\x00\x00\x00\x90\xeb\x06\xb8\x00\x00\x00\x00\x90/; END { printf "%s: %d substitution%s made.\n",($c==1 ? "Success" : "Error"),$c,(!$c || $c>1 ? "s" : ""); $?=($c!=1); }' /System/Library/Extensions/GeForceGLDriver.bundle/Contents/MacOS/libclh.dylib

Alternatively you can use a hex editor to search for:

8b 81 1c 0c 00 00 eb 06 8b 81 20 0c 00 00

and replace it by:

b8 02 00 00 00 90 eb 06 b8 00 00 00 00 90

There should be only one occurrence of this in the whole file. The perl script will tell you the number of substitutions it made.

Normally it should take effect immediately so there's no need to reboot, it should also trigger a rebuild of the kernel cache.

If like me you're a cautious person feel free to do those two things manually." (all credit to this code digger) credit removed

...using the new drivers from nvidia for 10.8.1 i can now run the LuxMark v2.0 benchmark ... :thumbsup_anim:

Edited April 7, 2013 by robertx
Link to tonymac removed

m_coffee · September 14, 2012

THANK YOU!!!!
IT IS A PERFECT SOLUTION!!!

Edited September 17, 2013 by Gringo Vermelho
Fullquote removed. Please don't quote entire posts when replying directly below them.

RobertX · September 14, 2012

...just delivering the news

RobertX · September 20, 2012

on 10.8.2 now...and again a new patch seems to be required... :worried_anim: ..."a hunting I will go..."

RobertX · September 20, 2012

for the stock 10.8.2 drivers (8.0.61 295.30.20f02 version) this fix still works

"So, open up a hex editor of your liking and do this:

open /System/Library/Extensions/GeForceGLDriver.bundle/Contents/MacOS/libclh.dylib (as root or with sudo)

find: 8B 87 1C 0C 00 00 89 06 8B 87 20 0C 00 00 89 02

replace by: 31 C0 FF C0 FF C0 89 06 31 C0 89 02 90 90 90 90

save

reboot is not required, but recommended" from the first post... :thumbsup_anim:

tora · October 11, 2012

for the stock 10.8.2 drivers (8.0.61 295.30.20f02 version) this fix still works

"So, open up a hex editor of your liking and do this:

open /System/Library/Extensions/GeForceGLDriver.bundle/Contents/MacOS/libclh.dylib (as root or with sudo)

find: 8B 87 1C 0C 00 00 89 06 8B 87 20 0C 00 00 89 02

replace by: 31 C0 FF C0 FF C0 89 06 31 C0 89 02 90 90 90 90

save

reboot is not required, but recommended" from the first post...

By doing so, OpenCL doesn't work for me.

I'm on OS X 10.8.2 (12C60) and my graphics card is Gigabyte GeForce GTX 560 Ti 1024 MB.

What I am doing wrong?

Greetings and thanks.

tora · October 11, 2012

By doing so, OpenCL doesn't work for me.

I'm on OS X 10.8.2 (12C60) and my graphics card is Gigabyte GeForce GTX 560 Ti 1024 MB.

What I am doing wrong?

Greetings and thanks.

well,

this script with latest nVidia drivers get back openCL for me

sudo perl -pi -e '$c+=s/\x8b\x81\x1c\x0c\x00\x00\xeb\x06\x8b\x81\x20\x0c\x00\x00/\xb8\x02\x00\x00\x00\x90\xeb\x06\xb8\x00\x00\x00\x00\x90/; END { printf "%s: %d substitution%s made.\n",($c==1 ? "Success" : "Error"),$c,(!$c || $c>1 ? "s" : ""); $?=($c!=1); }' /System/Library/Extensions/GeForceGLDriver.bundle/Contents/MacOS/libclh.dylib

RobertX · October 11, 2012

...good to see people using their heads... :smoke:

aankun.ganteng · April 3, 2013

Hi, this guide is succesfully enable my openCL :thumbsup_anim:

but when click on oceanwave test the image is having some glitches

(see the bottom of the sun)

is it normal???

mitch_de · April 3, 2013

Hi, this guide is succesfully enable my openCL

but when click on oceanwave test the image is having some glitches

(see the bottom of the sun)

is it normal???

No, the rendering is not correct. The waves are missed.

You can try much newer (than 1.2) OceanWave version , but i think (because the OpenCL code wasnt changed) the missing waves will stay.

Such things may happen with some of the subgpu types which not already fully supported by the OpenCL drivers .

to be more excact: to on the fly OpenCL compiler which compiles the source for the found gpu type on the host system. Other than CUDA, which is compiled by the dev already (for several nvidia gpu types) OpenCL used OpenCL source code and compiled it later on run time (first run).

Doesnt matter much, because the complex used OpenCL functions in OceanWave , which fail on your gpu may not used in other OpenCL acceled apps.

aankun.ganteng · April 4, 2013

No, the rendering is not correct. The waves are missed.

You can try much newer (than 1.2) OceanWave version , but i think (because the OpenCL code wasnt changed) the missing waves will stay.

Such things may happen with some of the subgpu types which not already fully supported by the OpenCL drivers .

to be more excact: to on the fly OpenCL compiler which compiles the source for the found gpu type on the host system. Other than CUDA, which is compiled by the dev already (for several nvidia gpu types) OpenCL used OpenCL source code and compiled it later on run time (first run).

Doesnt matter much, because the complex used OpenCL functions in OceanWave , which fail on your gpu may not used in other OpenCL acceled apps.

Thanks for the reply,

anyway a redo all the patch from the beginning

now the rendering is flickering between screenshot #1 and #2

i think it's getting better?

mitch_de · April 4, 2013

You are on the right way

JahRastaMaN · April 7, 2013

...think i've got the fix now...from "the other place"

"Anyway I just wanted to share this patch for libclh.dylib since the old one doesn't work anymore and it's quite frustrating that OpenCL isn't working out of the box so to speak. And it took some time to work it out since Nvidia anonymized the function names in the library.

Just copy and paste this in a terminal window (don't forget to backup libclh.dylib beforehand).

Code:

sudo perl -pi -e '$c+=s/\x8b\x81\x1c\x0c\x00\x00\xeb\x06\x8b\x81\x20\x0c\x00\x00/\xb8\x02\x00\x00\x00\x90\xeb\x06\xb8\x00\x00\x00\x00\x90/; END { printf "%s: %d substitution%s made.\n",($c==1 ? "Success" : "Error"),$c,(!$c || $c>1 ? "s" : ""); $?=($c!=1); }' /System/Library/Extensions/GeForceGLDriver.bundle/Contents/MacOS/libclh.dylib

Thank YOU man! It's works fine for me. i'm using G75VW RS 72 and 10.8.3 and GTX 670m 3GB GDDR5

http://cl.ly/O6ro

RobertX · April 7, 2013

beta992 · April 21, 2013

Thank YOU man! It's works fine for me. i'm using G75VW RS 72 and 10.8.3 and GTX 670m 3GB GDDR5

Patch from robertx was also needed for me on 10.8.3.

JahRastaMaN · May 6, 2013

Cool Beta992! Edit you signature

RobertX · May 16, 2013

for the new nvidia "Web" drivers this works for me

...in Terminal type:

sudo perl -pi -e '$c+=s/\x8b\x81\x1c\x0c\x00\x00\xeb\x06\x8b\x81\x20\x0c\x00\x00/\xb8\x02\x00\x00\x00\x90\xeb\x06\xb8\x00\x00\x00\x00\x90/; END { printf "%s: %d substitution%s made.\n",($c==1 ? "Success" : "Error"),$c,(!$c || $c>1 ? "s" : ""); $?=($c!=1); }' /System/Library/Extensions/GeForceGLDriverWeb.bundle/Contents/MacOS/libclh.dylib

:smoke:

edit: although the fix works, i now get this error in safari while attempting to view the iphone ad...

5/16/13 4:50:36.000 PM kernel[0]: NVDA(Video): Channel exception! exception type = 0x1f = Fifo: MMU Error

5/16/13 4:50:44.365 PM WebProcess[405]: VADriver: Channel timeout (client), ch = 2

5/16/13 4:50:56.000 PM kernel[0]: NVDA(Video): Channel timeout!

5/16/13 4:51:16.000 PM kernel[0]: NVDA(Video): Channel timeout!

5/16/13 4:51:24.809 PM WebProcess[405]: VADriver: Channel timeout (client), ch = 3

5/16/13 4:51:36.000 PM kernel[0]: NVDA(OpenGL): Channel timeout!

5/16/13 4:51:57.000 PM kernel[0]: NVDA(Video): Channel timeout!

5/16/13 4:52:17.000 PM kernel[0]: NVDA(OpenGL): Channel timeout!

...totally locks up my system...i'll keep hunting

...changed my smbios.plist to MacPro 3.1 and no longer have the channel timeout freeze in safari

Edited May 17, 2013 by robertx

beta992 · May 16, 2013

for the new nvidia "Web" drivers this works for me

...in Terminal type:

sudo perl -pi -e '$c+=s/\x8b\x81\x1c\x0c\x00\x00\xeb\x06\x8b\x81\x20\x0c\x00\x00/\xb8\x02\x00\x00\x00\x90\xeb\x06\xb8\x00\x00\x00\x00\x90/; END { printf "%s: %d substitution%s made.\n",($c==1 ? "Success" : "Error"),$c,(!$c || $c>1 ? "s" : ""); $?=($c!=1); }' /System/Library/Extensions/GeForceGLDriverWeb.bundle/Contents/MacOS/libclh.dylib

edit: although the fix works, i now get this error in safari while attempting to view the iphone ad...

5/16/13 4:50:36.000 PM kernel[0]: NVDA(Video): Channel exception! exception type = 0x1f = Fifo: MMU Error

5/16/13 4:50:36.000 PM kernel[0]: NVDA(Video): Channel exception! exception type = 0x1f = Fifo: MMU Error

5/16/13 4:50:44.365 PM WebProcess[405]: VADriver: Channel timeout (client), ch = 2

5/16/13 4:50:56.000 PM kernel[0]: NVDA(Video): Channel timeout!

5/16/13 4:51:16.000 PM kernel[0]: NVDA(Video): Channel timeout!

5/16/13 4:51:24.809 PM WebProcess[405]: VADriver: Channel timeout (client), ch = 3

5/16/13 4:51:36.000 PM kernel[0]: NVDA(OpenGL): Channel timeout!

5/16/13 4:51:57.000 PM kernel[0]: NVDA(Video): Channel timeout!

5/16/13 4:52:17.000 PM kernel[0]: NVDA(OpenGL): Channel timeout!

...totally locks up my system...i'll keep hunting

Safari is buggy for me to.. using Chrome as browser now. No freezes, although I'm using the DP3 kexts.

cmf · May 24, 2013

better late than never: *updated first post for 10.8.3+ with the info posted by robertx.

for the people who are interested, the replacement code does this:


movl $2, %eax

nop

jmp 6

movl $0, %eax

nop

so you should be able to set this to a different CC by replacing $MAJOR and $MINOR in this sequence:
B8 $MAJOR 00 00 00 90 EB 06 B8 $MINOR 00 00 00 90

if any of the gtx titan / gk110 folks reads this, please test if this makes opencl work on those devices (sets it to CC3.0 which is used for gk104 devices):
B8 03 00 00 00 90 EB 06 B8 00 00 00 00 90

this does not work!

JahRastaMaN · May 28, 2013

I Don't use Web driver. My solution for NVDA Channel Timeout was install Cuda 5.0.59 and freezefix. I have been there five days without NVDA Channel timeout with

OpenCL fix for non-GF100/GF110 cards (aka CC/SM 2.1+)

Recommended Posts

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites