dsm plugin aesv2 issues

[eylenh]

I had a working UltraVNC (client and server both XP SP2, uvnc 1.0.2) setup but needed more security, so I turned to the DSM plugin.

I downloaded the plugin, unzipped it into the uvnc program directory on both client and server, generated the key, renamed it to aesv2.key and copied it to both client and server. Configured the server to use the plugin (apply+OK) and restarted the service. Both client and server found the key.

When I tried to connect (with the DSM selected on the client), it would hang on 'negotiating protocol'. On my server there was a pop up, indicating the service had crashed (memory could not be read). Turning on logging did not reveal anything.

Stopped the service and started the commandline. The WinVNC log showed that it loaded the current user's settings so I setup the service to run as that user. I could connect to the server but could not interact with the desktop so I switched back to the local system account.
Next step was to create the aesv2pluginkey system variable. Now I can connect and the server doesn't crash, but the remote window is never shown. This is in the WinVNC log :

Wed Oct 11 00:17:11 2006
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : AddClient() started
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : vncClient() executing...
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : TEST 4
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : AddClient() done
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : client connected : 82.146.aaa.bbb (3)
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : DSMPlugin Pointer to socket OK
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : m_ms_logon set to false --De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : negotiated version
--De bewerking is voltooid.
Entered InitAuthenticate --De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncPasswd.h : PASSWD : ToText called
--De bewerking is voltooid.
password authentication --De bewerking is voltooid.
Wed Oct 11 00:17:13 2006
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncdesktop.cpp : initialising desktop handler
--De ingang is ongeldig.
S:\UltraVNC\winvnc\winvnc\vncDesktopSW.cpp : SWinit
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncdesktopthread.cpp : Hook changed 1
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncdesktopthread.cpp : Hook changed 2
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncdesktop.cpp : KillScreenSaver...
--De bewerking is voltooid.
Wed Oct 11 00:17:14 2006
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : OpenInputDesktop I
--Onjuiste functie.
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : OpenInputDesktop II
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : SelectDesktop
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : OpenInputdesktop2 NULL
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : OpenInputdesktop2
--Onjuiste functie.
S:\UltraVNC\winvnc\winvnc\vncdesktop.cpp : InitDesktop Failed
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : SelectHDESK to Default (28) from 28
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncservice.cpp : SelectHDESK failed to close old desktop 28 (Err=170)
--De opgegeven bron is bezet.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : Desktop init failed, unlock in application mode ?
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : client Kill() called --De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vsocket.cpp : closing socket
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncdesktop.cpp : killing screen server
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : Authenticated() done
--Ongeldige vensteringang.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : RemoveClient() done
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : ~vncClient() executing...
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : deleting socket
--Ongeldige vensteringang.


Any ideas?

Hans

[eylenh]

some extra info: after switching users for the service account, I forgot to switch "allow service to interact with the desktop" back on. When i do that, the client is again hanging at the "negotiating protocol" window and the WinVNC log shows this :

S:\UltraVNC\winvnc\winvnc\vncserver.cpp : authhosts cleared
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncproperties.cpp : clearing user settings
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncPasswd.h : PASSWD : FromClear called
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncproperties.cpp : loading DEFAULT local settings
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncproperties.cpp : bypassing user-specific settings (both local and global)
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : trying port number 5900
--De bewerking is voltooid.
Wed Oct 11 00:31:00 2006
S:\UltraVNC\winvnc\winvnc\vsocket.cpp : closing socket
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncsockconnect.cpp : started socket connection thread
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vnchttpconnect.cpp : started HTTP server thread
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : DSMPlugin Params OK
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncPasswd.h : PASSWD : ToText called
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncpropertiesPoll.cpp : Reset Reg
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncpropertiesPoll.cpp : clearing user settings
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncpropertiesPoll.cpp : loading DEFAULT local settings
--De bewerking is voltooid.
Wed Oct 11 00:31:05 2006
--De bewerking is voltooid.
Wed Oct 11 00:31:10 2006
--De bewerking is voltooid.
Wed Oct 11 00:31:15 2006
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : AddClient() started
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : vncClient() executing...
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : TEST 4
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncserver.cpp : AddClient() done
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : client connected : 82.146.aaa.bbb (1)
--De bewerking is voltooid.
S:\UltraVNC\winvnc\winvnc\vncclient.cpp : DSMPlugin Pointer to socket OK
--De bewerking is voltooid.
--De bewerking is voltooid.
Wed Oct 11 00:31:20 2006
--De bewerking is voltooid.
Wed Oct 11 00:31:25 2006
--De bewerking is voltooid.