Snapshot Issues and errors

Issue: Error received when taking a snapshot.

The following error occurs taking the snapshot:

29-Sep-2011 10:39:02 com.sun.corba.se.impl.encoding.CDRInputStream_1_0 read_value
WARNING: "IOP00810257: (MARSHAL) Could not find class"
org.omg.CORBA.MARSHAL:   vmcid: SUN  minor code: 257 completed: Maybe
        at com.sun.corba.se.impl.logging.ORBUtilSystemException.couldNotFindClass(ORBUtilSystemException.java:8260)
        at com.sun.corba.se.impl.encoding.CDRInputStream_1_0.read_value(CDRInputStream_1_0.java:1013)
        at com.sun.corba.se.impl.encoding.CDRInputStream.read_value(CDRInputStream.java:253)
        at com.sun.jmx.remote.internal.PInputStream.read_value(Unknown Source)
        at org.omg.stub.javax.management.remote.rmi._RMIConnection_Stub.getMBeanInfo(Unknown Source)
        at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1052)
        at com.midvision.rapiddeploy.jmx.outbound.wls.AbstractWebLogicJmx.getConfigurationAsObject(AbstractWebLogicJmx.java:85)
        at com.midvision.rapiddeploy.jmx.outbound.wls.AbstractWebLogicJmx.getConfiguration(AbstractWebLogicJmx.java:129)
        at com.midvision.rapiddeploy.service.control.WebLogicControlCommand.takeSnapshot(WebLogicControlCommand.java:435)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.midvision.rapiddeploy.service.control.AbstractControlCommand.run(AbstractControlCommand.java:343)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.ClassNotFoundException
        ... 14 more
java.rmi.MarshalException: CORBA MARSHAL 1398079745 Maybe; nested exception is:
        org.omg.CORBA.MARSHAL:   vmcid: SUN  minor code: 257 completed: Maybe
        at com.sun.corba.se.impl.javax.rmi.CORBA.Util.mapSystemException(Util.java:197)
        at javax.rmi.CORBA.Util.mapSystemException(Util.java:67)
        at org.omg.stub.javax.management.remote.rmi._RMIConnection_Stub.getMBeanInfo(Unknown Source)
        at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1052)
        at com.midvision.rapiddeploy.jmx.outbound.wls.AbstractWebLogicJmx.getConfigurationAsObject(AbstractWebLogicJmx.java:85)
        at com.midvision.rapiddeploy.jmx.outbound.wls.AbstractWebLogicJmx.getConfiguration(AbstractWebLogicJmx.java:129)
        at com.midvision.rapiddeploy.service.control.WebLogicControlCommand.takeSnapshot(WebLogicControlCommand.java:435)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.midvision.rapiddeploy.service.control.AbstractControlCommand.run(AbstractControlCommand.java:343)
        at java.lang.Thread.run(Thread.java:662)
Caused by: org.omg.CORBA.MARSHAL:   vmcid: SUN  minor code: 257 completed: Maybe
        at com.sun.corba.se.impl.logging.ORBUtilSystemException.couldNotFindClass(ORBUtilSystemException.java:8260)
        at com.sun.corba.se.impl.encoding.CDRInputStream_1_0.read_value(CDRInputStream_1_0.java:1013)
        at com.sun.corba.se.impl.encoding.CDRInputStream.read_value(CDRInputStream.java:253)
        at com.sun.jmx.remote.internal.PInputStream.read_value(Unknown Source)
        ... 11 more
Caused by: java.lang.ClassNotFoundException
        ... 14 more

Resolution:

Place the wlclient.jar in the Tomcat lib directory. This file may need to be amended to remove javax classes that clash with the supplied ones in the lib directory.

Issue: Error received on deployment using JMX.

You receive an error similar to the following when running a WebLogic JMX configuration deployment

Exception in thread "Thread-13" java.lang.NoClassDefFoundError: com/ibm/CORBA/iiop/ORB
        at com.ibm.ws.naming.util.WsnInitCtxFactory.getInitialContextInternal(WsnInitCtxFactory.java:421)
        at com.ibm.ws.naming.util.WsnInitCtx.getContext(WsnInitCtx.java:123)
        at com.ibm.ws.naming.util.WsnInitCtx.getContextIfNull(WsnInitCtx.java:798)
        at com.ibm.ws.naming.util.WsnInitCtx.lookup(WsnInitCtx.java:164)
        at com.ibm.ws.naming.util.WsnInitCtx.lookup(WsnInitCtx.java:179)
        at javax.naming.InitialContext.lookup(InitialContext.java:392)
        at com.ibm.websphere.management.remote.WsProvider.newJMXConnector(WsProvider.java:139)
        at javax.management.remote.JMXConnectorFactory.getConnectorAsService(JMXConnectorFactory.java:427)
        at javax.management.remote.JMXConnectorFactory.newJMXConnector(JMXConnectorFactory.java:310)
        at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:247)
        at com.midvision.rapiddeploy.jmx.outbound.wls.WebLogicJmxHelper.createConnection(WebLogicJmxHelper.java:68)
        at com.midvision.rapiddeploy.jmx.outbound.wls.WebLogicJmxHelper.createConnection(WebLogicJmxHelper.java:77)
        at com.midvision.rapiddeploy.jmx.outbound.wls.AbstractWebLogicJmx.<init>(AbstractWebLogicJmx.java:63)
        at com.midvision.rapiddeploy.jmx.outbound.wls.WebLogicJmxImport.<init>(WebLogicJmxImport.java:47)
        at com.midvision.rapiddeploy.orchestration.tasks.wls.JmxDeployConfigurationTask.runTask(JmxDeployConfigurationTask.java:84)
        at com.midvision.rapiddeploy.domain.task.core.AbstractJobRunner.runBatch(Unknown Source)
        at com.midvision.rapiddeploy.domain.task.core.AbstractJobRunner._runBatch(Unknown Source)
        at com.midvision.rapiddeploy.remoting.server.JobRunner._main(JobRunner.java:70)
        at com.midvision.rapiddeploy.remoting.server.JobRunner.main(JobRunner.java:33)
        at com.midvision.rapiddeploy.remoting.server.RemoteInvocationHandler.run(RemoteInvocationHandler.java:177)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.ClassNotFoundException: com.ibm.CORBA.iiop.ORB
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
        ... 21 more

Resolution:

We need to ensure that no IBM WebSphere client jars are on the classpath. Remove them from the MidVision lib directory or from any classpath set on the target server.

Issue: Connection failure.

You get the following error trying to take a snapshot, when the framework server connects to the server:

29-Sep-2011 14:45:04 com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 192.168.1.4; port: 7001"
org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 201  completed: No
        at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
        at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
        at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
        at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
        at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
        at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:152)
        at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
        at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
        at org.omg.stub.javax.management.remote.rmi._RMIConnection_Stub.getDefaultDomain(Unknown Source)
        at javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.checkConnection(RMIConnector.java:1578)
        at com.sun.jmx.remote.internal.ClientCommunicatorAdmin$Checker.run(ClientCommunicatorAdmin.java:165)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.ConnectException: Connection refused: connect
        at sun.nio.ch.Net.connect(Native Method)
        at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:500)
        at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
        at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
        at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
        ... 9 more

Resolution:

This may be a firewall issue or an IIOP security issue.

Check that the host/port can be connected to from the client Check IIOP is enabled and the correct username/password entered (as above)

Issue: ORB already destroyed error on deployment.

The following error is returned when the deployment process tries to connect to the target server instance:

WARNING: "IOP01210228: (BAD_OPERATION) This ORB instance has been destroyed, so no operations can be performed on it"
org.omg.CORBA.BAD_OPERATION:   vmcid: SUN  minor code: 228  completed: No
        at com.sun.corba.se.impl.logging.ORBUtilSystemException.orbDestroyed(ORBUtilSystemException.java:586)
        at com.sun.corba.se.impl.logging.ORBUtilSystemException.orbDestroyed(ORBUtilSystemException.java:608)
        at com.sun.corba.se.impl.orb.ORBImpl.checkShutdownState(ORBImpl.java:1308)
        at com.sun.corba.se.impl.orb.ORBImpl.create_any(ORBImpl.java:1097)
        at com.sun.corba.se.impl.javax.rmi.CORBA.Util.writeAny(Util.java:312)
        at javax.rmi.CORBA.Util.writeAny(Util.java:96)
        at org.omg.stub.javax.management.remote.rmi._RMIServer_Stub.newClient(Unknown Source)
        at javax.management.remote.rmi.RMIConnector.getConnection(RMIConnector.java:2343)
        at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:296)
        at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
        at com.midvision.rapiddeploy.jmx.outbound.wls.WebLogicJmxHelper.createConnection(WebLogicJmxHelper.java:68)
        at com.midvision.rapiddeploy.jmx.outbound.wls.WebLogicJmxHelper.createConnection(WebLogicJmxHelper.java:77)
        at com.midvision.rapiddeploy.jmx.outbound.wls.AbstractWebLogicJmx.<init>(AbstractWebLogicJmx.java:63)
        at com.midvision.rapiddeploy.jmx.outbound.wls.WebLogicJmxImport.<init>(WebLogicJmxImport.java:47)
        at com.midvision.rapiddeploy.orchestration.tasks.wls.JmxDeployConfigurationTask.runTask(JmxDeployConfigurationTask.java:84)
        at com.midvision.rapiddeploy.domain.task.core.AbstractJobRunner.runBatch(Unknown Source)
        at com.midvision.rapiddeploy.domain.task.core.AbstractJobRunner._runBatch(Unknown Source)
        at com.midvision.rapiddeploy.domain.task.core.AbstractJobRunner._main(Unknown Source)
        at com.midvision.rapiddeploy.domain.task.core.JobRunner.main(Unknown Source)

Resolution:

Check that the JDK being picked up on the target server is the correct one. This should be a SUN 1.6JDK/JRE. TO be sure about this, set the JRE in the .bashrc file and in the ~/.ssh/environment file. Restart the ssh daemon.

Issue: Security exception when taking a snapshot:

The following error is observed in the job logs when aking a snapshot:

org.omg.CORBA.NO_PERMISSION:   vmcid: 0x0  minor code: 0  completed: No

Resolution:

Configure the WebLogic domain to allow IIOP connection. Enter the appropriate username and password and restart the domain.

  1. Log in to the WebLogic console
  2. Go to Servers �> GenericAdminServer �> Protocols �> IIOP
  3. Check the IIOP enabled checkbox and in 'advanced settings' enter the weblogic domain password (weblog1c by default) and repeat it.
  4. Save.
  5. Restart Domain.