Article:
  Clustering and Load Balancing in Tomcat 5, Part 2
Subject:   4 Tomcat Servers
Date:   2005-04-22 13:48:05
From:   j2eeman
Nice article for me to get start up with Tomcat clustering. I have a question regarding the number of server to be set up on my machine. In your article "After installing Tomcat server instances (you need four of them), extract the contents of the zip file to the tomcat directories"


so, does this mean, I need to install tomcat in 4 places.


Can you pls clarify.


Thanks,
Raghu

Full Threads Oldest First

Showing messages 1 through 3 of 3.

  • 4 Tomcat Servers
    2006-10-25 23:07:05  suhaib [View]

    Hi
    I am new to Tomcat and infact new to this domain. I am trying to set up 4 Tomcat servers in a cluster and one of them will act as load balancer. (This one does both load balacing and server the requests). Moreover, I need a way to design a load balancing scheme where I can dynamically balance the load among all the available servers. (Balanced load in contrast to random or round robin which does work this way). Moreover any of the server can go down and comes up but not the load balancer one which always stays up.

    I have read a couple of articles but none seems to answer my questions as no one really explains the things in the server.xml and rules.xml. I have no clue to what these are and how these are manil]pulated to get the desires results. ( Java sucks full time and it seems that it does not have any direcion so far, I am a C programmer).

    I will highly appreciate if someone can tell me what needs to be modified in the server.xml and rules.xml or other file to get this work done.


    Moreover WHAT is these lines in server.xml (the first server LOAD BALANCER in this article) doing:


    <Manager className="org.apache.catalina.session.PersistentReplicationManager"

    debug="0"

    saveOnRestart="true">

    <Store className="org.apache.catalina.session.FileStore"

    directory="E:\web\tomcat50\work" />

    </Manager>


    These lines are not in the other servers servers.xml files nor in my server.xml file

    I am using tomcat 5.5:
    Finally what does this means:
    "extract the contents of the zip file to the tomcat directories."Do we have to overwrite all the files in the tomecat folder with these folders. Do I need "ServerUtil" class or other rule classes in tomcat 5.5.


    This is my server.xml file
    <!-- Server Configuration File for Tomcat 5 on Debian
    You can find a more complete example in /usr/share/doc/tomcat5/examples/
    -->

    <!-- Note that component elements are nested corresponding to their
    parent-child relationships with each other -->

    <!-- A "Server" is a singleton element that represents the entire JVM,
    which may contain one or more "Service" instances. The Server
    listens for a shutdown command on the indicated port.tcpListenPort

    Note: A "Server" is not itself a "Container", so you may not
    define subcomponents such as "Valves" or "Loggers" at this level.
    -->

    <Server port="8005" shutdown="SHUTDOWN" debug="0">

    <Listener className="org.apache.catalina.mbeans.ServerLifecycleListener"
    debug="0"/>
    <Listener className="org.apache.catalina.mbeans.GlobalResourcesLifecycleListener"
    debug="0"/>

    <!-- Global JNDI resources -->
    <GlobalNamingResources>

    <!-- Test entry for demonstration purposes -->
    <Environment name="simpleValue" type="java.lang.Integer" value="30"/>

    <!-- Editable user database that can also be used by
    UserDatabaseRealm to authenticate users -->
    <Resource name="UserDatabase" auth="Container" type="org.apache.catalina.UserDatabase" description="User database that can be updated and saved" factory="org.apache.catalina.users.MemoryUserDatabaseFactory" pathname="conf/tomcat-users.xml"/>

    <ResourceParams name="UserDatabase">
    <parameter>
    <name>factory</name>
    <value>org.apache.catalina.users.MemoryUserDatabaseFactory</value>
    </parameter>
    <parameter>
    <name>pathname</name>
    <value>conf/tomcat-users.xml</value>
    </parameter>
    </ResourceParams>

    </GlobalNamingResources>

    <!-- A "Service" is a collection of one or more "Connectors" that share
    a single "Container" (and therefore the web applications visible
    within that Container). Normally, that Container is an "Engine",
    but this is not required.

    Note: A "Service" is not itself a "Container", so you may not
    define subcomponents such as "Valves" or "Loggers" at this level.
    -->

    <!-- Define the Tomcat Stand-Alone Service -->
    <Service name="Tomcat-Standalone">



    <!-- Define a non-SSL Coyote HTTP/1.1 Connector on port 8180 -->
    <Connector className="org.apache.coyote.tomcat5.CoyoteConnector"
    port="8180" maxThreads="150" minSpareThreads="25" maxSpareThreads="75"
    enableLookups="true" acceptCount="10" debug="0"
    connectionTimeout="20000" useURIValidationHack="false" />

    <!-- Define a Coyote/JK2 AJP 1.3 Connector on port 8009 -->
    <Connector className="org.apache.coyote.tomcat5.CoyoteConnector"
    port="8009" maxThreads="150" minSpareThreads="25" maxSpareThreads="75"
    enableLookups="true" acceptCount="10" debug="0"
    connectionTimeout="20000" useURIValidationHack="false"
    protocolHandlerClassName="org.apache.jk.server.JkCoyoteHandler"/>

    <!-- An Engine represents the entry point (within Catalina) that processes
    every request. The Engine implementation for Tomcat stand alone
    analyzes the HTTP headers included with the request, and passes them
    on to the appropriate Host (virtual host). -->

    <!-- Define the top level container in our container hierarchy
    The name must be Catalina for correct function of the admin webapp -->
    <Engine name="Catalina" jvmRoute="node01" defaultHost="localhost" debug="0">

    <!-- Global logger unless overridden at lower levels
    <Logger className="org.apache.catalina.logger.FileLogger"
    prefix="catalina_" suffix=".log" timestamp="true"/>
    -->
    <!-- Because this Realm is here, an instance will be shared globally -->
    <Realm className="org.apache.catalina.realm.UserDatabaseRealm"
    debug="0" resourceName="UserDatabase"/>

    <!-- Define the default virtual host -->
    <Host name="localhost" debug="0" appBase="webapps"
    unpackWARs="true" autoDeploy="true">

    <!-- Defines a cluster for this node,
    By defining this element, means that every manager will be changed.
    So when running a cluster, only make sure that you have webapps in there
    that need to be clustered and remove the other ones.
    A cluster has the following parameters:

    className = the fully qualified name of the cluster class

    clusterName = a descriptive name for your cluster, can be anything

    mcastAddr = the multicast address, has to be the same for all the nodes

    mcastPort = the multicast port, has to be the same for all the nodes

    mcastBindAddress = bind the multicast socket to a specific address

    mcastTTL = the multicast TTL if you want to limit your broadcast

    mcastSoTimeout = the multicast readtimeout

    mcastFrequency = the number of milliseconds in between sending a "I'm alive" heartbeat

    mcastDropTime = the number a milliseconds before a node is considered "dead" if no heartbeat is received

    tcpThreadCount = the number of threads to handle incoming replication requests, optimal would be the same amount of threads as nodes

    tcpListenAddress = the listen address (bind address) for TCP cluster request on this host,
    in case of multiple ethernet cards.
    auto means that address becomes
    InetAddress.getLocalHost().getHostAddress()

    tcpListenPort = the tcp listen port

    tcpSelectorTimeout = the timeout (ms) for the Selector.select() method in case the OS
    has a wakup bug in java.nio. Set to 0 for no timeout

    printToScreen = true means that managers will also print to std.out

    expireSessionsOnShutdown = true means that

    useDirtyFlag = true means that we only replicate a session after setAttribute,removeAttribute has been called.
    false means to replicate the session after each request.
    false means that replication would work for the following piece of code: (only for SimpleTcpReplicationManager)
    <%
    HashMap map = (HashMap)session.getAttribute("map");
    map.put("key","value");
    %>
    replicationMode = can be either 'pooled', 'synchronous' or 'asynchronous'.
    * Pooled means that the replication happens using several sockets in a synchronous way. Ie, the data gets replicated, then the request return. This is the same as the 'synchronous' setting except it uses a pool of sockets, hence it is multithreaded. This is the fastest and safest configuration. To use this, also increase the nr of tcp threads that you have dealing with replication.
    * Synchronous means that the thread that executes the request, is also the
    thread the replicates the data to the other nodes, and will not return until all
    nodes have received the information.
    * Asynchronous means that there is a specific 'sender' thread for each cluster node,
    so the request thread will queue the replication request into a "smart" queue,
    and then return to the client.
    The "smart" queue is a queue where when a session is added to the queue, and the same session
    already exists in the queue from a previous request, that session will be replaced
    in the queue instead of replicating two requests. This almost never happens, unless there is a
    large network delay.
    -->
    <!--
    When configuring for clustering, you also add in a valve to catch all the requests
    coming in, at the end of the request, the session may or may not be replicated.
    A session is replicated if and only if all the conditions are met:
    1. useDirtyFlag is true or setAttribute or removeAttribute has been called AND
    2. a session exists (has been created)
    3. the request is not trapped by the "filter" attribute

    The filter attribute is to filter out requests that could not modify the session,
    hence we don't replicate the session after the end of this request.
    The filter is negative, ie, anything you put in the filter, you mean to filter out,
    ie, no replication will be done on requests that match one of the filters.
    The filter attribute is delimited by ;, so you can't escape out ; even if you wanted to.

    filter=".*\.gif;.*\.js;" means that we will not replicate the session after requests with the URI
    ending with .gif and .js are intercepted.

    The deployer element can be used to deploy apps cluster wide.
    Currently the deployment only deploys/undeploys to working members in the cluster
    so no WARs are copied upons startup of a broken node.
    The deployer watches a directory (watchDir) for WAR files when watchEnabled="true"
    When a new war file is added the war gets deployed to the local instance,
    and then deployed to the other instances in the cluster.
    When a war file is deleted from the watchDir the war is undeployed locally
    and cluster wide
    -->


    <Cluster className="org.apache.catalina.cluster.tcp.SimpleTcpCluster"
    managerClassName="org.apache.catalina.cluster.session.DeltaManager"
    expireSessionsOnShutdown="false"
    useDirtyFlag="true"
    notifyListenersOnReplication="true">

    <Membership
    className="org.apache.catalina.cluster.mcast.McastService"
    mcastAddr="228.0.0.4"
    mcastPort="45564"
    mcastFrequency="500"
    mcastDropTime="3000"/>

    <Receiver
    className="org.apache.catalina.cluster.tcp.ReplicationListener"
    tcpListenAddress="auto"
    tcpListenPort="4001"
    tcpSelectorTimeout="100"
    tcpThreadCount="6"/>

    <Sender
    className="org.apache.catalina.cluster.tcp.ReplicationTransmitter"
    replicationMode="pooled"
    autoConnect="true"
    maxPoolSocketLimit="10"
    keepAliveTimeout="-1"
    keepAliveMaxRequestCount="10000"
    waitForAck="true"/>

    <Valve className="org.apache.catalina.cluster.tcp.ReplicationValve"
    filter=".*\.gif;.*\.js;.*\.jpg;.*\.png;.*\.htm;.*\.html;.*\.css;.*\.txt;"
    primaryIndicator="true"/>


    <Valve className="org.apache.catalina.cluster.session.JvmRouteBinderValve" enabled="true" sessionIdAttribute="takeoverSessionid"/>

    <ClusterListener className="org.apache.catalina.cluster.session.ClusterSessionListener"/>
    <ClusterListener className="org.apache.catalina.cluster.session.JvmRouteSessionIDBinderListener" />

    <Deployer className="org.apache.catalina.cluster.deploy.FarmWarDeployer"
    tempDir="/tmp/war-temp/"
    deployDir="/tmp/war-deploy/"
    watchDir="/tmp/war-listen/"
    watchEnabled="false"/>



    </Cluster>




    <!-- Normally, users must authenticate themselves to each web app
    individually. Uncomment the following entry if you would like
    a user to be authenticated the first time they encounter a
    resource protected by a security constraint, and then have that
    user identity maintained across *all* web applications contained
    in this virtual host. -->
    <!--
    <Valve className="org.apache.catalina.authenticator.SingleSignOn" />
    -->

    <!-- Access log processes all requests for this virtual host. By
    default, log files are created in the "logs" directory relative to
    $CATALINA_HOME. If you wish, you can specify a different
    directory with the "directory" attribute. Specify either a relative
    (to $CATALINA_HOME) or absolute path to the desired directory.
    -->
    <!--
    <Valve className="org.apache.catalina.valves.AccessLogValve"
    directory="logs" prefix="localhost_access_log." suffix=".txt"
    pattern="common" resolveHosts="false"/>
    -->

    <!-- Access log processes all requests for this virtual host. By
    default, log files are created in the "logs" directory relative to
    $CATALINA_HOME. If you wish, you can specify a different
    directory with the "directory" attribute. Specify either a relative
    (to $CATALINA_HOME) or absolute path to the desired directory.
    This access log implementation is optimized for maximum performance,
    but is hardcoded to support only the "common" and "combined" patterns.
    -->
    <!--
    <Valve className="org.apache.catalina.valves.FastCommonAccessLogValve"
    directory="logs" prefix="localhost_access_log." suffix=".txt"
    pattern="common" resolveHosts="false"/>
    -->

    <!-- Logger shared by all Contexts related to this virtual host.
    <Logger className="org.apache.catalina.logger.FileLogger"
    directory="logs" prefix="localhost_" suffix=".log"
    timestamp="true"/>
    -->

    </Host>

    </Engine>

    </Service>


    </Server>
  • 4 Tomcat Servers
    2005-04-24 18:36:28  srinip [View]

    Hi,

    Since the cluster setup used in this article uses 3 TC nodes in the cluster and another TC for load balancing the web requests, you will need a total of 4 Tomcat instances running on a single machine. Or you can only run 2 nodes in the cluster and install 3 TC instances to get the clustering up and running.

    -Srini
    • 4 Tomcat Servers
      2005-05-12 13:27:42  vqt [View]

      I have able to setup the load balancer and the three nodes to run on a single server per you article. Your article also alludes that it is possible to setup the node to run on different servers.

      I was wondering what changes would I need to make in order to set up tomcat nodes to run on different machines and be able to communicate with the load balancer. It sounded like you would need to make a configuration changes to set this up.

      I appreciate any suggestions you have on this...

      Thanks!