Dev 1.x

    Replication

    Propel can be used in a master-slave replication environment. These environments are set up to improve the performance of web applications by dispatching the database-load to multiple database-servers. While a single master database is responsible for all write-queries, multiple slave-databases handle the read-queries. The slaves are synchronised with the master by a fast binary log (depending on the database).

    Configuring Propel for Replication

    • Set up a replication environment (see the Databases section below)
    • Use the latest Propel-Version from Github
    • add a slaves-section to propel.database.connections property of your configuration file
    • verify the correct setup by checking the masters log file (should not contain “select …” statements)

    The slaves section is included in a master connection and contains multiple nested dsn. It is recommended that they are numbered. The following example shows a slaves section with several configured slave connections where “localhost” is the master and “slave-server1” and “slave-server2” are the slave-database connections.

    propel:

  database:
      connections:
          bookstore:
              adapter: mysql
              classname: Propel\Runtime\Connection\ConnectionWrapper
              dsn: mysql:host=localhost;dbname=bookstore
              user: my_db_user
              password: s3cr3t
              slaves:
                  - dsn: mysql:host=slave-server1;dbname=bookstore
                  - dsn: mysql:host=slave-server2;dbname=bookstore

  runtime:
      defaultConnection: bookstore
      connections:
          - bookstore

  generator:
      defaultConnection: bookstore
      connections:
          - bookstore
    <?php

return [
    'propel' => [
        'database' => [
            'connections' => [
                'bookstore' => [
                    'adapter'    => 'mysql',
                    'classname'  => 'Propel\Runtime\Connection\ConnectionWrapper',
                    'dsn'        => 'mysql:host=localhost;dbname=bookstore',
                    'user'       => 'my_db_user',
                    'password'   => 's3cr3t',
                    'slaves' => [
                        ['dsn' => 'mysql:host=slave-server1;dbname=bookstore'],
                        ['dsn' => 'mysql:host=slave-server2;dbname=bookstore']
                    ]
                ]
            ]
        ],
        'runtime' => [
            'defaultConnection' => 'bookstore',
            'connections' => ['bookstore']
        ],
        'generator' => [
            'defaultConnection' => 'bookstore',
            'connections' => ['bookstore']
        ]
    ]
];
    {
    "propel": {
        "database": {
            "connections": {
                "bookstore": {
                    "adapter": "mysql",
                    "classname": "Propel\Runtime\Connection\ConnectionWrapper",
                    "dsn": "mysql:host=localhost;dbname=bookstore",
                    "user": "my_db_user",
                    "password": "s3cr3t",
                    "slaves": [
                        {"dsn": "mysql:host=slave-server1;dbname=bookstore"},
                        {"dsn": "mysql:host=slave-server2;dbname=bookstore"}
                    ]
                }
            }
        },
        "runtime": {
            "defaultConnection": "bookstore",
            "connections": ["bookstore"]
        },
        "generator": {
            "defaultConnection": "bookstore",
            "connections": ["bookstore"]
        }
    }
}
    [propel]
;
; Database section
;
database.connections.bookstore.adapter    = mysql
database.connections.bookstore.classname  = Propel\Runtime\Connection\ConnectionWrapper
database.connections.bookstore.dsn        = mysql:host=localhost;dbname=bookstore
database.connections.bookstore.user       = my_db_user
database.connections.bookstore.password   = s3cr3t
database.connections.bookstore.slaves[0][dsn] = mysql:host=slave-server1;dbname=bookstore
database.connections.bookstore.slaves[1][dsn] = mysql:host=slave-server2;dbname=bookstore

;
; Runtime section
;
runtime.defaultConnection = bookstore
runtime.connections[0]    = bookstore

;
; Generator section
;
generator.defaultConnection = bookstore
generator.connections[0] = bookstore
    <?xml version="1.0" encoding="ISO-8859-1" standalone="no"?>
<config>
    <propel>
        <database>
            <connections>
                <connection id="bookstore">
                    <adapter>mysql</adapter>
                    <classname>Propel\Runtime\Connection\ConnectionWrapper</classname>
                    <dsn>mysql:host=localhost;dbname=bookstore</dsn>
                    <user>my_db_user</user>
                    <password>s3cr3t</password>
                    <slave>
                        <dsn>mysql:host=slave-server1;dbname=bookstore</dsn>
                    </slave>
                    <slave>
                        <dsn>mysql:host=slave-server2;dbname=bookstore</dsn>
                    </slave>
                </connection>
            </connections>
        </database>
        <runtime>
            <defaultConnection>bookstore</defaultConnection>
            <connection>bookstore</connection>
        </runtime>
        <generator>
            <defaultConnection>bookstore</defaultConnection>
            <connection>bookstore</connection>
        </generator>
    </propel>
</config>

    Implementation

    The replication functionality is implemented in the Propel connection configuration and initialization code and in the generated TableMap and Object classes.

    Propel::getReadConnection() and Propel::getWriteConnection()

    When you request a connection with Propel, you can either specify that you want a READ connection (slave) or a WRITE connection (master). Methods that are designed to perform READ operations, like ModelCriteria::find(), will always request a READ connection like so:

    <?php
$con = Propel::getReadConnection(MyTableMap::DATABASE_NAME);
$books = BookQuery::create()->find($con);

    Other methods that are designed to perform write operations, like ModelCriteria::update() or ModelCriteria::delete(); will explicitly request a WRITE connection:

    <?php
$con = Propel::getWriteConnection(MyTableMap::DATABASE_NAME);
BookQuery::create()->deleteAll($con);

    If you do have configured slave connections, Propel will choose a single random slave to use per request for any connections where the mode is READ.

    Both READ (slave) and WRITE (master) connections are only configured on demand. If all of your SQL statements are SELECT queries, Propel will never create a connection to the master database (unless, of course, you have configured Propel to always use the master connection – see below).

    Warning: If you are using Propel to execute custom SQL queries in your application (and you want to make sure that Propel respects your replication setup), you will need to explicitly get the correct connection. For example:

    <?php
$con = Propel::getReadConnection(MyTableMap::DATABASE_NAME);
$stmt = $con->query('SELECT * FROM my');
/* ... */

    ConnectionManager::setForceMasterConnection()

    You can force Propel to always return a WRITE (master) connection when calling Propel::getServiceContainer()->getReadConnection(), even though there are some slaves connections defined.

    To do so, call the setForceMasterConnection() method on the related ConnectionManager, as follows:

    <?php
$manager = Propel::getServiceContainer()->getConnectionManager(MyTableMap::DATABASE_NAME);
$manager->setForceMasterConnection(true);
$con = Propel::getReadConnection(MyTableMap::DATABASE_NAME);
// $con is a WRITE connection

    This can be useful if you must be sure that you are getting the most up-to-date data (i.e. if there is some latency possible between master and slaves). But remember that the only safe way to get data integrity is to use transactions.

    Databases

    MySql

    http://dev.mysql.com/doc/refman/5.0/en/replication-howto.html

    References

    • Henderson Carl (2006): Building Scalable Web Sites. The Flickr Way. O’Reilly. ISBN-596-10235-6.
    ↟ Jump To Top