Release 9.

Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Publication Date: March 29, 2010 Worldwide Headquarters Blackboard Inc.

650 Massachusetts Avenue NW Sixth Floor Washington, DC 20001-3796 +1 800 424 9299 toll free US & Canada +1 202 463 4860 telephone +1 202 463 4863 facsimile www.blackboard.com +31 20 5206884 (NL) telephone +31 20 5206885 (NL) facsimile www.blackboard.com

International Headquarters Blackboard International B.V.

Dam 27 2nd Floor 1012 JS Amsterdam The Netherlands

Copyright 1997-2010. Blackboard, the Blackboard logo, BbWorld, Blackboard Learn, Blackboard Transact, Blackboard Connect, the Blackboard Outcomes System, Behind the Blackboard, and Connect-ED are trademarks or registered trademarks of Blackboard Inc. or its subsidiaries in the United States and other countries. U.S. Patent Numbers: 6,988,138; 7,493,396; 6,816,878. Dell and PowerEdge are trademarks of Dell Inc. Java is a registered trademark of Sun Microsystems, Inc. in the United States and other countries. Microsoft, Windows, and SQL Server are registered trademarks of Microsoft Corporation in the United States and other countries. Oracle is a registered trademark of Oracle Corporation and its affiliates. UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company Ltd. Other product and company names mentioned herein may be the trademarks of their respective owners. No part of the contents of this manual may be reproduced or transmitted in any form or by any means without the written permission of the publisher, Blackboard Inc.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 2

Contents
Introduction .................................................................................................................................... 4 About Blackboard Learn............................................................................................................ 4 About this Guide ........................................................................................................................ 4 Recommended Configurations .................................................................................................... 5 Deploying Blackboard Learn ........................................................................................................ 6 Virtualization at the Application Layer ........................................................................................ 7 Sizing the Application Server ....................................................................................................... 8 Dell Configuration Information .................................................................................................. 8 Will Hyper-Threading Make a Difference? ................................................................................ 8 Will Tomcat Clustering Make a Difference? .............................................................................. 9 Sizing by CPU and Memory ...................................................................................................... 9 Bare-Metal or Virtual Configurations ....................................................................................... 10 Preparing for the Westmere EP-Processor and R910 Nehalem ............................................ 10 Dell Configurations for Blackboard Learn Release 9.1 ........................................................... 11 Sizing the Database ..................................................................................................................... 13 Sizing Storage .............................................................................................................................. 14 Media and Content Storage .................................................................................................... 14 Database Data File Storage .................................................................................................... 14 Storage Performance .............................................................................................................. 15 Appendix A: Sizing Methodology .............................................................................................. 16

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 3

Introduction

Introduction
A paradigm shift is underway in online learning. Online learning tools that were once used primarily to augment classroom learning have matured to support an online model in which the Course Management System serves as the primary medium for teaching and learning. As the prevalence of high-speed Internet connections and home computer ownership has grown, so too has the demand for distance learning. Today's learners are turning to web-based distance learning programs as a means to balance other obligations with the desire to further their education, or because they are too far away from the institutions that can best serve their needs. The movement toward fully online learning models creates new demands for the IT environment and opens up new opportunities for institutions to use technology as a competitive tool. Demand for higher performance and faster response times are being driven by two key factors: greater numbers of users, and increased activity by users. Not only are institutions growing and supporting greater numbers of online users, but users are also interacting with the system in new ways that generate substantially greater system load. Users tend to stay online for much longer periods of time and have greater interactivity with their online courses. The technology must therefore support large numbers of users who concurrently access the system and require rapid response times so that they can interact without noticeable delays. When users have consistent and responsive page load times, online learning is easier and more effective, new forms of teaching and learning can also evolve when interaction has the feeling of being real-time. Traditional online lectures and online documents can be blended with interactive media, allowing students to share experiences with each other across geographical boundaries. This can increase the effectiveness of the learning environment and expand the available market the institution serves. Institutions want their online learning technology infrastructure to support these new forms of teaching and learning on a scale that allows many more students than could traditionally participate in a classroom approach. The online learning architecture must therefore be highly scalable as well as cost-effective to maintain so that institutions can focus on teaching instead of technology. The right technology infrastructure for online learning can create a competitive advantage for the institution.

About Blackboard Learn

Blackboard Learn includes Blackboards course management system, Course Delivery, as well as other core applications. Additional capabilities that can be licensed include community engagement, content management, and outcomes assessment.

About this Guide

This guide helps Blackboard clients achieve high service levels and reduce risk by properly configuring and sizing the implementation of Blackboard Learn software on Dell application and database servers. The information in this guide is based on a paper written jointly by the Blackboard Performance Team and Dell: From Vision to RealityOnline Learning in a Completely Digital World. For information about Blackboards sizing methodology, see Appendix A: Sizing Methodology. This guide is intended to provide guidance. It is not intended as a service level agreement. Deployments will differ from institution to institution based on a variety of factors including the usage of the application. For more information about systems architecture design and detailed sizing questions, contact your Blackboard Account Manager.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 4

Recommended Configurations

Recommended Configurations
Blackboards recommended configuration is based on a scalable reference architecture that takes advantage of todays latest technologies to support a rich online learning or distance learning model. In addition, this architecture offers superior performance and scalability as well as predictable service levels. This information is based on joint performance testing and benchmarking between Blackboard and Dell to achieve maximum performance throughput for each configuration.

Blackboard Learn Reference Architecture on Dell Hardware

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 5

Deploying Blackboard Learn

Deploying Blackboard Learn

The Dell server platform architecture supports Linux and Windows deployments on Intel and AMD processor lines. Performance testing and sizing for Blackboard Learn Release 9.1 focused on Intels Nehalem processor series (5500-series). Both Rack mount and highly dense blade servers are available. Blackboard Learn has been benchmarked on a variety of Dell systems. Evaluations are made against both rack mount and highly dense blade servers. These configurations have been evaluated in a non-virtualized configuration, often referred to as bare-metal. Additionally, benchmarking has been conducted with up to three virtualization hypervisors: VMware ESX Server 4 (Linux and Windows) Citrix XenServer 5.5 Red Hat Enterprise Linux 4 & 5 Xen

Most often these systems contain 2-4 sockets, each with 2, 4, and 6 cores per socket and 8GB to 96GB of memory. Throughput performance increases depending on which CPU model is chosen. At the time of this publishing, the Quad Core Intel Xeon 5520 2.26GHz processor with the Hyper-Threading option turned on offers the best overall price performance. The Quad Core Intel Xeon 55700, 8MB Cache, 2.93GHz processor offers the best throughput performance. Blackboard recommends leveraging both physical and virtual configurations. For years, the Blackboard products have been deployed in distributed manner across multiple physical servers. This configuration remains as the primary option for availability and scalability. In recent releases, many Blackboard customers have introduced virtualized configurations within a physical server using technology such as VMWare, Citrix XenServer, and Red Hat Xen. The combination of both physical and virtualized configurations has introduced resiliency, scalability, and high performance. In Blackboard Learn Release 9.1, Blackboard introduced a 100% 64-bit offering for all certified and supported operating systems (OSs) as an additional deployment approach to integrate with physical and virtual configurations.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 6

Virtualization at the Application Layer

Virtualization at the Application Layer

Since Release 8, Blackboards Performance Engineering team has executed more than 4,000 hours of regression testing and benchmarking of Blackboard Learn using virtualization technologies such as VMware ESX, Citrix XenServer, and Red Hat Xen. The Performance Engineering team has written two papers with Dell promoting deployments in a virtual manner: Optimizing Blackboard Academic Suite on Dell Servers and Storage From Vision to RealityOnline Learning in a Completely Digital World

Many customers have made virtualization part of their deployment approach. Virtualization enables multiple instances of Guest OS to be deployed on each physical server. Server processor, memory, storage, and networking resources are shared across multiple virtual machines, yet each virtual machine (VM) and OS instance can have direct control over specific system resources. Blackboard Learn can then be installed and operated on each VM in much the same way as running each instance on a separate physical server. Following are the two key reasons exist for implementing virtualization in the application tier: Modern CPUs such as the Intel 5500 series processors are so powerful that a single instance of the OS and its application software components typically cannot fully utilize the CPU. It is more cost-effective to add additional memory to a server and divide the server resources into multiple virtual machines than it is to buy more servers. Virtualization greatly simplifies provisioning and management of the Blackboard Learn environment.

Most of the virtualization packages deployed in Blackboard production environments include software tools to enable administrators to quickly and easily clone an image of a VM, including the OS and all application instances. This cloned VM image can then be quickly provisioned to a new VM when, for example, greater capacity is needed. Cloning also helps to ensure that all instances of the application are deployed in identical configurations, greatly simplifying ongoing maintenance of the environment.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 7

Sizing the Application Server

Sizing the Application Server

Dell Configuration Information
Application tier scalability is achieved using a highly flexible, horizontally scaled infrastructure. Multiple instances of Blackboard Learn can be deployed on a single Dell server using either a virtualization package or bare-metal configuration to isolate Blackboard application instances from each other and to manage allocation of CPU and memory resources. Each Dell server in the application tier can run multiple VMs, each with its own instance of the Blackboard Learn software. To achieve a high volume of concurrent user sessions, the architecture employs load balancing to distribute requests across all of the Blackboard Learn instances deployed on the virtualized servers. The architecture takes advantage of 64-bit computing by using Java heap sizes that range from 2G to 16GB for each Blackboard application instance. Some customers on rare occasions have deployed Java Virtual Machines (JVMs) as large as 32GB in size. The Java heap had been limited to 1.7GB in a 32-bit environment, but this limitation is overcome in the 64-bit environment. Because this feature is now available for all platforms with Blackboard Learn Release 9.1, Blackboard strongly recommends that customers adopt 64-bit for their primary deployment OSs. The architecture includes a recommended 8GB of memory for each VM, leaving up to 2GB for the Apache Web server, and up to 2GB for the OS and monitoring tools. This assumes a JVM heap size of 4GB. Obviously, a larger JVM heap size will require additional memory for the VM. The larger memory footprint for Blackboard Learn enables each application instance to more efficiently service a high volume of user requests. In other words, each application instance can scale vertically while the architecture can also be scaled horizontally by deploying additional VMs. This best of both worlds approach takes advantage of many application threads in the application tier to service thousands of requests per minute. The recommended servers for the application tier are Dell PowerEdge R710 servers, which were chosen for their small footprint, low cost, and powerful performance with Intel 5500 series processors. The application tier could also be built using other Dell servers such as Dell PowerEdge R610 rack mountable servers or Dell PowerEdge M610 or M710 blade servers, all of which feature the latest Intel 5500 series processors. The highly flexible and scalable application tier can help customers achieve the following: Lower costs: Increased utilization of servers enables good performance on a low-cost, consolidated infrastructure. Increased flexibility: VMs can be moved easily to other physical servers to redistribute workloads or recover quickly from a hardware failure. Faster Deployment: With fewer physical systems to setup and configure, less time is required for deployment.

Will Hyper-Threading Make a Difference?

Hyper-threading has been a feature-set in the Intel processor architecture for about a decade. In previous processor models, hyper-threading had limited advantages for performance improvements. With the 5500-series processor, the hyper-threading option yielded acceptable performance improvements when moving from 8 CPU threads (2 sockets x 4 cores) to 16 CPU threads (2 sockets x 4 cores x 2 logical hyper-threads). Hyper-threading is a viable, performance configuration worthy of running in a production environment.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 8

Sizing the Application Server

Will Tomcat Clustering Make a Difference?

Customers should begin migrating from Tomcat clusters. Tomcat clustering was introduced for scalability purposes when the Blackboard Learn architecture was 32-bit and customers wanted the ability to increase their memory usage on a single server. With the option to virtualize on both 32-bit and 64-bit, Blackboards benchmarking efforts have moved away from Tomcat cluster deployments. Customers can achieve similar performance in a virtual environment on the same physical server with multiple virtual instances as with a bare metal configuration with many Tomcat cluster instances. The difference in configurations is a smaller demand on the Apache or IIS web server fronting the Tomcat instance(s). The option to deploy a 64-bit JVM with larger heap sizes has suppressed the need for customers to run in a cluster option. Blackboard recommends that customers consider a deployment approach consisting of larger 64-bit JVMs that are distributed across physical servers with the option to virtualize the hardware to take advantage of the CPU and Memory capacity of these systems.

Sizing by CPU and Memory

The configuration table in this section includes options to size based on 2 CPU threads versus 4 CPU threads as well as an option to size based on a 32-bit OS versus 64-bit OS. As noted above, Blackboard recommends deploying Blackboard Learn in a 64-bit configuration. Choosing the CPU capacity should be a decision based on two inputs: CPU Utilization: A metric based on an average utilization of the CPUs between two points in time Run Queue: Responsible for queuing CPU operations while waiting for the CPU to process a request

CPU utilization is a topic argued by many as to what percentage value is optimal for a production system. The goal should be to use as much of the CPU available. So, an obvious goal is to identify a workload that will fully utilize the CPU, but not at the expense of having a high run queue. For every request that is stuck in the run queue, latency will be added until the CPU can service the request. CPU utilization of 100% is only one factor that will force a request into a wait state. A 2 CPU thread deployment is acceptable for a 32-bit deployment and would be the minimum configuration requirement for a 2GB JVM in a 64-bit address space. Customers seeking larger JVMs in the range of 4GB to 16GB should consider a 4 CPU thread deployment approach because of better throughput processing of Java garbage collection in parallel. Response times will improve with a larger heap and more available CPU threads for processing. Allocations of more than 4 CPUs did not yield major performance improvements and, therefore, are not recommended. Customers should be aware of their run queue for capacity management. A run queue equal or slightly above the CPU count is acceptable at normal times and during peak. When the run queue is double or even greater the CPU count, customers should strongly consider allocating more CPUs to the configuration or increasing the number of instances of the application. Special care and attention should be applied to the database when making the decision to introduce additional application servers. Impact can be seen on the memory footprint of the database, as well as the load average of the system because of the need for more remote connections and processes.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 9

Sizing the Application Server

Allocations of memory should be based on need and rate of collection. The application is 100% Java-based and thus has a greater demand for memory within the JVM than in previous versions of the application. A 32-bit 1.7GB JVM simply will not satisfy the performance demands of the user community as it was capable of doing in past releases with a hybrid technology stack that included PERL. Therefore, customers deploying with a 32-bit configuration will require greater amounts of equipment to support faster responsiveness and larger concurrency. A 64-bit JVM sized between 4GB and 16GB will provide serviceable response times with less latency. Memory tends to be the primary resource constraint. As a result, Blackboard recommends using a larger JVM with the performance options defined in the Release Notes for a given release.

Bare-Metal or Virtual Configurations

The sizing table in this section makes no assumptions about whether a deployment is virtual or bare-metal. The term bare-metal implies a single operating system installed on a single physical server. Clients have the option to deploy their environments in either a virtual or bare-metal configuration. The CPU and Memory capacity of the recommended Dell systems is ideal for virtualized deployments. Customers will be able to save substantially year after year by choosing to deploy in a virtualized manner. In the paper From Vision to RealityOnline Learning in a Completely Digital World, Blackboard deployed up to four installations of Blackboard Learn on a single R710 server. Each VM was configured to provide four virtual CPUs to each installation, as well as 8GB of memory to the guest OS. The Blackboard Learn JVM was configured for 64-bit addressable memory and a 4GB maximum heap size. The consolidation of four VMs to one physical server loaded with 48 GB of memory instead of purchasing four physical servers with 8GB to 12GB of memory can result in a more than 300% cost savings. The cost of memory justifies the overall savings of purchasing fewer, under-sized systems.

Preparing for the Westmere EP-Processor and R910 Nehalem

At the time this document was published, Dell had yet to release the 5600-series (Westmere EP-Processor) for the R610, R710, M610 and M710 systems. In addition, the R910 Nehalem, which leverages an 8-core processor (Intel Xeon X7560), was not ready for production. Changes will be made to this guide to reflect the new processors and models recommended for sizing purposes. The following changes will be made after these new CPUs and models become available: Current Recommendation: Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) Future Recommendation: Intel Xeon E5620 series (2.40GHz, 12M cache, Turbo, HT, 1066MHz Max Memory) Current Recommendation: Intel Xeon X5550 (2.66Ghz, 8M Cache, Turbo, HT, 1333MHz Max Memory) Future Recommendation: Intel Xeon X5650 (2.66GHz, 12M cache, Turbo HT, 1333MHz Max Memory) 6-core Current Recommendation: Intel Xeon X7460 (2.67GHz, 16M Cache, 1066Mhz FSB) Future Recommendation: Intel Xeon X7560 (2.26GHz), 24M Cache, 1066Mhz FSB) 8-core

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 10

Dell Configurations for Blackboard Learn Release 9.1

Sizing Category Description Standard The Standard sizing configuration is designed for availability and performance. Options exist for both physical distributions of application servers and/or virtualized instances of the application. The institution has minimal deployment of distance learning or connected classroom initiatives (less than 5%). Advanced The Advanced sizing configuration is designed for high-availability and high-performance. The model is designed for heavy adoption of the product across institutions of varying sizes. Customers deploying distance learning programs or with connected classroom initiatives to a portion of the community fall into this category. Complex The Complex sizing configuration is designed for massive adoption, high-availability, and highperformance. Customers deploying predominately distance learning programs or with connected classroom initiatives fall into this category. Customers with larger community sizes (greater than 250,000 users) fall into this category.

Ap p l i c a t i o n S e r v e r C o n f i g u r a t i o n Number of OS Instances (Physical or Virtual) Minimum CPU Configuration Per OS Instance 2 CPU Virtualization Collapse Ratio (VMs to Physical Server) Ideal CPU Configuration Per OS Instance 4 CPU Virtualization Collapse Ratio (VMs to Physical Server) 32-bit Memory Requirements Per OS Instance 64-bit Memory Requirements Per OS Instance I/O Workload at Peak Hour Hits/Hour at Peak Hour Characteristics 2 to 4 2 CPU Threads Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) 4:1 with Hyper-Threading OFF 4 CPU Threads Intel Xeon X5550 (2.66Ghz, 8M Cache, Turbo, HT, 1333MHz Max Memory) 2:1 with Hyper-Threading OFF -or4:1 with Hyper-Threading ON 4GB to 8GB 8GB to 16GB recommended 300 to 500 I/Os Up to 4 Million Hits/Hour With 4 CPU threads per instance and a 64-bit deployment across 4 instances, this configuration will support as many as 20,000 concurrent sessions for a peak hour. A concurrent session is a user who has logged into the application within the last hour. With 2 CPU threads per instance and a 32-bit deployment across 4 instances, this configuration will support approximately 2,000 concurrent sessions. Results will vary depending on the use of memory intensive areas of the application, such as Assessment and Grade Center. Memory has the greatest impact on the session concurrency and responsiveness of the application, followed by CPU capacity. Consider a larger memory footprint for even smaller workloads to deliver faster page responsiveness. Blackboard Learn Hardware Sizing Guide for Dell Deployments
2010 Blackboard Inc. Proprietary and Confidential

4 to 8 2 CPU Threads Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) 4:1 with Hyper-Threading OFF 4 CPU Threads Intel Xeon X5550 (2.66Ghz, 8M Cache, Turbo, HT, 1333MHz Max Memory) 2:1 with Hyper-Threading OFF -or4:1 with Hyper-Threading ON 4GB to 8GB 8GB to 16GB recommended 500 to 1000 I/Os Up to 8 Million Hits/Hour With 4 CPU threads per instance and a 64-bit deployment across 4 instances, this configuration will support as many as 40,000 concurrent sessions for a peak hour. A concurrent session is a user who has logged into the application within the last hour. With 2 CPU threads per instance and a 32-bit deployment across 4 instances, this configuration will support approximately 4,000 concurrent sessions. Results will vary depending on the use of memory intensive areas of the application, such as Assessment and Grade Center. Memory has the greatest impact on the session concurrency and responsiveness of the application, followed by CPU capacity. Consider a larger memory footprint for even smaller workloads to deliver faster page responsiveness.

8 to 16 2 CPU Threads Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) 4:1 with Hyper-Threading OFF 4 CPU Threads Intel Xeon X5550 (2.66Ghz, 8M Cache, Turbo, HT, 1333MHz Max Memory) 2:1 with Hyper-Threading OFF -or4:1 with Hyper-Threading ON 4GB to 8GB 8GB to 16GB recommended 1000 to 2000 I/Os Up to 12 Million Hits/Hour With 4 CPU threads per instance and a 64-bit deployment across 4 instances, this configuration will support as many as 80,000 concurrent sessions for a peak hour. A concurrent session is a user who has logged into the application within the last hour. With 2 CPU threads per instance and a 32-bit deployment across 4 instances, this configuration will support approximately 8,000 concurrent sessions. Results will vary depending on the use of memory intensive areas of the application such as Assessment and Grade Center. Memory has the greatest impact on the session concurrency and responsiveness of the application, followed by CPU capacity. Consider a larger memory footprint for even smaller workloads to deliver faster page responsiveness. Page 11

Dell Configurations for Blackboard Learn Release 9.1

Sizing Category Description Standard The Standard sizing configuration is designed for availability and performance. Options exist for both physical distributions of application servers and/or virtualized instances of the application. The institution has minimal deployment of distance learning or connected classroom initiatives (less than 5%). Advanced The Advanced sizing configuration is designed for high-availability and high-performance. The model is designed for heavy adoption of the product across institutions of varying sizes. Customers deploying distance learning programs or with connected classroom initiatives to a portion of the community fall into this category. Complex The Complex sizing configuration is designed for massive adoption, high-availability, and highperformance. Customers deploying predominately distance learning programs or with connected classroom initiatives fall into this category. Customers with larger community sizes (greater than 250,000 users) fall into this category.

Database Server Configuration Minimum CPU Configuration 4 to 8 CPU Threads Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) Ideal CPU Configuration 8 CPU Threads Intel Xeon X5570 (2.93Ghz, 8M Cache, Turbo, HT, 1333MHz Max Memory) Memory Requirements I/O Workload at Peak Hour Availability Approach 8GB to 16GB 600 to 1,200 I/Os Failover clustering approaches that leverage Active/Passive database configurations should be considered for this deployment. 8 to 16 CPU Threads Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) 16 CPU Threads Intel Xeon X5570 (2.93Ghz , 8M Cache, Turbo, HT, 1333MHz Max Memory) 16GB to 48GB 1,500 to 3,000 I/Os Failover clustering approaches that leverage Active/Passive database configurations should be considered for this deployment. Linux deployments may consider Oracle Real Application Clusters (Oracle RAC). 16 to 24 CPU Threads Intel Xeon 5520 series (2.26Ghz, 8M Cache, Turbo, HT, 1066MHz Max Memory) 24+ CPU Threads Intel Xeon X7460 (2.67GHz, 16M Cache, 1066Mhz FSB) 48GB to 96GB 4,500 to 10,000 I/Os Failover clustering approaches that leverage Active/Passive database configurations should be considered for this deployment. Linux deployments should consider Oracle Real Application Clusters (Oracle RAC).

Oracle Memory Requirements Estimated SGA Size Processes Estimated Process Size Estimated PGA Memory 1GB to 4GB 600 to 1,200 3M to 7M 2GB to 8GB 4GB to 16GB 2,000 to 4,000 3M to 7M 10GB to 20GB 16GB to 32GB 5,000 to 10,000 3M to 7M 25GB to 50GB

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 12

Sizing the Database

Sizing the Database

The Dell M610, R610, and R710 are ideal for running Microsoft SQL Server 2005 or 2008 and Oracle 10gR2 or 11gR1 in standard and advanced sizing configurations. Blackboard recommends using the dual-socket, quad core configuration. These systems also offer a HyperThreading option, which have revealed in benchmarks to provide a performance advantage. Memory requirements will vary depending on deployment within a 32-bit or 64-bit configuration. All certified and supported configurations are available in both 32-bit and 64-bit address spaces. Each of these systems can be used for availability purposes in an Oracle RAC configuration or Microsoft SQL Server Active/Passive Failover Cluster. Blackboard offers support for RAC with all versions of Oracle supported by Blackboard. For information about running Blackboard Learn with RAC, see the Blackboard Learn Server Administrator Guide available on Behind the Blackboard. For more information about the SQL Server Failover capabilities of Blackboard Learn, contact Blackboard Consulting. For complex sizing configurations, Dell PowerEdge R710 and R900 servers are used to provide increased capacity. A high availability option is supported through an optional cluster configuration with a redundant instance of the database running on a second server using Oracle RAC or SQL Server Failover capabilities to provide the redundant database functionality. Sizing for memory is absolutely critical for ensuring a high-performing and reliable configuration. Oracle configurations require a set of inputs to calculate the SGA and PGA spaces of memory. The SGA will contain both the SQL area for caching statements as well as the buffer cache for storing blocks of data in memory. The PGA space will maintain the process memory requirements as well as hash and sorting space for query execution. The combination of these two regions makes up the requirements of Oracle memory. SQL Server will have similar memory requirements as Oracle. SQL Server memory is broken down into three regions: Buffer Pool Procedure Cache MemToLeave

These regions are transparent to DBAs to simplify application management purposes.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 13

Sizing Storage

Sizing Storage
Media and Content Storage
Blackboard Learn uses a non-relational file system for the storage of multi-media and binary files such as text files, images, word processing documents, spreadsheets, and other file types used in teaching and learning. Blackboard recommends that clients on UNIX platforms use a network file share (NFS). Blackboard recommends that clients on Windows use a common internet file system (CIFS). Both of these network-based file system protocols allow for simplified management, ease of data expansion, and multiple access points from applications servers. Load balanced installations can use both file system types. Deploying storage on a local application server can also be implemented, but Blackboard does not recommend doing so. File system content can range from 5100 times the size of the database content. File system content from a block perspective is touched less frequently than the database file system. Clients can opt to configure their systems to a lesser performing RAID configuration with slower spindles because I/O performance is less of a concern. Blackboard recommends that clients determine a storage quota per student and faculty member as well as account for passive users that require less storage quota. Assume that faculty will have greater storage requirements. Following is a simple example:
Profile Faculty Student Other Quota 5GB 500MB 20MB Users 500 10,000 1,000 Storage Needs 2.5 TB + RAID Considerations 5TB + RAID Considerations 20GB + RAID Considerations

Sizing the file system depends on archival strategies, data management policies, RAID configuration, and I/O performance standards. Blackboard typically assumes that the file system will require about 100+ I/O per second per application server at peak. To calculate your I/O per second needs, multiply this metric against the number of application servers in your deployment.

Database Data File Storage

Blackboard Learn uses a relational database system (Oracle and SQL Server) for the storage of database content. Clients on UNIX platforms may use one of the following: A network file share (NFS) ISCSI (networked block-level) Direct attached storage (block-level)

Clients on Windows SQL Server may use one of the following: ISCSI (networked block-level) Direct attached storage (block-level)

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 14

Sizing Storage

The database storage requirements of institutions can vary. Typically, database content can range from 5100 times less than file system content. Sizing the database depends on archival strategies, data management policies, RAID configuration, and, most importantly, I/O performance standards. Blackboard typically assumes that the file system will require between 350 to 600 I/O per second per application server at peak. To calculate your I/O per second needs, multiply this metric against the number of application servers in your deployment. The primary driver for database storage should be performance.

Storage Performance
The database tier has variable I/O performance needs, therefore, Blackboard recommends using fibre channel drives with 10,000 to 15,000 RPM capacity. To deliver adequate I/O throughput, Blackboard also recommends using smaller capacity drives so that there will be more spindles to reduce seek times and improve data transfer rates. The I/O performance requirements are not the same for the shared file system. Slower, condensed storage options using SATA or SAS disks in the range of 7,200 or 10,000 RPM are more than adequate. The configurations defined in this guide have been validated to support adequate I/O throughput for the user loads defined for each configuration. When sizing storage, be sure to do the following: 1. Determine how much storage your institution will need. 2. Determine how this storage can be spread across multiple trays and disks to optimize performance throughput. Remember that the shared file system can require upwards of 5100 times the amount of storage of the database. However, the database can use 520 times the number of I/O operations per second than the shared file system.
Description Content Storage Tier Standard UNIX: Network Attached Storage Architecture Windows: CIFS Architecture Up to 2.2 TB of usable storage 7.2k to 10k RPM SATA or SAS disks Database Storage Tier UNIX: Network Attached Storage Architecture, ISCSI, or FC-SAN Windows: ISCSI or FC-SAN Up to 500 GB of usable storage 10k to 15k RPM FC A d va n c e d UNIX: Network Attached Storage Architecture Windows: CIFS Architecture Up to 5 TB of usable storage 7.2k to 10k RPM SATA or SAS disks UNIX: Network Attached Storage Architecture, ISCSI, or FC-SAN Windows: ISCSI or FC-SAN Up to 1 TB of usable storage 10k to 15k RPM FC Complex UNIX: Network Attached Storage Architecture Windows: CIFS Architecture Up to 10 TB of usable storage 7.2k to 10k RPM SATA or SAS disks UNIX: Network Attached Storage Architecture, ISCSI, or FC-SAN Windows: ISCSI or FC-SAN Up to 2 TB of usable storage 10k to 15k RPM FC

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 15

Appendix A: Sizing Methodology

Appendix A: Sizing Methodology

Sizing is a three-step process consisting of two modeling exercises and performance testing. The modeling exercises are used to gather statistical evidence about how users interact with the system. The data generated from these exercises is subsequently used in a series of performance tests. Performance tests help quantify what the system will look like under hypothesized workloads and scenarios. The process begins with understanding how Blackboard clients have used the product in the past. This form of sampling is called behavior modeling. The objective of this form of sampling is to gather meaningful data representing the following: Who is using the system? What is being done? Where are they performing their operations? When are they performing their operations? How long are users spending performing their operations?

Predictive modeling is used for new performance testing new features. Little information can be collected about a feature that has not been built. Because of this, Blackboard hypothesizes user interactions with these new features. The data collected from both modeling exercises is then used for performance testing and benchmarking. Performance benchmarking is conducted by Blackboard with a selected partner of choice (such as Sun Microsystems, Dell, Microsoft, or Oracle) at the Blackboard Performance Laboratory using a combination of purchased and donated equipment from a partner. Performance testing and benchmark activities focus primarily on the performance (response times exhibited by users) and scalability of the system (utilization of system resources such as CPU, memory, and I/O). HP/Mercury LoadRunner is the simulation tool of choice for generating workload.

Blackboard Learn Hardware Sizing Guide for Dell Deployments

2010 Blackboard Inc. Proprietary and Confidential

Page 16