CA Asset Portfolio Management r126 Performance testing results summary - CA Technologies
{{search ? 'Close':'Search'}}

CA Asset Portfolio Management r12.6
Performance testing results summary

Introduction

The r12.6 release of CA Asset Portfolio Management (APM) was subjected to a series of stress and performance tests prior to its GA release. The following is a summary of the results that will help an organization plan an implementation of APM to obtain optimal performance.

Hardware and Configurations

APM performance testing has been conducted on 4 similar environments most of which have been configured using ESX virtual technologies. Detailed testing environment specifications appear in the appendices at the end of this paper.

Additionally these environments break down into 2 types of configurations.

  1. (Virtual) - Environments in which all application servers and database servers are hosted on ESX virtual sessions. See appendices: 1, 2, & 4.

  2. (Mixed) - Environments in which all application servers are hosted on ESX virtual sessions and the database is hosted on a physical server. See appendices: 3.

The following CA products were installed to support various APM integration testing requirements:

  1. CA Asset Portfolio Management r12.6 0001 English Only (APM)

  2. CA IT Client Manager r12.5- English, French, German, Japanese (ITCM)

  3. CA Business Intelligence for Windows r3.2 0311 (CA BI)

  4. CA Process Automation 3.0 ( ITPAM)

Section 1: APM User Interface

UI Test Case scenario

The most relevant real world testing scenario is one that simulates a typical user's daily activity. The following user interactions have been used to evaluate performance of the APM Web UI application starting from 1 user up to 100 users adding 1 user every 30 seconds. Each user added is doing the same type of activities over a 2 hour time period.

Please review the examples below. UI testing was done for a single web server configuration supporting 100 users. If a customer needs to support more than 100 users per APM installation then web farm and load balancing configuration technologies are recommended. Limit user load to 100 users per APM web instance.

APM 12.6 UI Performance tests

All tests were conducted with a 100 user load over a 2 hour time period. Automated testing tools were used to generate user load in a single web server environment. Tests simulated the following typical APM user interactions:

  1. Asset Saved Search - user selects a customized asset search and executes the search

  2. Create Asset - user creates an asset and saves

  3. Search Assets - user selects standard asset search

  4. Search Contacts - user select standard contacts search
Customer Action Screen / UI Element Elapsed Time (seconds)
    Apx 1: SQL Server 2005 Apx 2: SQL Server 2008 Apx 3: SQL Server 2008 Apx 4: Oracle
11g
1. Asset Saved Search
Load Login Page CA APM splash screen 0.35 0.12 0.06 0.24
Login Log In button 3.52 3.36 2.41 3.50
Load Search Page Manage Searches link 0.61 0.32 0.40 1.09
Choose Saved Search Saved Search link 0.99 0.62 0.68 1.94
Submit Search Go button 0.58 0.30 0.33 0.70
Logout Logout link 0.49 0.30 0.33 0.84
2. Create Asset
Load Login Page CA APM splash screen 0.33 0.18 0.07 0.30
Login Log In button 3.47 3.65 2.69 3.30
Load New Asset Page New Asset link 1.49 1.17 1.26 2.40
Enter Model Name Field (using auto-complete) 0.36 0.07 0.23 0.30
Loading Asset Family Loading. Please wait… message 1.61 1.26 1.70 2.40
Loading Extended Fields Loading. Please wait… message 1.75 1.39 1.33 3.09
Enter Operating System Field (using auto-complete) 0.24 0.07 0.35 0.26
Enter Cost Center Field (using auto-complete) 0.12 0.07 0.27 0.20
Enter Department Field (using auto-complete) 0.10 0.07 0.07 0.17
Enter GL Code Field (using auto-complete) 0.29 0.07 0.03 0.37
Enter Company Bought For Field (using auto-complete) 0.13 0.07 0.06 0.23
Re-enter Company Bought For Field (using auto-complete) 0.09 0.06 0.07 0.18
Enter Contact Field (using auto-complete) 0.12 0.06 0.26 0.22
Enter Location Field (using auto-complete) 0.11 0.07 0.17 0.20
Enter Seller Company Field (using auto-complete) 0.17 0.07 0.07 0.20
Re-enter Seller Company Field (using auto-complete) 0.11 0.06 0.07 0.18
Enter Organization Bought For Field (using auto-complete) 0.11 0.07 0.04 0.17
Enter Lifecycle Status Field (using auto-complete) 0.10 0.07 0.17 0.21
Enter Resource Owner Field (using auto-complete) 0.11 0.08 0.15 0.21
Enter Billing Contact Field (using auto-complete) 0.11 0.07 0.16 0.25
Re-enter Billing Contact Field (using auto-complete) 0.09 0.06 0.06 0.18
Enter Support Contact Field (using auto-complete) 0.09 0.07 0.05 0.19
Re-enter Support Contact Field (using auto-complete) 0.08 0.06 0.05 0.18
Enter Maintenance Vendor Field (using auto-complete) 0.10 0.07 0.06 0.18
Enter Manufacturer Field (using auto-complete) 0.11 0.07 0.07 0.19
Enter Responsible Vendor Field (using auto-complete) 0.19 0.07 0.07 0.17
Enter Maintenance Organization Field (using auto-complete) 0.21 0.07 0.15 0.23
Customer Action Screen / UI Element Elapsed Time (seconds)
    Apx 1: SQL Server
2005
Apx 2: SQL Server
2008
Apx 3: SQL Server
2008
Apx 4: Oracle
11g
Re-enter Maintenance Organization Field (using auto-complete) 0.09 0.05 0.05 0.16
Enter Responsible Organization Field (using auto-complete) 0.10 0.06 0.05 0.21
Save Asset Save button 3.11 1.91 2.40 5.70
Logout Logout link 1.70 0.58 1.14 1.58
3. Search Assets
Load Login Page CA APM splash screen 0.30 0.11 0.99 0.22
Login Log In button 3.50 3.88 3.49 3.57
Search Assets Asset Search page 0.94 0.50 0.59 1.13
Logout Logout link 0.76 0.31 0.23 0.75
4. Search Contacts
Load Login Page CA APM splash screen 0.28 0.10 1.11 0.37
Login Log In button 3.38 3.40 3.52 3.59
Load Directory Directory tab 0.93 0.59 0.79 1.34
Search Contacts Contact Search page 0.79 0.46 0.55 1.16
Logout Logout link 0.63 0.32 0.21 0.94

Section 2: ITAM Data Importer

ITAM APM Data Importer Test Case scenario

These tests simulate a typical user attempting to create a large block of owned assets. The following ITAM Data Importer tasks have been used to evaluate performance of the APM Data Importer via owned asset on-boarding activity using a Comma Separated Value (CSV) file dataset of 100,000 records as the data source. The APM Importer executable is launched from APM Application server for the purpose of scalability. Multiple Importer tasks can be executed at the same time from the APM Application server or any other server where the user has implemented APM Data Importer. The Asset Load task creates owned assets and various related supporting records, than registers owned assets through the Common Object Registration API (CORA) registration process.

The Contact Load task shows similar on-boarding activities and has been used as another example of Importer operations. Please review the examples provided below.

APM 12.6 ITAM Data Importer tests

  1. Asset Load - creates owned assets along with their relevant supporting records

  2. Contact Load - creates contact records along with their relevant supporting records

Asset Load

The Asset Load test is a single tenant import of 72k assets using a single ITAM Data Importer instance.

Note: A single APM application server was used to execute load through APM Importer UI.

Object Loaded MDB Table Record Count
Asset ca_owned_resource 72,730
Company ca_company 54
Contact ca_contact 41,380
Cost Center ca_resource_cost_center 999
Department ca_resource_department 999
Job Function ca_job_function 0
Job Title ca_job_title 8
Location ca_location 215
Model ca_model_def 620
Organization ca_organization 43
TOTAL   117,048

 

  Apx 1: SQL Server
2005
Apx 2: SQL Server
2008
Apx 3: SQL Server
2008
Apx 4: Oracle
11g
Records Loaded 117,048 117,048 117,048 117,048
Elapsed Time (mins) 1020 408 466 4500
Average Records / Sec 1.91 4.78 4.19 0.43

Contact Load

The Contact Load test is a multiple tenant import of 20k contacts for 5 tenants using multiple ITAM Data Importer instances.

Object Loaded MDB Table Record Count
Company ca_company 5,000
Contact ca_contact 99,458
Cost Center ca_resource_cost_center 10,999
Department ca_resource_department 10,000
Job Function ca_job_function 100
Job Title ca_job_title 2,591
Location ca_location 200
Organization ca_organization 10,000
TOTAL   138,348

  Apx 1: SQL Server
2005
Apx 2: SQL Server
2008
Apx 3: SQL Server
2008
Apx 4: Oracle
11g
Records Loaded 138,348 138,348 138,348 138,348
Elapsed Time (mins) 196 144 132 205
Average Records / Sec 11.74 16.01 17.47 11.25

Section 3: Hardware Reconciliation

APM Hardware Reconciliation Test Case scenarios

This testing simulates several activities a typical user may attempt in order to reconcile owned assets against discovered hardware. Reconciliation is also able to perform updates to various fields on the owned asset record based on rules the user has created.

In the test results referenced below, these tests attempt to make changes to the owned asset when the discovery process has stored values which don't match the owned asset values.

APM 12.6 hardware reconciliation tests

  1. Asset Converter - Creates XML files to be processed via ITCM collector. This is a utility which allows user to map various discovery data sources into an XML formatted file which ITCM Asset Collector can consume, and then populate that information into the CA MDB. This is an example of an on-boarding activity in which the customer discovery tools are unknown to the CA MDB. The Asset Converter provides a method to load the data.

  2. ITCM Asset Collector - Processes XML files created through the Asset Converter and populates the CA MDB with specific hardware/software records so APM can reconcile. The Asset Collector has two sets of information: Alpha, data loaded for the first time, and Delta, records which are already present but have changed some of their values, for example number of CPU's, RAM, or disk size.

  3. APM Reconciliation - the reconciliation process takes place in two parts:

  4. Match process - matches owned assets to their discovered hardware counter-parts

  5. Change process - changes owned asset field values to match their discovered hardware detail when the data is different on the discovered hardware records.

Note: Reconciliation has been tested in 2 phases, an Alpha pass and Delta pass.

Asset Converter

Converts a single CSV file with approximately 86K rows of data into XML files for ITCM Asset Collector consumption and processing. The CSV data file is used to create ca_disovered_hardware and inv_generalinventory_item records.

  Apx 1: SQL Server 2005 Apx 2: SQL Server 2008 Apx 3: SQL Server 2008 Apx 4; Oracle 11g
Alpha Delta Alpha Delta Alpha Delta Alpha Delta
Records Loaded 64,953 64,953 64,953 64,953 64,953 64,953 64,953 64,953
Elapsed Time (mins) 60 59 58 57 58 57 58 57
Average Records / Sec 18.04 18.35 18.66 18.99 18.66 18.99 18.66 18.99

ITCM Asset Collector

Consumes and processes XML files generated from Asset Converter. Loads hardware data into the MDB. Note: There is one ca_discovered_hardware record and anywhere from one to hundreds of inv_generalinventory_item records for each hardware record generated.

  Apx 1: SQL Server 2005 Apx 2: SQL Server 2008 Apx 3: SQL Server 2008 Apx 4: Oracle 11g
Alpha Delta Alpha Delta Alpha Delta Alpha Delta

Records Loaded
58,468 58,468 58,468 58,468 58,468 58,468 58,468 58,468

Elapsed Time (mins)
2760 359 1440 270 1260 240 1800 987

Average Records / Sec
0.35 2.71 0.68 3.61 0.77 4.06 0.54 0.99

Hardware Reconciliation - Alpha Match-Change Processing

Evaluates matching rules and modifies records between ca_discovered_hardware and ca_owned_resource records. Alpha load refers to the primary reconciliation.

  Apx 1: SQL Server 2005 Apx 2: SQL Server 2008 Apx 3: SQL Server 2008 Apx 4: Oracle 11g
Match Change Match Change Match Change Match Change
Records Loaded 56,506 56,506 56,506 56,506 56,506 56,506 56,506 56,506
Elapsed Time (mins) 35 480 21 420 19 397 37 1560
Average Records / Sec 26.91 1.96 44.85 2.24 49.57 2.37 25.45 0.60

Hardware Reconciliation - Delta Match-Change Processing

Delta change represents updates to hardware asset records coming from discovery of changes to hardware.

  Apx 1: SQL Server 2005 Apx 2: SQL Server 2008 Apx 3: SQL Server 2008 Apx :4 Oracle 11g
Match Change Match Change Match Change Match Change
Records Loaded 56,506 56,506 56,506 56,506 56,506 56,506 56,506 56,506
Elapsed Time (mins) 5 515 5 492 4 360 15 2437
Average Records / Sec 188.35 1.83 188.35 1.91 235.44 2.62 62.78 0.39

Appendix 1:

ITAM QA Performance (Virtual) lab environment

MS SQL 2005

ESX Session 1: Server: APM 12.6 Web Server - APM 12.6
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space
ESX Session 2: Server: APM 12.6 Application Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space
ESX Session 3: Server: APM 12.6 Database Server
Windows 2003 Enterprise Server SP2 (32 bit)
MS SQL Server 2005 (32 bit)
Dual Processor 2.9 GHz
4 GB Memory
  • 100 GB Hard Drive Space (C:)
ESX Session 4: Server: APM 12.6 ITCM, ITPAM, & CA BI Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
8 GB Memory
  • 50 GB Hard Drive Space

Appendix 2:

ITAM QA Performance (Virtual) lab environment

MS SQL 2008

ESX Session 1: Server: APM 12.6 Web Server
Windows 2003 Enterprise Server SP2 (64 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 50 GB Hard Drive Space
ESX Session 2: Server: APM 12.6 Application Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 50 GB Hard Drive Space
ESX Session 3: Server: APM 12.6 Database Server
Windows 2008 Enterprise Server SP3 (64 bit)
MS SQL Server 2008 (64 bit)
Dual Processor 2.9 GHz
6 GB Memory
  • 50 GB Hard Drive Space (C:)
  • 60 GB Hard Drive Space (D:)
ESX Session 4: Server: APM 12.6 ITCM, ITPAM, & CA BI Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
8 GB Memory
  • 50 GB Hard Drive Space

Appendix 3:

ITAM QA Performance (Mixed) lab environment

MS SQL 2008

ESX Session 1: Server: APM 12.6 Web Server
Windows 2008 Standard Server SP1 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space
ESX Session 2: Server: APM 12.6 Application Server
Windows 2008 Standard Server SP1 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space
Physical Server 3: APM 12.6 Database Server
Windows 2008 Enterprise Server SP3 (64 bit)
MS SQL Server 2008 (64 bit)
8 Dual Processor 2.9 GHz - total of 16 CPU's
32 GB Memory
  • 500 GB Hard Drive Space (C:)
  • 1000 GB Hard Drive Space (D:)
ESX Session 4: Server: APM 12.6 ITCM, & BI Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space

Appendix 4:

ITAM QA Performance lab environment

Windows Oracle 11.x

ESX Session 1: Server: APM 12.6 Web Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space
ESX Session 2: Server: APM 12.6 Application Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
4 GB Memory
  • 60 GB Hard Drive Space
ESX Session 3: Server: APM 12.6 Database Server
Windows 2003 Enterprise Server SP2 (32 bit)
Oracle 11.x (32 bit)
Dual Processor 2.9 GHz
4 GB Memory
  • 80 GB Hard Drive Space (C:)
ESX Session 4: Server: APM 12.6 ITCM, ITPAM, & CA BI Server
Windows 2003 Enterprise Server SP2 (32 bit)
Dual Processor 2.3 GHz
8 GB Memory
  • 50 GB Hard Drive Space

Chat with CA

Just give us some brief information and we'll connect you to the right CA Expert.

Our hours of availability are 8AM - 5PM CST.

All Fields Required

connecting

We're matching your request.

Unfortunately, we can't connect you to an agent. If you are not automatically redirected please click here.

  • {{message.agentProfile.name}} will be helping you today.

    View Profile


  • Transfered to {{message.agentProfile.name}}

    {{message.agentProfile.name}} joined the conversation

    {{message.agentProfile.name}} left the conversation

  • Your chat with {{$storage.chatSession.messages[$index - 1].agentProfile.name}} has ended.
    Thank you for your interest in CA.


    How Did We Do?
    Let us know how we did so that we can maintain a quality experience.

    Take Our Survey >

    Rate Your Chat Experience.

    {{chat.statusMsg}}

agent is typing