CrossMark

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

Where can I get TabletMark v3 for sideloading on my device?

TabletMark v3 packages are made available for sideloading on the TabletMark v3 product page. Sideloadable packages for Andriod, Windows, and iOS are available at the bottom of the page. Click the green ‘Download’ button next to the package you wish to download.

Do MobileMark® 2014 installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010 SP1, will expire 30 days after installation. Once the applications have expired, the disk containing the MobileMark® 2014 installation must be re-imaged with a new copy of the operating system, and a new instance of MobileMark® 2014 must be installed.

Does MobileMark® 2014 support installation on partitions other than the C:\ drive?

No. MobileMark® 2014  must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, MobileMark® 2014 tests must be executed from the same account that was used to install the benchmark.

Can the test system be connected to the Internet?

Test systems with MobileMark® 2014 installed should not be connected to the Internet. Some applications installed as part of MobileMark® 2014 may be deactivated and cause the benchmark to fail if an Internet connection is detected. These applications include:

  • Adobe® Acrobat® Pro X
  • Adobe® Photoshop® CS5 Extended
  • Adobe® Premiere® Pro CS5
Does MobileMark® 2014 support installation from external USB devices?

Yes. MobileMark® 2014 can be installed from external media such as USB disk or memory keys. Follow the steps below to install from external media. At least 20GB of free space is required.

  1. Create a new folder on the target USB media. Example folder name “MM2014”
  2. Create a folder for the contents of DVD1 inside the “MM2014” folder created in step 1. Example folder name “MM2014\Disc1”
  3. Create a folder for the contents of DVD2 inside the “MM2014” folder created in step 1. Example folder name “MM2014\Disc2”
  4. Copy the contents of DVD1 into “MM2014\Disc1” folder
  5. Copy the contents of DVD2 into “MM2014\Disc2” folder
  6. Copy the individual files Autorun.inf, BAPCo.ico, and MobileMark2014_Setup.exe from DVD1 into folder “MM2014\Disc1”
  7. Copy files individual files Autorun.inf, BAPCo.ico, from DVD2 into folder “MM2014\Disc2”
  8. Folder “MM2014\Disc1” should contain folders: Apps, Data, Help, and Setup, and individual files: Autorun.inf, BAPCo.ico, and MobileMark2012_Setup.exe
  9. Folder “MM2014\Disc2” should contain folders: Apps2, Data2, and Setup2, and individual files: Autorun.inf, BAPCo.ico
  10. Install the benchmark by launching MobileMark2014_Setup.exe from folder “MM2014\Disc1”
Why does MobileMark® 2014 sometimes report lower scores on the first iteration of a multiple iteration project?

Microsoft Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as MobileMark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. If selected, the Conditioning Run iteration will be executed at the beginning of a project. Typically, the Conditioning Run will be executed on AC power. When one iteration of the selected scenario has been successfully completed, the MobileMark 2014 will prompt the user to unplug the system. Once the system is unplugged, MobileMark 2014 will continue to execute the selected scenario until the system battery is completely discharged. Results from the Conditioning Run are not included in the project performance or battery life scoring.

What happens if the Conditioning Run is executed on DC (battery power)?

In cases where the Conditioning Run is executed on DC (battery power), the selected iteration will be run one time. Upon completion of the Conditioning Run iteration, MobileMark 2014 will pause the test to check if the system is plugged in or running on battery power. If the system is on battery power, MobileMark 2014 will continue to execute the chosen scenario until the system’s remaining battery charge is exhausted. However, the system will only report battery life and performance qualification scores if the remaining charge in the battery is sufficient to complete one iteration of the scenario. Results from the Conditioning Run will not be included in either the performance qualification or battery life scores.

Which operating system languages does MobileMark® 2014 support?

MobileMark® 2014 supports installation on US English, Brazilian Portuguese, Chinese (Simplified), French, German, Japanese, Spanish, and Russian. The operating system’s Regional Language settings must be set to US English. Additional languages may be supported in future updates. Check the MobileMark® 2014 FAQ online for the latest information.

How long does MobileMark® 2014 installation take?

Installation time for MobileMark® 2014 takes approximately 1 hour. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of MobileMark® 2014?

MobileMark® 2014 run time will vary according to factors such as battery design capacity, battery charge level at the start of the test, test system configuration, and the selected scenario.

What is the workaround for the ‘Clock error detected’ message?

Be sure that the system under test is set to the correct date and time to avoid the ‘Clock error detected’ message.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

What is the workaround for the “Acrobat® There is no disk in the drive” error?

This issue typically manifests itself on certain machines with special drive hidden partitions installed by OEMs on their branded machines. One can work around this issue by deleting the special hidden partition installed on the drive(s) and re-running MobileMark® 2014.

Does MobileMark 2014 support Windows 7 ‘N’?

MobileMark 2014 will support Windows 7 ‘N’ versions provided that the test image has Windows Media Player version 12 installed.

Why does IE9 crash when playing Flash content?

Internet Explorer 9 may crash when playing Flash content on systems equipped with NVIDIA Optimus graphics. Workaround this issue by going to the NVIDIA graphics control panel and set “Preferred graphics processor” to “Integrated graphics” for IE9.

Is Windows 8/8.1 activation required for running MobileMark 2014 (Applies to version 1.5 or higher)?

Windows 8/8.1 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with MobileMark 2014 tests. There are three ways to prevent this interference:

  • Activate the Windows 8 installation using a retail license key.
  • Activate the Windows 8 installation using a Key Management Server. Note, this option is only available for Windows 8 Enterprise edition
  • Enable Windows 8 Test Mode
    • Launch the “regedit” application
    • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
    • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the correct DPI scaling setting for MobileMark 2014?

MobileMark 2014 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.

Where can I find documentation on MobileMark 2014?

MobileMark 2014 documentation is located on the MobileMark 2014 product page here.

Hotfix for Error 1010: Security check failed while hashing files

Please note: The below “Error 1010” Hotfix does not apply to versions 1.5.x.x, as this fix has already be integrated into the code.

Download Hotfix for error 1010

Instructions:

1) MobileMark 2014 patch 2 or SYSmark 2014 patch 2 must be installed to use this hotfix.

2) Download and extract the above zip file to the test system where error 1010 occurred.

3) If any SYSmark 2014 or MobileMark 2014 windows remain open, close them before attempting to apply the hotfix.

4) Right click the ‘Hotfix_for_Error_1010.exe’ file that you extracted from the zip and choose ‘Run as Administrator’.

5) The package will launch a command prompt window.

6) Follow the prompts to apply the hotfix.

7) Upon successful completion, press any key to close the command window. You may now attempt to run SM14 or MM14, and should no longer see error 1010.

Note: This fix applies only SM14 and MM14 patch 2. If the hotfix package cannot detect the SM14 or MM14 installation, it will exit.

Do SYSmark® 2014 installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010, will expire 30 days after installation. Once the applications have expired, the HDD containing the SYSmark® 2014 installation must be reimaged with a new copy of the operating system, and a new instance of SYSmark® 2014 must be installed.

Does SYSmark® 2014 support foreign languages?

Yes. Support for non-English languages include French, German, Spanish, Portuguese (Brazilian), Russian, Japanese, and Chinese (Simplified) with SYSmark® 2014 Patch 1 installed.

Does SYSmark® 2014 support installation on partitions other than the C:\ drive?

No. SYSmark® 2014 must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, SYSmark® 2014 tests must be executed from the same account that was used to install the benchmark.

Can the test system be connected to the Internet?

Test systems with SYSmark® 2014 installed should not be connected to the Internet. Some applications installed as part of SYSmark® 2014 may be deactivated and cause the benchmark to fail if an Internet connection is detected.

Does SYSmark® 2014 support installation from external USB devices?

Yes. SYSmark® 2014 is distributed on USB media as well as DVD media. To install from the USB media distributed by BAPCo, simply plug the USB key into an open USB port on the target system. Locate the SYSmark2014_setup.exe file and double click to begin installation. The files on DVD media can also be installed from external media such as USB HDD or memory keys. Follow the steps below to install from external USB media. At least 50GB of free space is required.

  • Create a new folder
  • Copy the contents of DVD 1 into the newly created folder
  • Copy the contents of DVD 2 into the same folder as the contents from DVD 1
  • The folder should now contain the following: Apps, Apps2, Data, Data2, Setup, Setup2, Autorun.inf, BAPCo.ico, and SYSmark2014_Setup.exe
  • Install the benchmark by launching SYSmark2014_Setup.exe from the GUI, or on the command line
Does SYSmark® 2014 support uninstallation?

No. At this time SYSmark® 2014 does not support uninstallation. BAPCo strongly recommends making a backup of the test system image prior to installtion of SYSmark® 2014. Once testing is complete, BAPCo recommends performing a full image recovery on the test system.

SYSmark® 2014 completed successfully and reported scores, why is there an error folder included with the results?

An error folder included with the results of a SYSmark® 2014 run indicates that one or more of the scenarios in that project encountered a problem. In such cases, SYSmark® 2014 will attempt to retry the scenario a default maximum of 5 times. The retry maximum is can be customized on the command line using -r or –retries. Setting the value to “0” will disable the retry feature and SYSmark® will halt if an error is encountered.

Why does SYSmark® 2014 sometimes report lower scores on the first iteration of a multiple iteration project?

The Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as SYSmark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. The Conditioning Run is selected by default, and the iteration will be executed at the beginning of a project. Results from the Conditioning Run are not included in the project scoring.

Which operating system languages does SYSmark® 2014 support?

At this time, SYSmark® 2014 supports installation on US English. Additional language support may be added in future releases. Check the SYSmark® 2014 FAQ online for the latest information.

How long does SYSmark® 2014 installation take?

Installation time for SYSmark® 2014 takes approximately 45 minutes. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of SYSmark® 2014?

Running one full iteration of SYSmark® 2014 takes approximately 1 hour on the reference system. The time to complete a full iteration may vary depending on the the configuration of the system being tested.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

Is Windows 8/8.1 activation required for running SYSmark® 2014?

Windows 8/8.1 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with SYSmark 2014 tests. There are three ways to prevent this interference:

  • Activate the Windows 8/8.1 installation using a retail license key.
  • Activate the Windows 8/8.1 installation using a Key Management Server. Note, this option is only available for Windows 8/8.1 Enterprise edition
  • Enable Windows 8/8.1 Test Mode
  • Launch the “regedit” application
  • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
  • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the correct DPI scaling setting for SYSmark® 2014?

SYSmark® 2014 should be run with the DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause SYSmark® 2014 to report ‘screen resolution mismatch’ error and halt the test.

Where can I find documentation on SYSmark 2014?

SYSmark 2014 documentation is located on the SYSmark 2014 product page here.

Hotfix for Error 1010: Security check failed while hashing files

Please note: The below “Error 1010” Hotfix does not apply to versions 1.5.x.x, as this fix has already be integrated into the code.

Download Hotfix for error 1010

Instructions:

1) MobileMark 2014 patch 2 or SYSmark 2014 patch 2 must be installed to use this hotfix.

2) Download and extract the above zip file to the test system where error 1010 occurred.

3) If any SYSmark 2014 windows remain open, close them before attempting to apply the hotfix.

4) Right click the ‘Hotfix_for_Error_1010.exe’ file that you extracted from the zip and choose ‘Run as Administrator’.

5) The package will launch a command prompt window.

6) Follow the prompts to apply the hotfix.

7) Upon successful completion, press any key to close the command window. You may now attempt to run SM14 or MM14, and should no longer see error 1010.

Note: This fix applies only SM14 and MM14 patch 2. If the hotfix package cannot detect the SM14 or MM14 installation, it will exit.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

Do SYSmark® 2012 Lite installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010, will expire 30 days after installation. Once the applications have expired, the HDD containing the SYSmark® 2012 Lite installation must be reimaged with a new copy of the operating system, and a new instance of SYSmark® 2012 Lite must be installed.

Does SYSmark® 2012 Lite support installation on partitions other than the C:\ drive?

No. SYSmark® 2012 Lite must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, SYSmark® 2012 Lite tests must be executed from the same account that was used to install the benchmark

Can the test system be connected to the Internet?

Test systems with SYSmark® 2012 Lite installed should not be connected to the Internet. Some applications installed as part of SYSmark® 2012 Lite may be deactivated and cause the benchmark to fail if an Internet connection is detected. These applications include:

  • Adobe® Acrobat® Pro
  • Adobe® Photoshop® CS5 (32bit)
  • Adobe® Premiere® Pro CS4
  • Adobe® Dreamweaver® CS4
Does SYSmark® 2012 Lite support installation from external USB devices?

Yes. SYSmark® 2012 Lite can be installed from external media such as USB HDD or memory keys. Follow the steps below to install from external media. At least 20GB of free space is required.

  • Create a new folder
  • Copy the contents of DVD 1 into the newly created folder
  • Copy the contents of DVD 2 into the same folder as the contents from DVD 1
  • The folder should now contain the following: Apps, Apps2, Data, Data2, Setup, Setup2, Autorun.inf, BAPCo.ico, and SYSmark2012_Setup.exe
  • Install the benchmark by launching SYSmark2012_Setup.exe from the GUI, or on the command line
SYSmark® 2012 Lite completed successfully and reported scores, why is there an error folder included with the results?

An error folder included with the results of a SYSmark® 2012 Lite run indicates that one or more of the scenarios in that project encountered a problem. In such cases, SYSmark® 2012 Lite will attempt to retry the scenario a default maximum of 5 times. The retry maximum is can be customized on the command line using -r or –retries. Setting the value to “0” will disable the retry feature and SYSmark® will halt if an error is encountered.

Why does SYSmark® 2012 Lite sometimes report lower scores on the first iteration of a multiple iteration project?

The Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as SYSmark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. If selected, the Conditioning Run iteration will be executed at the beginning of a project. Results from the Conditioning Run are not included in the project scoring.

Why did ABBYY® FineReader Pro fail to install?

The SYSmark® 2012 Lite installer will fail to install ABBYY® FineReader Pro if the account name used to install the benchmark contains an apostrophe. To resolve this issue, create a new administrator account which does not contain apostrophes in the account name.

Which operating system languages does SYSmark® 2012 Lite support?

At this time, SYSmark® 2012 Lite supports installation on US English, French, German, Japanese, Russian, Brazilian Portugese, Simplified Chinese and Spanish operating systems. Additional language support may be added in future releases. Check the SYSmark® 2012 Lite FAQ online for the latest information.

How long does SYSmark® 2012 Lite installation take?

Installation time for SYSmark® 2012 Lite takes approximately 1.5 hours. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of SYSmark® 2012 Lite?

Running one full iteration of SYSmark® 2012 Lite takes approximately 3.5 hours on the reference system. The time to complete a full iteration may vary depending on the the configuration of the system being tested.

What is the workaround for the ‘Clock error detected’ message?

Be sure that the system under test is set to the correct date and time to avoid the ‘Clock error detected’ message.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

What is the workaround for the “Acrobat®: There is no disk in the drive” error?

This issue typically manifests itself on certain machines with special drive hidden partitions installed by OEMs on their branded machines. One can work around this issue by deleting the special hidden partition installed on the drive(s) and re-running SYSmark 2012 Lite.

How can SYSmark 2012 Lite be upgraded to the latest patch release?

SYSmark® 2012 Lite supports in place upgrades to the latest shipping version by using the patch installer executable, which can be downloaded from www.bapco.com/support. After downloading the patch, copy it to the system with existing SYSmark® 2012 Lite installation, and double click the patch executable to launch it. Follow the prompts to install. SYSmark® 2012 Lite patch installers will update any previous version of the benchmark to the latest shipping version.

Can the patch installer be used to update a partial installation of SYSmark® 2012 Lite?

SYSmark® 2012 Lite patch installer does not support updates of existing installations of SYSmark® 2012 Lite. Attempting to apply the patch installer to a partial installation of an earlier version of SYSmark® 2012 Lite will result in corrupting the installation on the system. If this happens, please start with a clean image and complete install of SYSmark® 2012 Lite, then apply the patch to update to the latest shipping version.

Does the SYSmark® 2012 Lite installer prevent installation of an older version over a newer version?

SYSmark® 2012 Lite versions prior to version 1.0.1.84 do not support version detection which prevents an older version from being installed over a newer version. If an earlier version of SYSmark® 2012 Lite is installed over a newer version, the installation will become corrupt and unusable.

Can the full SYSmark® 2012 Lite installer be used to update an existing older version to the latest shipping version?

SYSmark® 2012 Lite full installer cannot be used to update an existing older version to the latest shipping version. The installer will exit if an older version is detected on the target system.

Is Windows 8 activation required for running SYSmark® 2012 Lite?

Windows 8 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with SYSmark 2012 Lite tests. There are three ways to prevent this interference:

  • Activate the Windows 8 installation using a retail license key.
  • Activate the Windows 8 installation using a Key Management Server. Note, this option is only available for Windows 8 Enterprise edition
  • Enable Windows 8 Test Mode
    • Launch the “regedit” application
    • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
    • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the correct DPI scaling setting for SYSmark® 2012 Lite?

SYSmark® 2012 Lite should be run with the DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The configuration tool now includes an item to automate setting this value.

Why does IE9 crash when playing Flash content?

Internet Explorer 9 may crash when playing Flash content on systems equipped with NVIDIA Optimus graphics. Workaround this issue by going to the NVIDIA graphics control panel and set “Preferred graphics processor” to “Integrated graphics” for IE9.

Do MobileMark® 2012 Lite installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010 SP1, will expire 30 days after installation. Once the applications have expired, the disk containing the MobileMark® 2012 Lite installation must be re-imaged with a new copy of the operating system, and a new instance of MobileMark® 2012 Lite must be installed.

Does MobileMark® 2012 Lite support installation on partitions other than the C:\ drive?

No. MobileMark® 2012 Lite must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, SYSmark® 2012 Lite tests must be executed from the same account that was used to install the benchmark

Can the test system be connected to the Internet?

Test systems with MobileMark® 2012 Lite installed should not be connected to the Internet. Some applications installed as part of MobileMark® 2012 Lite may be deactivated and cause the benchmark to fail if an Internet connection is detected. These applications include:

  • Adobe® Acrobat® Pro X
  • Adobe® Photoshop® CS5 Extended
  • Adobe® Premiere® Pro CS5
Does MobileMark® 2012 Lite support installation from external USB devices?

Yes. MobileMark® 2012 Lite can be installed from external media such as USB disk or memory keys. Follow the steps below to install from external media. At least 20GB of free space is required.

  1. Create a new folder on the target USB media. Example folder name “MM2012”
  2. Create a folder for the contents of DVD1 inside the “MM2012” folder created in step 1. Example folder name “MM2012\Disc1”
  3. Create a folder for the contents of DVD2 inside the “MM2012” folder created in step 1. Example folder name “MM2012\Disc2”
  4. Copy the contents of DVD1 into “MM2012\Disc1” folder
  5. Copy the contents of DVD2 into “MM2012\Disc2” folder
  6. Copy the individual files Autorun.inf, BAPCo.ico, and MobileMark2012_Setup.exe from DVD1 into folder “MM2012\Disc1”
  7. Copy files individual files Autorun.inf, BAPCo.ico, from DVD2 into folder “MM2012\Disc2”
  8. Folder “MM2012\Disc1” should contain folders: Apps, Data, Help, and Setup, and individual files: Autorun.inf, BAPCo.ico, and MobileMark2012_Setup.exe
  9. Folder “MM2012\Disc2” should contain folders: Apps2, Data2, and Setup2, and individual files: Autorun.inf, BAPCo.ico
  10. Install the benchmark by launching MobileMark2012_Setup.exe from folder “MM2012\Disc1”
Why does MobileMark® 2012 Lite sometimes report lower scores on the first iteration of a multiple iteration project?

Microsoft Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as MobileMark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. If selected, the Conditioning Run iteration will be executed at the beginning of a project. Typically, the Conditioning Run will be executed on AC power. When one iteration of the selected scenario has been successfully completed, the MobileMark 2012 Lite will prompt the user to unplug the system. Once the system is unplugged, MobileMark 2012 Lite will continue to execute the selected scenario until the system battery is completely discharged. Results from the Conditioning Run are not included in the project performance or battery life scoring.

What happens if the Conditioning Run is executed on DC (battery power)?

In cases where the Conditioning Run is executed on DC (battery power), the selected iteration will be run one time. Upon completion of the Conditioning Run iteration, MobileMark 2012 Lite will pause the test to check if the system is plugged in or running on battery power. If the system is on battery power, MobileMark 2012 Lite will continue to execute the chosen scenario until the system’s remaining battery charge is exhausted. However, the system will only report battery life and performance qualification scores if the remaining charge in the battery is sufficient to complete one iteration of the scenario. Results from the Conditioning Run will not be included in either the performance qualification or battery life scores.

Why did ABBYY® FineReader Pro fail to install?

The MobileMark® 2012 Lite installer will fail to install ABBYY® FineReader Pro if the account name used to install the benchmark contains an apostrophe. To resolve this issue, create a new administrator account which does not contain apostrophes in the account name.

Which operating system languages does MobileMark® 2012 Lite support?

MobileMark® 2012 Lite supports installation on US English, Brazilian Portuguese, Chinese (Simplified), French, German, Japanese, Spanish, and Russian. The operating system’s Regional Language settings must be set to US English. Additional languages may be supported in future updates. Check the MobileMark® 2012 Lite FAQ online for the latest information.

How long does MobileMark® 2012 Lite installation take?

Installation time for MobileMark® 2012 Lite takes approximately 1.5 hours. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of MobileMark® 2012 Lite?

MobileMark® 2012 Lite run time will vary according to factors such as battery design capacity, battery charge level at the start of the test, test system configuration, and the selected scenario.

What is the workaround for the ‘Clock error detected’ message?

Be sure that the system under test is set to the correct date and time to avoid the ‘Clock error detected’ message.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

What is the workaround for the “Acrobat® There is no disk in the drive” error?

This issue typically manifests itself on certain machines with special drive hidden partitions installed by OEMs on their branded machines. One can work around this issue by deleting the special hidden partition installed on the drive(s) and re-running MobileMark® 2012 Lite.

Does MobileMark 2012 Lite support Windows 7 ‘N’?

MobileMark 2012 Lite will support Windows 7 ‘N’ versions provided that the test image has Windows Media Player version 12 installed.

Why did the wireless network connection fail during the Office Productivity test?

If the wireless connection fails during the Office Productivity test try the following:

  • When setting up the connection profile for the wireless network, be sure the ‘Connect Automatically’ option is checked
  • Reduce the number of clients connected to the router during the Office Productivity
  • As a last resort, try resetting the router to factory defaults
Which wireless routers are recommended for use with MobileMark 2012 Lite?

The following wireless routers are recommended for use with MobileMark 2012 Lite:

  • Netgear N900 Wireless Dual Band Gigabit Router (WNDR4500)
  • Linksys E3200 High-Performance Simultaneous Dual-Band Wireless-N Router
Is Windows 8 activation required for running MobileMark 2012 Lite ? (Applies to version 1.5 or higher)

Windows 8 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with MobileMark 2012 Lite tests. There are three ways to prevent this interference:

  • Activate the Windows 8 installation using a retail license key.
  • Activate the Windows 8 installation using a Key Management Server. Note, this option is only available for Windows 8 Enterprise edition
  • Enable Windows 8 Test Mode
    • Launch the “regedit” application
    • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
    • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the correct DPI scaling setting for MobileMark 2012 Lite?

MobileMark 2012 Lite should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%

What is the workaround for the “Outlook experienced a serious problem with the ‘atheros outlook addin 2010’ add-in error message”?

Some systems equipped with Atheros BlueTooth modules may experience issues as the Atheros Outlook add-in can disrupt the automation of MobileMark 2012 testing. Please remove the Atheros add-in prior to installing MobileMark 2012. Note that issues may still occur if the add-in has not been fully removed. If such a failure occurs, click ‘Yes’ to disable the add-in when prompted, then restart the MobileMark 2012 test.

Why does IE9 crash when playing Flash content?

Internet Explorer 9 may crash when playing Flash content on systems equipped with NVIDIA Optimus graphics. Workaround this issue by going to the NVIDIA graphics control panel and set “Preferred graphics processor” to “Integrated graphics” for IE9.

Do MobileMark® 2012 installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010 SP1, will expire 30 days after installation. Once the applications have expired, the disk containing the MobileMark® 2012 installation must be re-imaged with a new copy of the operating system, and a new instance of MobileMark® 2012 must be installed.

Does MobileMark® 2012 support installation on partitions other than the C:\ drive?

No. MobileMark® 2012 must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, MobileMark® 2012 tests must be executed from the same account that was used to install the benchmark

Can the test system be connected to the Internet?

Test systems with MobileMark® 2012 installed should not be connected to the Internet. Some applications installed as part of MobileMark® 2012 may be deactivated and cause the benchmark to fail if an Internet connection is detected. These applications include:

  • Adobe® Acrobat® Pro X
  • Adobe® Photoshop® CS5 Extended
  • Adobe® Premiere® Pro CS5
Does MobileMark® 2012 support installation from external USB devices?

Yes. MobileMark® 2012 can be installed from external media such as USB disk or memory keys. Follow the steps below to install from external media. At least 20GB of free space is required.

  1. Create a new folder on the target USB media. Example folder name “MM2012”
  2. Create a folder for the contents of DVD1 inside the “MM2012” folder created in step 1. Example folder name “MM2012\Disc1”
  3. Create a folder for the contents of DVD2 inside the “MM2012” folder created in step 1. Example folder name “MM2012\Disc2”
  4. Copy the contents of DVD1 into “MM2012\Disc1” folder
  5. Copy the contents of DVD2 into “MM2012\Disc2” folder
  6. Copy the individual files Autorun.inf, BAPCo.ico, and MobileMark2012_Setup.exe from DVD1 into folder “MM2012\Disc1”
  7. Copy files individual files Autorun.inf, BAPCo.ico, from DVD2 into folder “MM2012\Disc2”
  8. Folder “MM2012\Disc1” should contain folders: Apps, Data, Help, and Setup, and individual files: Autorun.inf, BAPCo.ico, and MobileMark2012_Setup.exe
  9. Folder “MM2012\Disc2” should contain folders: Apps2, Data2, and Setup2, and individual files: Autorun.inf, BAPCo.ico
  10. Install the benchmark by launching MobileMark2012_Setup.exe from folder “MM2012\Disc1”
Why does MobileMark® 2012 sometimes report lower scores on the first iteration of a multiple iteration project?

Microsoft Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as MobileMark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. If selected, the Conditioning Run iteration will be executed at the beginning of a project. Typically, the Conditioning Run will be executed on AC power. When one iteration of the selected scenario has been successfully completed, the MobileMark 2012 will prompt the user to unplug the system. Once the system is unplugged, MobileMark 2012 will continue to execute the selected scenario until the system battery is completely discharged. Results from the Conditioning Run are not included in the project performance or battery life scoring.

What happens if the Conditioning Run is executed on DC (battery power)?

In cases where the Conditioning Run is executed on DC (battery power), the selected iteration will be run one time. Upon completion of the Conditioning Run iteration, MobileMark 2012 will pause the test to check if the system is plugged in or running on battery power. If the system is on battery power, MobileMark 2012 will continue to execute the chosen scenario until the system’s remaining battery charge is exhausted. However, the system will only report battery life and performance qualification scores if the remaining charge in the battery is sufficient to complete one iteration of the scenario. Results from the Conditioning Run will not be included in either the performance qualification or battery life scores.

Why did ABBYY® FineReader Pro fail to install?

The MobileMark® 2012 installer will fail to install ABBYY® FineReader Pro if the account name used to install the benchmark contains an apostrophe. To resolve this issue, create a new administrator account which does not contain apostrophes in the account name.

Which operating system languages does MobileMark® 2012 support?

MobileMark® 2012 supports installation on US English, Brazilian Portuguese, Chinese (Simplified), French, German, Japanese, Spanish, and Russian. The operating system’s Regional Language settings must be set to US English. Additional languages may be supported in future updates. Check the MobileMark® 2012 FAQ online for the latest information.

How long does MobileMark® 2012 installation take?

Installation time for MobileMark® 2012 takes approximately 1.5 hours. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of MobileMark® 2012?

MobileMark® 2012 run time will vary according to factors such as battery design capacity, battery charge level at the start of the test, test system configuration, and the selected scenario.

What is the workaround for the ‘Clock error detected’ message?

Be sure that the system under test is set to the correct date and time to avoid the ‘Clock error detected’ message.

What is the workaround for the “Acrobat® There is no disk in the drive” error?

This issue typically manifests itself on certain machines with special drive hidden partitions installed by OEMs on their branded machines. One can work around this issue by deleting the special hidden partition installed on the drive(s) and re-running MobileMark® 2012.

Does MobileMark 2012 support Windows 7 ‘N’?

MobileMark 2012 will support Windows 7 ‘N’ versions provided that the test image has Windows Media Player version 12 installed.

Why did the wireless network connection fail during the Office Productivity test?

If the wireless connection fails during the Office Productivity test try the following:

  • When setting up the connection profile for the wireless network, be sure the ‘Connect Automatically’ option is checked
  • Reduce the number of clients connected to the router during the Office Productivity
  • As a last resort, try resetting the router to factory default
Which wireless routers are recommended for use with MobileMark 2012?

The following wireless routers are recommended for use with MobileMark 2012:

  • Netgear N900 Wireless Dual Band Gigabit Router (WNDR4500)
  • Linksys E3200 High-Performance Simultaneous Dual-Band Wireless-N Router
Is Windows 8 activation required for running MobileMark 2012 (Applies to version 1.5 or higher)?

Windows 8 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with MobileMark 2012 tests. There are three ways to prevent this interference:

  • Activate the Windows 8 installation using a retail license key.
  • Activate the Windows 8 installation using a Key Management Server. Note, this option is only available for Windows 8 Enterprise edition
  • Enable Windows 8 Test Mode
    • Launch the “regedit” application
    • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
    • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the workaround for the “Outlook experienced a serious problem with the ‘atheros outlook addin 2010’ add-in error message”?

Some systems equipped with Atheros BlueTooth modules may experience issues as the Atheros Outlook add-in can disrupt the automation of MobileMark 2012 testing. Please remove the Atheros add-in prior to installing MobileMark 2012. Note that issues may still occur if the add-in has not been fully removed. If such a failure occurs, click ‘Yes’ to disable the add-in when prompted, then restart the MobileMark 2012 test.

What is the correct DPI scaling setting for MobileMark 2012?

MobileMark 2012 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.

Do SYSmark® 2012 installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010, will expire 30 days after installation. Once the applications have expired, the HDD containing the SYSmark® 2012 installation must be reimaged with a new copy of the operating system, and a new instance of SYSmark® 2012 must be installed.

Does SYSmark® 2012 support installation on partitions other than the C:\ drive?

No. SYSmark® 2012 must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, SYSmark® 2012 tests must be executed from the same account that was used to install the benchmark

Can the test system be connected to the Internet?

Test systems with SYSmark® 2012 installed should not be connected to the Internet. Some applications installed as part of SYSmark® 2012 may be deactivated and cause the benchmark to fail if an Internet connection is detected. These applications include:

  • Adobe® Acrobat® Pro
  • Adobe® Photoshop® CS5 Extended
  • Adobe® Premiere® Pro CS5
  • Adobe® Dreamweaver® CS5
  • Adobe® After Effects® CS5
Does SYSmark® 2012 support installation from external USB devices?

Yes. SYSmark® 2012 can be installed from external media such as USB HDD or memory keys. Follow the steps below to install from external media. At least 20GB of free space is required.

  • Create a new folder
  • Copy the contents of DVD 1 into the newly created folder
  • Copy the contents of DVD 2 into the same folder as the contents from DVD 1
  • The folder should now contain the following: Apps, Apps2, Data, Data2, Setup, Setup2, Autorun.inf, BAPCo.ico, and SYSmark2012_Setup.exe
  • Install the benchmark by launching SYSmark2012_Setup.exe from the GUI, or on the command line
SYSmark® 2012 completed successfully and reported scores, why is there an error folder included with the results?

An error folder included with the results of a SYSmark® 2012 run indicates that one or more of the scenarios in that project encountered a problem. In such cases, SYSmark® 2012 will attempt to retry the scenario a default maximum of 5 times. The retry maximum is can be customized on the command line using -r or –retries. Setting the value to “0” will disable the retry feature and SYSmark® will halt if an error is encountered.

Why does SYSmark® 2012 sometimes report lower scores on the first iteration of a multiple iteration project?

The Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as SYSmark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. If selected, the Conditioning Run iteration will be executed at the beginning of a project. Results from the Conditioning Run are not included in the project scoring.

Why did ABBYY® FineReader Pro fail to install?

The SYSmark® 2012 installer will fail to install ABBYY® FineReader Pro if the account name used to install the benchmark contains an apostrophe. To resolve this issue, create a new administrator account which does not contain apostrophes in the account name.

Which operating system languages does SYSmark® 2012 support?

At this time, SYSmark® 2012 supports installation on US English, French, German, Japanese, Russian, Brazilian Portugese and Spanish operating systems. Additional language support may be added in future releases. Check the SYSmark® 2012 FAQ online for the latest information.

How long does SYSmark® 2012 installation take?

Installation time for SYSmark® 2012 takes approximately 1.5 hours. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of SYSmark® 2012?

How long does it take to complete one full iteration of sysmark® 2012?

Running one full iteration of sysmark® 2012 takes approximately 3.5 hours on the reference system. The time to complete a full iteration may vary depending on the the configuration of the system being tested.

What is the workaround for the ‘Clock error detected’ message?

Be sure that the system under test is set to the correct date and time to avoid the ‘Clock error detected’ message.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

What is the workaround for the “Acrobat®: There is no disk in the drive” error?

This issue typically manifests itself on certain machines with special drive hidden partitions installed by OEMs on their branded machines. One can work around this issue by deleting the special hidden partition installed on the drive(s) and re-running SYSmark 2012.

How can SYSmark 2012 be upgraded to the latest patch release?

SYSmark® 2012 supports in place upgrades to the latest shipping version by using the patch installer executable, which can be downloaded from www.bapco.com/support. After downloading the patch, copy it to the system with existing SYSmark® 2012 installation, and double click the patch executable to launch it. Follow the prompts to install. SYSmark® 2012 patch installers will update any previous version of the benchmark to the latest shipping version.

Can the patch installer be used to update a partial installation of SYSmark® 2012?

SYSmark® 2012 patch installer does not support updates of existing partial installations of SYSmark® 2012. Attempting to apply the patch installer to a partial installation of an earlier version of SYSmark® 2012 will result in corrupting the installation on the system. If this happens, please start with a clean image and complete install of SYSmark® 2012, then apply the patch to update to the latest shipping version.

Does the SYSmark® 2012 installer prevent installation of an older version over a newer version?

SYSmark® 2012 versions prior to version 1.0.1.84 do not support version detection which prevents an older version from being installed over a newer version. If an earlier version of SYSmark® 2012 is installed over a newer version, the installation will become corrupt and unusable.

Can the full SYSmark® 2012 installer be used to update an existing older version to the latest shipping version?

SYSmark® 2012 full installer cannot be used to update an existing older version to the latest shipping version. The installer will exit if an older version is detected on the target system.

Is Windows 8 activation required for running SYSmark® 2012? (Applies to version 1.5 or higher)
  • Activate the Windows 8 installation using a retail license key.
  • Activate the Windows 8 installation using a Key Management Server. Note, this option is only available for Windows 8 Enterprise edition
  • Enable Windows 8 Test Mode
    • Launch the “regedit” application
    • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
    • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the correct DPI scaling setting for SYSmark® 2012?

SYSmark® 2012 should be run with the DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause SYSmark® 2012 to report ‘screen resolution mismatch’ error and halt the test.

Why does the 3D Modeling scenario fail on systems with greater than 16 cores/threads?

SYSmark® 2012 3D Modeling scenario may fail to run on systems with greater than 16 cores/threads due to a limitation in the 3D Studio Max 2011 application. This issue has been fixed in SYSmark 2012 Patch 2 v1.5.2.295. Please update to the latest version.

Who creates BAPCo benchmarks?

BAPCo has a detailed development process which is followed for all products. An outline of the development process is available in the SYSmark 2014 whitepaper. Many committee members volunteer resources to help in various aspects of the development process.

Where can I find the EULA & Compliance (Benchmark Rules)?

The EULA (End User License Agreement) can be found and downloaded here.

The Compliance and Benchmarking Rules can be found and downloaded here.

Are BAPCo products used in government tenders?

Yes, BAPCo products are used in government tenders in over 50 countries including: Argentina, Armenia, Australia, Austria, Azerbaijan, Belgium, Brazil, Canada, Chile, China, Columbia, Costa Rica, Croatia, Cyprus, Czech Republic, Denmark, Egypt, Estonia, France, Germany, Greece, Hong Kong, Hungary, India, Indonesia, Ireland, Israel, Italy, Japan, Kazakhstan, Latvia, Lithuania, Macedonia, Malaysia, Mexico, Netherlands, New Zealand, Norway, Philippines, Poland, Portugal, Romania, Russian Federation, Saudi Arabia, Serbia, Singapore, Slovakia, South Africa, South Korea, Spain, Sweden, Switzerland, Taiwan, Tajikistan, Thailand, Turkey, United Arab Emirates, United Kingdom and United States of America. Refer to http://bapco.com/bgn for additional information.

Does BAPCo use any optimization when compiling the benchmarking software?

No. The default compiler options are used. SYSmark, MobileMark and TabletMark are compiled with Microsoft Visual Studio with default options.

Does BAPCo optimize the applications it uses in SYSmark or MobileMark?

No, BAPCo does not optimize any applications. All the applications used in BAPCo benchmarks come directly from the application vendors. The performance of those applications will represent the performance users will see in the real world.

Who makes the decisions on which scenarios should be included in BAPCo benchmarks?

BAPCo committee members look at current usage models and usage trends to determine relevant scenarios.

Who makes the decisions on which applications will be used in BAPCo benchmarks?

BAPCo committee members use many criteria to determine relevant applications to use, including market data. Ultimately the BAPCo membership decides which applications will be used.

What are the benefits of using SYSmark or MobileMark?

SYSmark and MobileMark use real world applications. This gives a more realistic view of performance unlike many synthetic benchmarks which only focus on limited aspects of a system.

Why would a company want to join the consortium?

BAPCo was founded to foster the creation of meaningful benchmarks in an applications environment. BAPCo members receive released products at a cost rate. Also, BAPCo members have access to beta pre-releases before outside companies can purchase the released product. The BAPCo organization always promotes member companies in its literature, WWW site, and convention (exposure) show booths.

How does a company join BAPCo?

Companies interested in joining the consortium are required to fill out an Application + BAPCo Membership Agreement which will be reviewed by BAPCo’s Board of Directors. Membership dues are payable upon application approval.

Starting on 1 January 2021 BAPCo membership dues will be:

Full membership: $16,540 initiation fee and $16,540 yearly ($33,080).

Associate membership: $11,025 initiation fee and $11,025 yearly ($22,050).

2021-2023 BAPCo Membership dues table:

Companies interested in becoming part of the consortium should send a request via our contact form.

Who can join BAPCo?

Any organization interested in contributing to the consortium’s goals and purposes while adhering to the consortium’s code of conduct may join. Companies interested in becoming part of the consortium should call (408) 988-7654 or send a request via our contact form.

What makes BAPCo’s benchmarks unique?

BAPCo benchmarks are based on software packages commonly found in retail computer software stores. Using benchmarks based on business applications enables users to conduct evaluations of systems handling realistic workloads in environments users might often encounter. This approach provides users with meaningful data for evaluating systems because the results are relevant to demands they would typically place on systems through day-to-day workloads.

What is BAPCo?

BAPCo stands for Business Applications Performance Corporation and its current members include: Acer, ARCIntuition, ASUS, Compal, Dell, Hewlett-Packard, Hitachi, Intel, Inventec, LC Future Center, Lenovo, Pegatron, Quanta Computer,  Samsung, Toshiba, Western Digital, Wistron, and others. BAPCo is a non-profit consortium with a charter to develop and distribute a set of objective performance benchmarks for personal computers based on popular software applications and operating systems.

Why was BAPCo formed?

BAPCo was founded to foster the creation of meaningful benchmarks in an applications environment.

How do members of the press contact BAPCo?

Members of the press interested in contacting BAPCo may do so through email: [email protected]

Is a meter required to run the benchmark?

No. EEcoMark v2 can be run without a power meter by selecting the ‘null meter’ option when setting up the test parameters in the Controller GUI. However, when selecting the ‘null meter’ option, power data readings are simulated and will not reflect the actual energy consumption of the system.

Can the Controller support more than one UUT?

A given Controller system may be used with several UUT systems. However, the Controller can only be connected to and interact with one UUT at a time.

How do I submit TabletMark results to BAPCo.com?

At the completion of a successful run of TabletMark, results can be submitted to BAPCo.com from the results browser. Select the result to be submitted, then press the ‘submit’ icon. Note that the test system must be connected to the Internet for BAPCo.com to import the submission.

MobileMark 2014 ver 1.5 or SYSmark 2014 ver 1.5 has error OP_Acrobat_02_StartApp.exe/StartAcrobat (15008) on Windows 10 November update

Note: SYSmark 2014 v1.5 and MobileMark 2014 v1.5 with patch 1 installed no longer need this hotfix. Please download patch 1 from the product page.

 

The November update to Windows 10 may cause an error with Adobe Acrobat when running MobileMark 2014 ver 1.5 or SYSmark 2014 ver 1.5. Please download the following .zip archive Hotfix_for_default_PDF_reader.

  1. Extract the zip file to a directory
  2. Copy the self-extracting executable from the .zip to the test system
  3. Be sure all SYSmark/MobileMark windows and applications are closed
  4. Right click the executable and choose ‘Run as administrator’
  5. Follow the prompts to apply the hotfix.
  6. Once the hotfix completes, run the benchmark test.
Work around for SYSmark 2014 error 10014

The following work around is for Intel vPro equipped systems with the Intel Management and Security app installed which are failing with the following error:

OP_OneNote_05_Email.exe/SendToEmail (10014) SendToEmail: Failed to close outlook window (10014)

  1. Open the Intel Management and Security app by right clicking on the icon in the systray
  2. Uncheck the item labeled ‘enable user notification’
  3. Uncheck the item labeled ‘Intel Management and Security status will be available the next time I log on to Windows’
  4. Close the app
  5. Reboot
  6. Run SYSmark 2014

 

How do I configure a non-English OS installation for use with BAPCo SYSMark or MobileMark?

For testing on Non-Engish OS, SYSmark 2018 and MobileMark 2018 installers will configure the system correctly for the supported languages, provided the operating system is installed in a supported language, i.e., German.

SYSmark and MobileMark support seven Non-English languages. Download the .pdf for the target language and follow the instructions to configure the operating system.

 

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer.  Using incorrect drivers could result in significantly reduced performance.

SYSmark 2014 SE encounters errors on systems with lower memory configurations

If errors are encountered when testing SYSmark 2014 SE on systems with lower memory configurations (2gb of RAM), try increasing the virtual memory size available to to the system. A larger pagefile size will help with memory management and increase the chance of a passing result on lower end configuraations.

Where are the drivers for Watts Up? Pro power meter

Drivers for the Watts Up? Pro power meter are located below:

Data logger

USB controller driver

Instructions for installing the data logger and USB controller driver can be found in the SYSmark 2014 SE User guide.

Does SYSmark® 2014 SE support installation from external USB devices?

Yes. SYSmark® 2014 SE is distributed on USB media as well as DVD media. To install from the USB media distributed by BAPCo, simply plug the USB key into an open USB port on the target system. Locate the SYSmark2014SE_setup.exe file and double click to begin installation. The files on DVD media can also be installed from external media such as USB HDD or memory keys. Follow the steps below to install from external USB media. At least 30GB of free space is required on the target media.

  • Create a new folder
  • Copy the contents of DVD 1 into the newly created folder
  • Copy the contents of DVD 2 into the same folder as the contents from DVD 1
  • The folder should now contain the following: Apps, Apps2, Data, Data2, Setup, Setup2, Autorun.inf, BAPCo.ico, and SYSmark2014SE_Setup.exe
  • Install the benchmark by launching SYSmark2014SE_Setup.exe from the GUI, or on the command line
Evaluating systems with NVMe devices

NVMe configurations: NVMe devices may show lower than expected performance in some

configurations due to the way Force Unit Access (FUA) write requests are handled by the

Windows operating system. Therefore, BAPCo recommends that users install the storage driver

provided by the manufacturer of their NVMe device. In cases where the manufacturer does not

provide an NVMe driver, users may disable the ‘Windows Write cache buffer flushing’ setting on

the NVMe drive prior to testing.

Which meters are supported by SYSmark 2014 SE Energy Consumption test?

SYSmark 2014 SE supports two meters for use with the Energy Consumption test.

  1. Watts Up? Pro
  2. Extech 380803

Instructions for use and configuration of both meters can be found in the SYSmark 2014 SE User Guide, located on the main product page documentation section.

Hotfix for MobileMark 2014 patch 1 v1.5.1.55 display brightness reporting issue

This update is now included as part of MobileMark 2014 v1.5 HotFix 3. Please see the MobileMark 2014 v1.5 FAQ entry for HotFix 3

 

MobileMark 2014 v1.5 workaround for Redstone 3 smart screen battery warning

Note: BAPCo has issued a HotFix which automates this workaround. Please see this FAQ entry for more information.

 

When testing Redstone 3 (build 1709) with MobileMark 2014 v1.5, some users may experience a smart screen warning that blocks the test from completing and reporting a result. This issue is due to changes that Microsoft has made in the way Redstone 3 warns users when the remaining battery charge is low. This warning cannot be disabled as per Microsoft design.

BAPCo continues to work with Microsoft to resolve this issue. In the meantime, if you experience this issue when testing on Redstone 3, please refer to the workaround detailed in this document MM14.smart.screen.workaround.for.RS3

SYSmark 2014 SE patch 1 hotfix 1

The following hotfix has been issued to correct an issue with the config tool in SYSmark 2014 SE when attempting to run on Redstone 3.

 

Download SYSmark 2014 SE patch 1 hotfix v1

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE patch 1 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

SYSmark 2014 SE patch 1 must be installed to apply this hot fix. The update will not apply to older versions of SYSmark 2014 SE.

After the hotfix is applied, launch SYSmark SE 2014. The new version should be reported as 2.0.1.81.

SYSmark 2014 v1.5 on RS3, Error 1008: System Config failed with return code -1

Some users may encounter Error 1008: System Config failed with return code -1 when testing SYSmark 2014 v1.5 when testing on Windows 10 Redstone 3.

This manual work around has been replaced by the following Hotfix.

Download “SYSmark 2014 ver 1.5 patch 1, hotfix 1 v1.5.1.85 (config tool error under RS3)
Instructions:

  1. Download to target system
  2. Unzip the archive
  3. Close SM14 v1.5 if the application is open
  4. Right click the .exe and run as administrator

SYSmark 2014 v1.5 patch 1 must be installed to apply hotfix 1. The update will not apply to older versions of SYSmark 2014 v1.5. After the hotfix is applied, launch SM14 v1.5. The new version should be reported as 1.5.1.85.

 

MobileMark 2014 v1.5 patch 1 HotFix 3

The following HotFix has been issued to correct issues when testing on Redstone 3 . HotFix 3 is a cumulative update.

 

Download MobileMark 2014 v1.5 patch 1 hotfix 3

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of MobileMark 2014 v1.5 patch 1 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

MobileMark 2014 patch 1 must be installed to apply this hot fix. The update will not apply to older versions of MobileMark 2014.

After the hotfix is applied, launch MobileMark 2014. The new version should be reported as 1.5.1.63.

SYSmark 2014 SE: Workaround for Error 13007

Some users may experience Error 13007 when testing with SYSmark 2014 SE. This error can sometimes be the result of an orphaned registry key. The package below should help resolve the error.

  1. Download the zip archive and unpack it (Error-13007-OP_Word_03_Whitepaper).
  2. Copy the executable to the system under test that failed with error 13007.
  3. Right click the .exe file and run as administrator.
  4. Reboot the system.
  5. Run SYSmark 2014 SE.

 

SYSmark 2014 SE patch 1 Hotfix 2 v2.0.1.87 for OneNote error 10004 and Excel CloseApp on Windows 10

SYSmark 2014 SE patch 1 Hotfix 2 v2.0.1.87 for OneNote error 10004 and Excel CloseApp on Windows 10

Download “SYSmark 2014 SE patch 1 Hotfix 2 v2.0.1.87

Instructions:

1) Download to target system
2) Unzip the archive
3) Close SM14 SE if the application is open
4) Right click the extracted .exe and run as administrator

SM14 SE patch 1 v2.0.1.78 or patch 1 with hotfix 1 2.0.1.81 must be installed to apply hotfix 2. The hotfix 2 package will *not* apply to earlier versions of SM14 SE, and it will not apply to SM14 v1.5 or MM14 v1.5

After the hotfix is applied, launch SM14 SE. The new version should be reported as 2.0.1.87.

Benchmarks fail to execute with Error 1: Errorstate::Enter: unknown error code (1)

Systems with  Intel Dynamic Power and Thermal Framework (DPTF) driver version (8.4.11000.6436) may fail to execute and display Error 1: Errorstate::Enter: unknown error code (1) in the results browser.

You may encounter this issue when testing with older versions of SYSmark 2014 SE or MobileMark v1.5. If so, please visit either the SYSmark 2014 SE product page or the MobileMark 2014 v1.5 product page  to download the latest patch and hotfix for your product. Update your benchmark according the patch or hotfix instructions and reboot the system under test. You should now be able to run SYSmark 2014 SE or MobileMark 2014 v1.5 successfully.

If you are testing SYSmark 2014 v1.5, please follow these steps to work around the issue:

1) Please visit the SYSmark 2014 v1.5 product page to download and apply any patches or hotfixes to your installation.

2) Download the Dptf_Sysmark_2014_v1.5_fix  package and copy to the system under test

3) Extract the contents of the zip file

4) Right click the .reg file and choose ‘Merge’

5) Reboot the system under test

6) You should now be able to run SYSmark 2014 v1.5 successfully.

 

 

 

System information may take a long time to run

On some systems with large amounts of data in the Windows Error logs, system information may take a long time to complete. The system may appear unresponsive, but it should complete after a few minutes. To avoid this delay, clear the Windows Error logs on the system under test prior to launching SYSmark 2018 or MobileMark 2018.

SYSmark 2018 or MobileMark 2018 may fail if Windows taskbar is set to autohide

SYSmark 2018 or MobileMark 2018 may fail if the Windows taskbar is configured to autohide. Leave the taskbar default setting of always visible to avoid this problem.

SYSmark 2018 may fail if Windows Search service is disabled

Some of the applications included with SYSmark 2018 may fail to work properly if the Windows Search service is disabled. When testing with SYSmark 2018, BAPCo recommends that users run with the default setting for Windows Search service, which is set to enabled.

SYSmark 2018 error: Failed to find valid license key, please reinstall benchmark

Some users may encounter the error “Failed to find valid license key, please reinstall benchmark” when testing with SYSmark 2018 on supported non-English languages. To work around this problem, navigate to the following location in the registry:

Double click on the SM_License_Key entry and paste your license key into the ‘Value Data’ blank. Click ok to save the update. Close regedit edit and reboot the system. Once the system has rebooted, SYSmark 2018 should be working correctly.

This procedure will need to be performed for each new installation of SYSmark 2018, prior to the first launch the benchmark.

Why did my SYSmark 2018 installation expire

Some of the applications in SYSmark 2018 have licensing restrictions which cause them to expire after 7 days. SYSmark 2018 will warn the user prior to this expiration. Once the installation has expired, the system under test must be wiped completely, and a new instance of SYSmark 2018 must be installed.

SYSmark 2014 SE patch 1 hotfix 3 v2.0.1.89

The following hotfix corrects an issue that caused SYSmark 2014 SE to hang and become unresponsive when testing on some versions of Windows 10.

Download SYSmark 2014 SE patch 1 hotfix 3 v2.0.1.89

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE patch 1 (or SYSmark 2014 SE patch 1 hotfix 1 or hotfix 2) are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

SYSmark 2014 SE patch 1 v2.0.1.78 OR patch 1 hotfix 1 v2.0.1.81 OR patch 1 hotfix 2 v2.0.1.87 must be installed to apply Hotfix 3. The update will not apply to older versions of SYSmark 2014 SE.

After the hotfix is applied, launch SYSmark 2014 SE. The new version should be reported as 2.0.1.89.

SYSmark 2018 may hang when testing on configurations with disabled network adapters

SYSmark 2018 may hang when testing on configurations with disabled network adapters. To avoid this issue, BAPCo recommends that customers be sure that all network adapters on the system under test are enabled.

BAPCo will release a fix for this issue in an upcoming version of SYSmark 2018.

MobileMark 2014 patch 2 v1.5.2.64 installation hangs at ‘Enable Direct Play’

On some systems, MobileMark 2014 installation hangs when attempting to enable the direct play service and becomes unresponsive, even though the benchmark installation has completed. User experiencing this issue may work around the problem by rebooting the system to clear the installation hang. When the desktop appears, launch MobileMark 2014 and start a test.

SYSmark 2018 v1.0.0.39 hotfix 2

The following hotfix corrects an issue that caused SYSmark 2018 v1.0.0.38 hotfix 1 to incorrectly mark FDRs as invalid.

Download sm18_hotfix2_v1.0.0.39

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2018 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

SYSmark 2018 v1.0.0.37 OR SYSmark 2018 v1.0.0.38 hotfix 1 must be installed to apply hotfix 2

After the hotfix is applied, launch SYSmark 2018. The new version should be reported as 1.0.0.39.

APPmark 2018 battery run fails on Snapdragon-based Windows devices

Users may experience test failures when running an APPmark 2018 battery life test on some Snapdragon-based devices running Windows 10 April 2018 update (also known as Version 1803 or Redstone 4) or newer. The failure typically occurs after several hours of testing when the benchmark attempts to allocate memory for a workload operation and the operating system denies the request. In such cases, it should still be possible to obtain performance scores by running a 3 iteration test without the battery run checkbox selected, and it may be possible to obtain battery life results by repeatedly attempting the battery life test or reverting to an earlier version of Windows (e.g., RS3). It is possible a future update to Windows or the supporting platform software will resolve this issue, but no other workaround is currently available.

Why did my MobileMark 2018 installation expire

Some of the applications in MobileMark 2018 have licensing restrictions which cause them to expire after 7 days. MobileMark 2018 will warn the user prior to this expiration. Once the installation has expired, the system under test must be wiped completely, and a new instance of MobileMark 2018 must be installed.

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

SYSmark 2014 SE patch 1 hotfix 4 v2.0.1.91

The following hotfix corrects an issue in SYSmark 2014 SE OP and/or RE scenarios where some systems would fail to switch between applications correctly. Hotfix 4 to resolves this issue, which should improve benchmark stability on current and future CPU architectures.

Hotfix 4 is a cumulative update and includes fixes released in Hotfixes 1-3.

Download sm14se_patch1_hotfix4_v2.0.1.91

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE are closed before attempting to apply the hotfix
4) Right click the extracted .exe and run as administrator. Note, failing to run the installer as administrator may result in the hotfix failing to install correctly.

SYSmark 2014 SE patch 1 or higher must be installed to apply Hotfix 4. The update will not apply versions of SYSmark 2014 SE prior to patch 1.

After the hotfix is applied, launch SYSmark 2014 SE. The new version should be reported as 2.0.1.91.

Why does Windows 10 disable memory integrity (HVCI) when SM14, SM14 SE or MM14 are installed?

If Windows 10 detects the installation of an application that is not compatible with the memory integrity feature, Windows 10 will disable the feature in order to prevent system instability. Users may notice that memory detection has been disabled Windows 10 if they install older BAPCo benchmarks such as SYSmark 2014, SYSmark 2014 SE, or MobileMark 2014.

BAPCo recommends updating to the latest generation of SYSmark 2018  and MobileMark 2018 for users who wish to test with memory integrity enabled.

Does turning Windows Defender off affect the SYSmark performance score?

See the FAQ posted here on Windows Defender and the related Tamper Protection setting.

Does Windows Tamper Protection affect the SYSmark performance score?

Does Windows Tamper Protection affect the SYSmark performance score?

Tamper Protection can limit the ability of the SYSmark/MobileMark System Configuration Tool to modify some system settings.  Some of those settings, like disabling Windows Defender, can affect the SYSmark/MobileMark performance score.

BAPCo MobileMark 2014 patch 3 v1.5.3.72 is no longer available

BAPCo MobileMark 2014 patch 3 v1.5.3.72 is no longer available.

BAPCo has discovered an issue in MM14 patch 3 which may cause issues with system idle on systems that support Modern Standby (Connected Standby). If the issue is encountered, systems under test may not report correct results.  Customers who have downloaded patch 3 should revert back to patch 2 for testing until BAPCo is able to issue an updated fix. Patch 2 is available for download on the MobileMark 2014 product page.

 

In addition, BAPCo will no longer accept results submissions for MobileMark 2014 v1.5.3.72.

 

Contact [email protected] with any questions.

Why does error CR_Premiere_03_OpenProject_Transcode error (22008)

Error CR_Premiere_03_OpenProject_Transcode error (22008) may occur on systems that do not have updated audio drivers installed.

When testing with SYSmark 25, BAPCo recommends that all system drivers be installed and updated to the latest available version.

Adobe Premiere Pro System compatibility Report warning

When testing with SYSmark 25, some users may encounter a System Compatibility Report dialog in Adobe Premiere Pro. This warning appears when the graphics driver installed on the system under test does not fully support the capabilities of Adobe Premiere Pro in SYSmark 25. To avoid this warning, please update to the latest publicly available graphics driver for the system under test.

Does SYSmark 25 support uninstallation?

SYSmark 25 can be uninstalled from Add/Remove programs in Windows 10. However, the uninstaller is not able to remove the DRM signatures placed on disk by some of the applications distributed with SYSmark 25.

BAPCo recommends that users make a back up of the system image prior to installation of SYSmark 25. After testing is complete, restore the back up, or install a clean image to the target drive to avoid issues with application DRM.

Do SYSmark 25 installations expire?

SYSmark 25 installations will expire 30 days after the first run of the benchmark, as per the licensing agreement between the application vendors and BAPCo.

Users should be sure that system time and date are correct before installing SYSmark 25. Do not attempt to change the system time and date once SYSmark 25 is installed, as it may trigger application DRM and immediately expire the installation.

Adobe Lightroom error: 20010 Import(): The Choose Source Folder window did not appear

Although SYSmark 25 has been engineered to disable network connections while the test is running, this error may occur on some configurations when the system under test has been connected to a wireless network. If this error occurs, and the system under test happens to be connected to a wireless network, please disconnect from the wireless network and attempt to run again.

Windows 10 version 19H2 version reporting in BAPCo benchmark results

With the release of Windows 10 19H2, Microsoft made a change to the mechanism used for Windows 10 version reporting.

Current generation BAPCo products have been updated (SYSmark 2018 fix will be included in the upcoming patch 3) to report the OS version correctly. However, customers with down-level versions of BAPCo benchmarks may find that in some cases, Windows 10 19H2 will be reported as Windows 10 19H1.

BAPCo encourages customers to always update to the latest patch for their product. Please see the product page on the BAPCo website for the latest updates for your benchmark product.

Why are my scores lower with Windows 10 build 20H1 (19041.450)

Microsoft recently released an update to Windows 10’s Microsoft Defender application which makes it impossible to permanently disable the Microsoft Defender Antivirus protection service. This change appears in Windows 10 build 20H1 (19041.450), and is part of KB4052623. As per the Microsoft documentation, this setting is no longer necessary, as Defender will automatically disable itself if third party AntiVirus software is installed on the system.

Customers running BAPCo benchmarks on Windows 10 build 20H1 (19041.450) may notice a negative impact to benchmark scores as a consequence of this update.

BAPCo is also investigating a known issue with Windows 10 build 20H1 (19041.450), in which the PDF results file may incorrectly report the state of Microsoft Defender as disabled.

How to disable Microsoft Defender in Windows 10 build 20H1 (19041.450)

Windows 10 build 20H1 (19041.450) introduced a change that prevents the user from permanently disabling Microsoft Defender. The inability to disable Microsoft Defender may negatively impact scores when running BAPCo benchmarks. Microsoft has provided documentation for users that may wish to roll back their instance of Microsoft Defender to a previous version.

Where are the benchmark results located?

This FAQ applies to SYSmark 25, MobileMark 2018, and SYSmark 2018.

Upon completion of a benchmark run, a folder called ‘Results’ is created on the desktop, and the output from the run will deposited into a subfolder that matches the project name. For example, if the project is ‘My Project’ the output folder will be on the desktop under ‘../Results/My Project/’.

Need additional help?

Support
Maximum upload size: 26.21MB
Sending
Share BAPCo content