SYSmark 2014

Do SYSmark® 2014 installations expire after a certain period?

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010, will expire 30 days after installation. Once the applications have expired, the HDD containing the SYSmark® 2014 installation must be reimaged with a new copy of the operating system, and a new instance of SYSmark® 2014 must be installed.

Does SYSmark® 2014 support foreign languages?

Yes. Support for non-English languages include French, German, Spanish, Portuguese (Brazilian), Russian, Japanese, and Chinese (Simplified) with SYSmark® 2014 Patch 1 installed.

Does SYSmark® 2014 support installation on partitions other than the C:\ drive?

No. SYSmark® 2014 must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, SYSmark® 2014 tests must be executed from the same account that was used to install the benchmark.

Can the test system be connected to the Internet?

Test systems with SYSmark® 2014 installed should not be connected to the Internet. Some applications installed as part of SYSmark® 2014 may be deactivated and cause the benchmark to fail if an Internet connection is detected.

Does SYSmark® 2014 support installation from external USB devices?

Yes. SYSmark® 2014 is distributed on USB media as well as DVD media. To install from the USB media distributed by BAPCo, simply plug the USB key into an open USB port on the target system. Locate the SYSmark2014_setup.exe file and double click to begin installation. The files on DVD media can also be installed from external media such as USB HDD or memory keys. Follow the steps below to install from external USB media. At least 50GB of free space is required.

  • Create a new folder
  • Copy the contents of DVD 1 into the newly created folder
  • Copy the contents of DVD 2 into the same folder as the contents from DVD 1
  • The folder should now contain the following: Apps, Apps2, Data, Data2, Setup, Setup2, Autorun.inf, BAPCo.ico, and SYSmark2014_Setup.exe
  • Install the benchmark by launching SYSmark2014_Setup.exe from the GUI, or on the command line
Does SYSmark® 2014 support uninstallation?

No. At this time SYSmark® 2014 does not support uninstallation. BAPCo strongly recommends making a backup of the test system image prior to installtion of SYSmark® 2014. Once testing is complete, BAPCo recommends performing a full image recovery on the test system.

SYSmark® 2014 completed successfully and reported scores, why is there an error folder included with the results?

An error folder included with the results of a SYSmark® 2014 run indicates that one or more of the scenarios in that project encountered a problem. In such cases, SYSmark® 2014 will attempt to retry the scenario a default maximum of 5 times. The retry maximum is can be customized on the command line using -r or –retries. Setting the value to “0” will disable the retry feature and SYSmark® will halt if an error is encountered.

Why does SYSmark® 2014 sometimes report lower scores on the first iteration of a multiple iteration project?

The Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as SYSmark® is running while Windows caching and pre-fetching is in progress.

What is the purpose of the Conditioning Run?

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. The Conditioning Run is selected by default, and the iteration will be executed at the beginning of a project. Results from the Conditioning Run are not included in the project scoring.

Which operating system languages does SYSmark® 2014 support?

At this time, SYSmark® 2014 supports installation on US English. Additional language support may be added in future releases. Check the SYSmark® 2014 FAQ online for the latest information.

How long does SYSmark® 2014 installation take?

Installation time for SYSmark® 2014 takes approximately 45 minutes. Installation time may vary based on the target system configuration.

How long does it take to complete one full iteration of SYSmark® 2014?

Running one full iteration of SYSmark® 2014 takes approximately 1 hour on the reference system. The time to complete a full iteration may vary depending on the the configuration of the system being tested.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

Is Windows 8/8.1 activation required for running SYSmark® 2014?

Windows 8/8.1 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with SYSmark 2014 tests. There are three ways to prevent this interference:

  • Activate the Windows 8/8.1 installation using a retail license key.
  • Activate the Windows 8/8.1 installation using a Key Management Server. Note, this option is only available for Windows 8/8.1 Enterprise edition
  • Enable Windows 8/8.1 Test Mode
  • Launch the “regedit” application
  • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
  • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”
What is the correct DPI scaling setting for SYSmark® 2014?

SYSmark® 2014 should be run with the DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause SYSmark® 2014 to report ‘screen resolution mismatch’ error and halt the test.

Where can I find documentation on SYSmark 2014?

SYSmark 2014 documentation is located on the SYSmark 2014 product page here.

Hotfix for Error 1010: Security check failed while hashing files

Please note: The below “Error 1010” Hotfix does not apply to versions 1.5.x.x

Download Hotfix for error 1010

Instructions:

1) MobileMark 2014 patch 2 or SYSmark 2014 patch 2 must be installed to use this hotfix.

2) Download and extract the above zip file to the test system where error 1010 occurred.

3) If any SYSmark 2014 or MobileMark 2014 windows remain open, close them before attempting to apply the hotfix.

4) Right click the ‘Hotfix_for_Error_1010.exe’ file that you extracted from the zip and choose ‘Run as Administrator’.

5) The package will launch a command prompt window.

6) Follow the prompts to apply the hotfix.

7) Upon successful completion, press any key to close the command window. You may now attempt to run SM14 or MM14, and should no longer see error 1010.

Note: This fix applies only SM14 and MM14 patch 2. If the hotfix package cannot detect the SM14 or MM14 installation, it will exit.

MobileMark 2014 ver 1.5 or SYSmark 2014 ver 1.5 has error OP_Acrobat_02_StartApp.exe/StartAcrobat (15008) on Windows 10 November update

Note: SYSmark 2014 v1.5 and MobileMark 2014 v1.5 with patch 1 installed no longer need this hotfix. Please download patch 1 from the product page.

 

The November update to Windows 10 may cause an error with Adobe Acrobat when running MobileMark 2014 ver 1.5 or SYSmark 2014 ver 1.5. Please download the following .zip archive Hotfix_for_default_PDF_reader.

  1. Extract the zip file to a directory
  2. Copy the self-extracting executable from the .zip to the test system
  3. Be sure all SYSmark/MobileMark windows and applications are closed
  4. Right click the executable and choose ‘Run as administrator’
  5. Follow the prompts to apply the hotfix.
  6. Once the hotfix completes, run the benchmark test.
Work around for SYSmark 2014 error 10014

The following work around is for Intel vPro equipped systems with the Intel Management and Security app installed which are failing with the following error:

OP_OneNote_05_Email.exe/SendToEmail (10014) SendToEmail: Failed to close outlook window (10014)

  1. Open the Intel Management and Security app by right clicking on the icon in the systray
  2. Uncheck the item labeled ‘enable user notification’
  3. Uncheck the item labeled ‘Intel Management and Security status will be available the next time I log on to Windows’
  4. Close the app
  5. Reboot
  6. Run SYSmark 2014

 

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer.  Using incorrect drivers could result in significantly reduced performance.

Does SYSmark® 2014 SE support installation from external USB devices?

Yes. SYSmark® 2014 SE is distributed on USB media as well as DVD media. To install from the USB media distributed by BAPCo, simply plug the USB key into an open USB port on the target system. Locate the SYSmark2014SE_setup.exe file and double click to begin installation. The files on DVD media can also be installed from external media such as USB HDD or memory keys. Follow the steps below to install from external USB media. At least 30GB of free space is required on the target media.

  • Create a new folder
  • Copy the contents of DVD 1 into the newly created folder
  • Copy the contents of DVD 2 into the same folder as the contents from DVD 1
  • The folder should now contain the following: Apps, Apps2, Data, Data2, Setup, Setup2, Autorun.inf, BAPCo.ico, and SYSmark2014SE_Setup.exe
  • Install the benchmark by launching SYSmark2014SE_Setup.exe from the GUI, or on the command line
Evaluating systems with NVMe devices

NVMe configurations: NVMe devices may show lower than expected performance in some

configurations due to the way Force Unit Access (FUA) write requests are handled by the

Windows operating system. Therefore, BAPCo recommends that users install the storage driver

provided by the manufacturer of their NVMe device. In cases where the manufacturer does not

provide an NVMe driver, users may disable the ‘Windows Write cache buffer flushing’ setting on

the NVMe drive prior to testing.

SYSmark 2014 v1.5 on RS3, Error 1008: System Config failed with return code -1

Some users may encounter Error 1008: System Config failed with return code -1 when testing SYSmark 2014 v1.5 when testing on Windows 10 Redstone 3.

This manual work around has been replaced by the following Hotfix.

Download “SYSmark 2014 ver 1.5 patch 1, hotfix 1 v1.5.1.85 (config tool error under RS3)
Instructions:

  1. Download to target system
  2. Unzip the archive
  3. Close SM14 v1.5 if the application is open
  4. Right click the .exe and run as administrator

SYSmark 2014 v1.5 patch 1 must be installed to apply hotfix 1. The update will not apply to older versions of SYSmark 2014 v1.5. After the hotfix is applied, launch SM14 v1.5. The new version should be reported as 1.5.1.85.

 

Need additional help?

Support
Drop a file here or click to upload Choose File
Maximum upload size: 2.1MB
Sending