BAPCo Knowledgebase

BAPCo provides full support on the latest versions of its products (SYSmark 2018, APPmark, TabletMark 2017, MobileMark 2014 v1.5, SYSmark 2014 sE).

All other products continue to receive limited support through BAPCo website and email support for incidences which have a known solution.

For all publication, evaluation, testing and tendering purposes BAPCo strongly recommends using the results from the latest version of all its products. Users wishing to continue to use older products (with limited support) should be aware that it may not be possible to obtain results from all systems and that BAPCo’s solutions to incident reports may require users to upgrade. BAPCo strongly recommends customers to consider SYSmark 2014 for all Windows 8+ based system requirements. BAPCo stopped support on SYSmark 2007 as of October 13th, 2014. Customers who would like to continue using SYSmark 2007 may wish to consider both SYSmark 2007 and SYSmark 2014 scores for a better representation of system performance. OEMs stopped providing Windows 7 driver support on all latest systems and that may affect the overall SYSmark 2007 scores.

Product patches downloaded or revisions integrated into updated DVD media are not expected to materially change the performance of a platform compared to that of any previous patch or version number; as such results generated with the newest patch or version are currently considered by BAPCo to be comparable with results generated with any previous patches for the given product series.

Search BAPCo Support

SYSmark 2018

Benchmarking on Windows 10 19H1 with Tamper protection setting

Since the release of Windows 10 19H1 (build 18362) some users have experienced issues when attempting to test with SYSmark 2018, MobileMark 2018, SYSmark 2014 SE, SYSmark 2014 v1.5, or MobileMark 2014 v1.5. These issues are related to the new Windows Security setting called ‘Tamper Protection’. Microsoft implemented the Tamper Protection setting to prevent third party applications from disabling certain system security settings without the user’s direct knowledge. If Tamper Protection is enabled, the system configuration tool integrated with BAPCo products may fail to apply the ‘Disable Windows Defender’ setting, and the benchmark will error out.

See the procedures below for testing with Tamper Protection on/off.

Note: When Tamper Protection is enabled, users may notice a decrease in benchmark performance scores.

Testing with Tamper Protection ON

  1. Launch the benchmark interface.
  2. Open the system config tool in settings and uncheck the ‘Disable Windows Defender’ configuration setting.
  3. Save the new configuration profile
  4. Run benchmark

Testing with Tamper Protection OFF

  1. Close any instances of the benchmark interface
  2. In the Windows 10 GUI, navigate to:
  3. Settings>Updates & Security>Windows Security>Virus & threat protection
  4. Scroll down to find the toggle for Tamper Protection and move it to the ‘Off’ position.
  5. Run benchmark.
How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

SYSmark 2018 v1.0.0.39 hotfix 2

The following hotfix corrects an issue that caused SYSmark 2018 v1.0.0.38 hotfix 1 to incorrectly mark FDRs as invalid.

Download sm18_hotfix2_v1.0.0.39

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2018 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

SYSmark 2018 v1.0.0.37 OR SYSmark 2018 v1.0.0.38 hotfix 1 must be installed to apply hotfix 2

After the hotfix is applied, launch SYSmark 2018. The new version should be reported as 1.0.0.39.

Read More

APPmark 2018

APPmark 2018 battery run fails on Snapdragon-based Windows devices

Users may experience test failures when running an APPmark 2018 battery life test on some Snapdragon-based devices running Windows 10 April 2018 update (also known as Version 1803 or Redstone 4) or newer. The failure typically occurs after several hours of testing when the benchmark attempts to allocate memory for a workload operation and the operating system denies the request. In such cases, it should still be possible to obtain performance scores by running a 3 iteration test without the battery run checkbox selected, and it may be possible to obtain battery life results by repeatedly attempting the battery life test or reverting to an earlier version of Windows (e.g., RS3). It is possible a future update to Windows or the supporting platform software will resolve this issue, but no other workaround is currently available.

Read More

Mobilemark 2018

Benchmarking on Windows 10 19H1 with Tamper protection setting

Since the release of Windows 10 19H1 (build 18362) some users have experienced issues when attempting to test with SYSmark 2018, MobileMark 2018, SYSmark 2014 SE, SYSmark 2014 v1.5, or MobileMark 2014 v1.5. These issues are related to the new Windows Security setting called ‘Tamper Protection’. Microsoft implemented the Tamper Protection setting to prevent third party applications from disabling certain system security settings without the user’s direct knowledge. If Tamper Protection is enabled, the system configuration tool integrated with BAPCo products may fail to apply the ‘Disable Windows Defender’ setting, and the benchmark will error out.

See the procedures below for testing with Tamper Protection on/off.

Note: When Tamper Protection is enabled, users may notice a decrease in benchmark performance scores.

Testing with Tamper Protection ON

  1. Launch the benchmark interface.
  2. Open the system config tool in settings and uncheck the ‘Disable Windows Defender’ configuration setting.
  3. Save the new configuration profile
  4. Run benchmark

Testing with Tamper Protection OFF

  1. Close any instances of the benchmark interface
  2. In the Windows 10 GUI, navigate to:
  3. Settings>Updates & Security>Windows Security>Virus & threat protection
  4. Scroll down to find the toggle for Tamper Protection and move it to the ‘Off’ position.
  5. Run benchmark.
How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

Why did my MobileMark 2018 installation expire

Some of the applications in MobileMark 2018 have licensing restrictions which cause them to expire after 7 days. MobileMark 2018 will warn the user prior to this expiration. Once the installation has expired, the system under test must be wiped completely, and a new instance of MobileMark 2018 must be installed.

Read More

TabletMark

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer.  Using incorrect drivers could result in significantly reduced performance.

How do I submit TabletMark results to BAPCo.com?

At the completion of a successful run of TabletMark, results can be submitted to BAPCo.com from the results browser. Select the result to be submitted, then press the ‘submit’ icon. Note that the test system must be connected to the Internet for BAPCo.com to import the submission.

Where can I get TabletMark v3 for sideloading on my device?

TabletMark v3 packages are made available for sideloading on the TabletMark v3 product page. Sideloadable packages for Andriod, Windows, and iOS are available at the bottom of the page. Click the green ‘Download’ button next to the package you wish to download.

Read More

SYSmark 2014 SE

Why does Windows 10 disable memory integrity (HVCI) when SM14, SM14 SE or MM14 are installed?

If Windows 10 detects the installation of an application that is not compatible with the memory integrity feature, Windows 10 will disable the feature in order to prevent system instability. Users may notice that memory detection has been disabled Windows 10 if they install older BAPCo benchmarks such as SYSmark 2014, SYSmark 2014 SE, or MobileMark 2014.

BAPCo recommends updating to the latest generation of SYSmark 2018  and MobileMark 2018 for users who wish to test with memory integrity enabled.

Benchmarking on Windows 10 19H1 with Tamper protection setting

Since the release of Windows 10 19H1 (build 18362) some users have experienced issues when attempting to test with SYSmark 2018, MobileMark 2018, SYSmark 2014 SE, SYSmark 2014 v1.5, or MobileMark 2014 v1.5. These issues are related to the new Windows Security setting called ‘Tamper Protection’. Microsoft implemented the Tamper Protection setting to prevent third party applications from disabling certain system security settings without the user’s direct knowledge. If Tamper Protection is enabled, the system configuration tool integrated with BAPCo products may fail to apply the ‘Disable Windows Defender’ setting, and the benchmark will error out.

See the procedures below for testing with Tamper Protection on/off.

Note: When Tamper Protection is enabled, users may notice a decrease in benchmark performance scores.

Testing with Tamper Protection ON

  1. Launch the benchmark interface.
  2. Open the system config tool in settings and uncheck the ‘Disable Windows Defender’ configuration setting.
  3. Save the new configuration profile
  4. Run benchmark

Testing with Tamper Protection OFF

  1. Close any instances of the benchmark interface
  2. In the Windows 10 GUI, navigate to:
  3. Settings>Updates & Security>Windows Security>Virus & threat protection
  4. Scroll down to find the toggle for Tamper Protection and move it to the ‘Off’ position.
  5. Run benchmark.
SYSmark 2014 SE patch 1 hotfix 4 v2.0.1.91

The following hotfix corrects an issue in SYSmark 2014 SE OP and/or RE scenarios where some systems would fail to switch between applications correctly. Hotfix 4 to resolves this issue, which should improve benchmark stability on current and future CPU architectures.

Hotfix 4 is a cumulative update and includes fixes released in Hotfixes 1-3.

Download sm14se_patch1_hotfix4_v2.0.1.91

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE are closed before attempting to apply the hotfix
4) Right click the extracted .exe and run as administrator. Note, failing to run the installer as administrator may result in the hotfix failing to install correctly.

SYSmark 2014 SE patch 1 or higher must be installed to apply Hotfix 4. The update will not apply versions of SYSmark 2014 SE prior to patch 1.

After the hotfix is applied, launch SYSmark 2014 SE. The new version should be reported as 2.0.1.91.

Read More

SYSmark 2014

Why does Windows 10 disable memory integrity (HVCI) when SM14, SM14 SE or MM14 are installed?

If Windows 10 detects the installation of an application that is not compatible with the memory integrity feature, Windows 10 will disable the feature in order to prevent system instability. Users may notice that memory detection has been disabled Windows 10 if they install older BAPCo benchmarks such as SYSmark 2014, SYSmark 2014 SE, or MobileMark 2014.

BAPCo recommends updating to the latest generation of SYSmark 2018  and MobileMark 2018 for users who wish to test with memory integrity enabled.

Benchmarking on Windows 10 19H1 with Tamper protection setting

Since the release of Windows 10 19H1 (build 18362) some users have experienced issues when attempting to test with SYSmark 2018, MobileMark 2018, SYSmark 2014 SE, SYSmark 2014 v1.5, or MobileMark 2014 v1.5. These issues are related to the new Windows Security setting called ‘Tamper Protection’. Microsoft implemented the Tamper Protection setting to prevent third party applications from disabling certain system security settings without the user’s direct knowledge. If Tamper Protection is enabled, the system configuration tool integrated with BAPCo products may fail to apply the ‘Disable Windows Defender’ setting, and the benchmark will error out.

See the procedures below for testing with Tamper Protection on/off.

Note: When Tamper Protection is enabled, users may notice a decrease in benchmark performance scores.

Testing with Tamper Protection ON

  1. Launch the benchmark interface.
  2. Open the system config tool in settings and uncheck the ‘Disable Windows Defender’ configuration setting.
  3. Save the new configuration profile
  4. Run benchmark

Testing with Tamper Protection OFF

  1. Close any instances of the benchmark interface
  2. In the Windows 10 GUI, navigate to:
  3. Settings>Updates & Security>Windows Security>Virus & threat protection
  4. Scroll down to find the toggle for Tamper Protection and move it to the ‘Off’ position.
  5. Run benchmark.
How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

Read More

MobileMark 2014

Why does Windows 10 disable memory integrity (HVCI) when SM14, SM14 SE or MM14 are installed?

If Windows 10 detects the installation of an application that is not compatible with the memory integrity feature, Windows 10 will disable the feature in order to prevent system instability. Users may notice that memory detection has been disabled Windows 10 if they install older BAPCo benchmarks such as SYSmark 2014, SYSmark 2014 SE, or MobileMark 2014.

BAPCo recommends updating to the latest generation of SYSmark 2018  and MobileMark 2018 for users who wish to test with memory integrity enabled.

Benchmarking on Windows 10 19H1 with Tamper protection setting

Since the release of Windows 10 19H1 (build 18362) some users have experienced issues when attempting to test with SYSmark 2018, MobileMark 2018, SYSmark 2014 SE, SYSmark 2014 v1.5, or MobileMark 2014 v1.5. These issues are related to the new Windows Security setting called ‘Tamper Protection’. Microsoft implemented the Tamper Protection setting to prevent third party applications from disabling certain system security settings without the user’s direct knowledge. If Tamper Protection is enabled, the system configuration tool integrated with BAPCo products may fail to apply the ‘Disable Windows Defender’ setting, and the benchmark will error out.

See the procedures below for testing with Tamper Protection on/off.

Note: When Tamper Protection is enabled, users may notice a decrease in benchmark performance scores.

Testing with Tamper Protection ON

  1. Launch the benchmark interface.
  2. Open the system config tool in settings and uncheck the ‘Disable Windows Defender’ configuration setting.
  3. Save the new configuration profile
  4. Run benchmark

Testing with Tamper Protection OFF

  1. Close any instances of the benchmark interface
  2. In the Windows 10 GUI, navigate to:
  3. Settings>Updates & Security>Windows Security>Virus & threat protection
  4. Scroll down to find the toggle for Tamper Protection and move it to the ‘Off’ position.
  5. Run benchmark.
How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

Read More

 

MobileMark 2012

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer.  Using incorrect drivers could result in significantly reduced performance.

How do I configure a non-English OS installation for use with BAPCo SYSMark or MobileMark?

For testing on Non-Engish OS, SYSmark 2018 and MobileMark 2018 installers will configure the system correctly for the supported languages, provided the operating system is installed in a supported language, i.e., German.

SYSmark and MobileMark support seven Non-English languages. Download the .pdf for the target language and follow the instructions to configure the operating system.

 

What is the correct DPI scaling setting for MobileMark 2012?

MobileMark 2012 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.

Read More

EEcoMark v2

Can the Controller support more than one UUT?

A given Controller system may be used with several UUT systems. However, the Controller can only be connected to and interact with one UUT at a time.

Is a meter required to run the benchmark?

No. EEcoMark v2 can be run without a power meter by selecting the ‘null meter’ option when setting up the test parameters in the Controller GUI. However, when selecting the ‘null meter’ option, power data readings are simulated and will not reflect the actual energy consumption of the system.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

Read More

Need additional help?

Support
Drop a file here or click to upload Choose File
Maximum upload size: 2.1MB
Sending