BAPCo Knowledgebase

BAPCo provides full support on the latest versions of its products (SYSmark 2018, APPmark, TabletMark 2017, MobileMark 2014 v1.5, SYSmark 2014 sE).

All other products continue to receive limited support through BAPCo website and email support for incidences which have a known solution.

For all publication, evaluation, testing and tendering purposes BAPCo strongly recommends using the results from the latest version of all its products. Users wishing to continue to use older products (with limited support) should be aware that it may not be possible to obtain results from all systems and that BAPCo’s solutions to incident reports may require users to upgrade. BAPCo strongly recommends customers to consider SYSmark 2014 for all Windows 8+ based system requirements. BAPCo stopped support on SYSmark 2007 as of October 13th, 2014. Customers who would like to continue using SYSmark 2007 may wish to consider both SYSmark 2007 and SYSmark 2014 scores for a better representation of system performance. OEMs stopped providing Windows 7 driver support on all latest systems and that may affect the overall SYSmark 2007 scores.

Product patches downloaded or revisions integrated into updated DVD media are not expected to materially change the performance of a platform compared to that of any previous patch or version number; as such results generated with the newest patch or version are currently considered by BAPCo to be comparable with results generated with any previous patches for the given product series.

Search BAPCo Support

SYSmark 2018

Does Windows Tamper Protection affect the SYSmark performance score?

Tamper Protection can limit the ability of the SYSmark System Configuration Tool to modify some system settings.  Some of those settings, like disabling Windows Defender, can affect the SYSmark performance score.

Does turning Windows Defender off affect the SYSmark performance score?

Starting with Windows 10 May 2019 Update (version 1903), the SYSmark  performance score can be over 10% higher when Windows Defender is turned off.  To address this, BAPCo is making two changes to SYSmark in upcoming patches.  First, we will document the status of Windows Defender in the results PDF file.  Second, we will change the default behavior of the SYSmark System Configuration Tool to not disable Windows Defender.  You can still optionally disable it if you want.

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

Read More

APPmark 2018

APPmark 2018 battery run fails on Snapdragon-based Windows devices

Users may experience test failures when running an APPmark 2018 battery life test on some Snapdragon-based devices running Windows 10 April 2018 update (also known as Version 1803 or Redstone 4) or newer. The failure typically occurs after several hours of testing when the benchmark attempts to allocate memory for a workload operation and the operating system denies the request. In such cases, it should still be possible to obtain performance scores by running a 3 iteration test without the battery run checkbox selected, and it may be possible to obtain battery life results by repeatedly attempting the battery life test or reverting to an earlier version of Windows (e.g., RS3). It is possible a future update to Windows or the supporting platform software will resolve this issue, but no other workaround is currently available.

Read More

Mobilemark 2018

Does Windows Tamper Protection affect the SYSmark performance score?

Tamper Protection can limit the ability of the SYSmark System Configuration Tool to modify some system settings.  Some of those settings, like disabling Windows Defender, can affect the SYSmark performance score.

Does turning Windows Defender off affect the SYSmark performance score?

Starting with Windows 10 May 2019 Update (version 1903), the SYSmark  performance score can be over 10% higher when Windows Defender is turned off.  To address this, BAPCo is making two changes to SYSmark in upcoming patches.  First, we will document the status of Windows Defender in the results PDF file.  Second, we will change the default behavior of the SYSmark System Configuration Tool to not disable Windows Defender.  You can still optionally disable it if you want.

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Microsoft provides a tool for removing Office installations. Please use this tool prior to installing any BAPCo benchmark on systems where Office is preinstalled.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

 

Read More

TabletMark

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer.  Using incorrect drivers could result in significantly reduced performance.

How do I submit TabletMark results to BAPCo.com?

At the completion of a successful run of TabletMark, results can be submitted to BAPCo.com from the results browser. Select the result to be submitted, then press the ‘submit’ icon. Note that the test system must be connected to the Internet for BAPCo.com to import the submission.

Where can I get TabletMark v3 for sideloading on my device?

TabletMark v3 packages are made available for sideloading on the TabletMark v3 product page. Sideloadable packages for Andriod, Windows, and iOS are available at the bottom of the page. Click the green ‘Download’ button next to the package you wish to download.

Read More

SYSmark 2014 SE

Does Windows Tamper Protection affect the SYSmark performance score?

Tamper Protection can limit the ability of the SYSmark System Configuration Tool to modify some system settings.  Some of those settings, like disabling Windows Defender, can affect the SYSmark performance score.

Does turning Windows Defender off affect the SYSmark performance score?

Starting with Windows 10 May 2019 Update (version 1903), the SYSmark  performance score can be over 10% higher when Windows Defender is turned off.  To address this, BAPCo is making two changes to SYSmark in upcoming patches.  First, we will document the status of Windows Defender in the results PDF file.  Second, we will change the default behavior of the SYSmark System Configuration Tool to not disable Windows Defender.  You can still optionally disable it if you want.

Why does Windows 10 disable memory integrity (HVCI) when SM14, SM14 SE or MM14 are installed?

If Windows 10 detects the installation of an application that is not compatible with the memory integrity feature, Windows 10 will disable the feature in order to prevent system instability. Users may notice that memory detection has been disabled Windows 10 if they install older BAPCo benchmarks such as SYSmark 2014, SYSmark 2014 SE, or MobileMark 2014.

BAPCo recommends updating to the latest generation of SYSmark 2018  and MobileMark 2018 for users who wish to test with memory integrity enabled.

Read More

SYSmark 2014

Does Windows Tamper Protection affect the SYSmark performance score?

Tamper Protection can limit the ability of the SYSmark System Configuration Tool to modify some system settings.  Some of those settings, like disabling Windows Defender, can affect the SYSmark performance score.

Does turning Windows Defender off affect the SYSmark performance score?

Starting with Windows 10 May 2019 Update (version 1903), the SYSmark  performance score can be over 10% higher when Windows Defender is turned off.  To address this, BAPCo is making two changes to SYSmark in upcoming patches.  First, we will document the status of Windows Defender in the results PDF file.  Second, we will change the default behavior of the SYSmark System Configuration Tool to not disable Windows Defender.  You can still optionally disable it if you want.

Why does Windows 10 disable memory integrity (HVCI) when SM14, SM14 SE or MM14 are installed?

If Windows 10 detects the installation of an application that is not compatible with the memory integrity feature, Windows 10 will disable the feature in order to prevent system instability. Users may notice that memory detection has been disabled Windows 10 if they install older BAPCo benchmarks such as SYSmark 2014, SYSmark 2014 SE, or MobileMark 2014.

BAPCo recommends updating to the latest generation of SYSmark 2018  and MobileMark 2018 for users who wish to test with memory integrity enabled.

Read More

MobileMark 2014

BAPCo MobileMark 2014 patch 3 v1.5.3.72 is no longer available

BAPCo MobileMark 2014 patch 3 v1.5.3.72 is no longer available.

BAPCo has discovered an issue in MM14 patch 3 which may cause issues with system idle on systems that support Modern Standby (Connected Standby). If the issue is encountered, systems under test may not report correct results.  Customers who have downloaded patch 3 should revert back to patch 2 for testing until BAPCo is able to issue an updated fix. Patch 2 is available for download on the MobileMark 2014 product page.

 

In addition, BAPCo will no longer accept results submissions for MobileMark 2014 v1.5.3.72.

 

Contact support@bapco.com with any questions.

Does Windows Tamper Protection affect the SYSmark performance score?

Tamper Protection can limit the ability of the SYSmark System Configuration Tool to modify some system settings.  Some of those settings, like disabling Windows Defender, can affect the SYSmark performance score.

Does turning Windows Defender off affect the SYSmark performance score?

Starting with Windows 10 May 2019 Update (version 1903), the SYSmark  performance score can be over 10% higher when Windows Defender is turned off.  To address this, BAPCo is making two changes to SYSmark in upcoming patches.  First, we will document the status of Windows Defender in the results PDF file.  Second, we will change the default behavior of the SYSmark System Configuration Tool to not disable Windows Defender.  You can still optionally disable it if you want.

Read More

 

MobileMark 2012

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer.  Using incorrect drivers could result in significantly reduced performance.

How do I configure a non-English OS installation for use with BAPCo SYSMark or MobileMark?

For testing on Non-Engish OS, SYSmark 2018 and MobileMark 2018 installers will configure the system correctly for the supported languages, provided the operating system is installed in a supported language, i.e., German.

SYSmark and MobileMark support seven Non-English languages. Download the .pdf for the target language and follow the instructions to configure the operating system.

 

What is the correct DPI scaling setting for MobileMark 2012?

MobileMark 2012 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.

Read More

EEcoMark v2

Can the Controller support more than one UUT?

A given Controller system may be used with several UUT systems. However, the Controller can only be connected to and interact with one UUT at a time.

Is a meter required to run the benchmark?

No. EEcoMark v2 can be run without a power meter by selecting the ‘null meter’ option when setting up the test parameters in the Controller GUI. However, when selecting the ‘null meter’ option, power data readings are simulated and will not reflect the actual energy consumption of the system.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

Read More

Need additional help?

Support
Maximum upload size: 2.1MB
Sending