BAPCo Knowledgebase
BAPCo provides full support on the latest versions of its products (SYSmark 2018, APPmark, TabletMark 2017, MobileMark 2014 v1.5, SYSmark 2014 sE).
All other products continue to receive limited support through BAPCo website and email support for incidences which have a known solution.
For all publication, evaluation, testing and tendering purposes BAPCo strongly recommends using the results from the latest version of all its products. Users wishing to continue to use older products (with limited support) should be aware that it may not be possible to obtain results from all systems and that BAPCo’s solutions to incident reports may require users to upgrade. BAPCo strongly recommends customers to consider SYSmark 2014 for all Windows 8+ based system requirements. BAPCo stopped support on SYSmark 2007 as of October 13th, 2014. Customers who would like to continue using SYSmark 2007 may wish to consider both SYSmark 2007 and SYSmark 2014 scores for a better representation of system performance. OEMs stopped providing Windows 7 driver support on all latest systems and that may affect the overall SYSmark 2007 scores.
Product patches downloaded or revisions integrated into updated DVD media are not expected to materially change the performance of a platform compared to that of any previous patch or version number; as such results generated with the newest patch or version are currently considered by BAPCo to be comparable with results generated with any previous patches for the given product series.
Search BAPCo Support
SYSmark 2018
The following hotfix corrects an issue that caused SYSmark 2018 v1.0.0.38 hotfix 1 to incorrectly mark FDRs as invalid.
Download sm18_hotfix2_v1.0.0.39
Instructions:
1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2018 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator
SYSmark 2018 v1.0.0.37 OR SYSmark 2018 v1.0.0.38 hotfix 1 must be installed to apply hotfix 2
After the hotfix is applied, launch SYSmark 2018. The new version should be reported as 1.0.0.39.
SYSmark 2018 may hang when testing on configurations with disabled network adapters. To avoid this issue, BAPCo recommends that customers be sure that all network adapters on the system under test are enabled.
BAPCo will release a fix for this issue in an upcoming version of SYSmark 2018.
Some of the applications in SYSmark 2018 have licensing restrictions which cause them to expire after 7 days. SYSmark 2018 will warn the user prior to this expiration. Once the installation has expired, the system under test must be wiped completely, and a new instance of SYSmark 2018 must be installed.
APPmark 2018
Users may experience test failures when running an APPmark 2018 battery life test on some Snapdragon-based devices running Windows 10 April 2018 update (also known as Version 1803 or Redstone 4) or newer. The failure typically occurs after several hours of testing when the benchmark attempts to allocate memory for a workload operation and the operating system denies the request. In such cases, it should still be possible to obtain performance scores by running a 3 iteration test without the battery run checkbox selected, and it may be possible to obtain battery life results by repeatedly attempting the battery life test or reverting to an earlier version of Windows (e.g., RS3). It is possible a future update to Windows or the supporting platform software will resolve this issue, but no other workaround is currently available.
TabletMark
When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer. Using incorrect drivers could result in significantly reduced performance.
TabletMark v3 packages are made available for sideloading on the TabletMark v3 product page. Sideloadable packages for Andriod, Windows, and iOS are available at the bottom of the page. Click the green ‘Download’ button next to the package you wish to download.
SYSmark 2014 SE
The following hotfix corrects an issue that caused SYSmark 2014 SE to hang and become unresponsive when testing on some versions of Windows 10.
Download SYSmark 2014 SE patch 1 hotfix 3 v2.0.1.89
Instructions:
1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE patch 1 (or SYSmark 2014 SE patch 1 hotfix 1 or hotfix 2) are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator
SYSmark 2014 SE patch 1 v2.0.1.78 OR patch 1 hotfix 1 v2.0.1.81 OR patch 1 hotfix 2 v2.0.1.87 must be installed to apply Hotfix 3. The update will not apply to older versions of SYSmark 2014 SE.
After the hotfix is applied, launch SYSmark 2014 SE. The new version should be reported as 2.0.1.89.
Systems with Intel Dynamic Power and Thermal Framework (DPTF) driver version (8.4.11000.6436) may fail to execute and display Error 1: Errorstate::Enter: unknown error code (1) in the results browser.
You may encounter this issue when testing with older versions of SYSmark 2014 SE or MobileMark v1.5. If so, please visit either the SYSmark 2014 SE product page or the MobileMark 2014 v1.5 product page to download the latest patch and hotfix for your product. Update your benchmark according the patch or hotfix instructions and reboot the system under test. You should now be able to run SYSmark 2014 SE or MobileMark 2014 v1.5 successfully.
If you are testing SYSmark 2014 v1.5, please follow these steps to work around the issue:
1) Please visit the SYSmark 2014 v1.5 product page to download and apply any patches or hotfixes to your installation.
2) Download the Dptf_Sysmark_2014_v1.5_fix package and copy to the system under test
3) Extract the contents of the zip file
4) Right click the .reg file and choose ‘Merge’
5) Reboot the system under test
6) You should now be able to run SYSmark 2014 v1.5 successfully.
SYSmark 2014 SE patch 1 Hotfix 2 v2.0.1.87 for OneNote error 10004 and Excel CloseApp on Windows 10
Download “SYSmark 2014 SE patch 1 Hotfix 2 v2.0.1.87”
Instructions:
1) Download to target system
2) Unzip the archive
3) Close SM14 SE if the application is open
4) Right click the extracted .exe and run as administrator
SM14 SE patch 1 v2.0.1.78 or patch 1 with hotfix 1 2.0.1.81 must be installed to apply hotfix 2. The hotfix 2 package will *not* apply to earlier versions of SM14 SE, and it will not apply to SM14 v1.5 or MM14 v1.5
After the hotfix is applied, launch SM14 SE. The new version should be reported as 2.0.1.87.
MobileMark 2012
When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer. Using incorrect drivers could result in significantly reduced performance.
SYSmark and MobileMark support seven Non-English languages. Download the .pdf for the target language and follow the instructions to configure the operating system.
- BAPCo Product Configuration Guide for Non English OS (English)
- BAPCo Product Configuration Guide for Non English OS (Portuguese)
- BAPCo Product Configuration Guide for Non English OS (Chinese)
- BAPCo Product Configuration Guide for Non English OS (French)
- BAPCo Product Configuration Guide for Non English OS (German)
- BAPCo Product Configuration Guide for Non English OS (Japanese)
- BAPCo Product Configuration Guide for Non English OS (Russian)
- BAPCo Product Configuration Guide for Non English OS (Spanish)
MobileMark 2012 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.
MobileMark 2014
On some systems, MobileMark 2014 installation hangs when attempting to enable the direct play service and becomes unresponsive, even though the benchmark installation has completed. User experiencing this issue may work around the problem by rebooting the system to clear the installation hang. When the desktop appears, launch MobileMark 2014 and start a test.
Systems with Intel Dynamic Power and Thermal Framework (DPTF) driver version (8.4.11000.6436) may fail to execute and display Error 1: Errorstate::Enter: unknown error code (1) in the results browser.
You may encounter this issue when testing with older versions of SYSmark 2014 SE or MobileMark v1.5. If so, please visit either the SYSmark 2014 SE product page or the MobileMark 2014 v1.5 product page to download the latest patch and hotfix for your product. Update your benchmark according the patch or hotfix instructions and reboot the system under test. You should now be able to run SYSmark 2014 SE or MobileMark 2014 v1.5 successfully.
If you are testing SYSmark 2014 v1.5, please follow these steps to work around the issue:
1) Please visit the SYSmark 2014 v1.5 product page to download and apply any patches or hotfixes to your installation.
2) Download the Dptf_Sysmark_2014_v1.5_fix package and copy to the system under test
3) Extract the contents of the zip file
4) Right click the .reg file and choose ‘Merge’
5) Reboot the system under test
6) You should now be able to run SYSmark 2014 v1.5 successfully.
The following HotFix has been issued to correct issues when testing on Redstone 3 . HotFix 3 is a cumulative update.
Download MobileMark 2014 v1.5 patch 1 hotfix 3
Instructions:
1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of MobileMark 2014 v1.5 patch 1 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator
MobileMark 2014 patch 1 must be installed to apply this hot fix. The update will not apply to older versions of MobileMark 2014.
After the hotfix is applied, launch MobileMark 2014. The new version should be reported as 1.5.1.63.
SYSmark 2014
Systems with Intel Dynamic Power and Thermal Framework (DPTF) driver version (8.4.11000.6436) may fail to execute and display Error 1: Errorstate::Enter: unknown error code (1) in the results browser.
You may encounter this issue when testing with older versions of SYSmark 2014 SE or MobileMark v1.5. If so, please visit either the SYSmark 2014 SE product page or the MobileMark 2014 v1.5 product page to download the latest patch and hotfix for your product. Update your benchmark according the patch or hotfix instructions and reboot the system under test. You should now be able to run SYSmark 2014 SE or MobileMark 2014 v1.5 successfully.
If you are testing SYSmark 2014 v1.5, please follow these steps to work around the issue:
1) Please visit the SYSmark 2014 v1.5 product page to download and apply any patches or hotfixes to your installation.
2) Download the Dptf_Sysmark_2014_v1.5_fix package and copy to the system under test
3) Extract the contents of the zip file
4) Right click the .reg file and choose ‘Merge’
5) Reboot the system under test
6) You should now be able to run SYSmark 2014 v1.5 successfully.
Some users may encounter Error 1008: System Config failed with return code -1 when testing SYSmark 2014 v1.5 when testing on Windows 10 Redstone 3.
This manual work around has been replaced by the following Hotfix.
Download “SYSmark 2014 ver 1.5 patch 1, hotfix 1 v1.5.1.85 (config tool error under RS3)”
Instructions:
- Download to target system
- Unzip the archive
- Close SM14 v1.5 if the application is open
- Right click the .exe and run as administrator
SYSmark 2014 v1.5 patch 1 must be installed to apply hotfix 1. The update will not apply to older versions of SYSmark 2014 v1.5. After the hotfix is applied, launch SM14 v1.5. The new version should be reported as 1.5.1.85.
NVMe configurations: NVMe devices may show lower than expected performance in some
configurations due to the way Force Unit Access (FUA) write requests are handled by the
Windows operating system. Therefore, BAPCo recommends that users install the storage driver
provided by the manufacturer of their NVMe device. In cases where the manufacturer does not
provide an NVMe driver, users may disable the ‘Windows Write cache buffer flushing’ setting on
the NVMe drive prior to testing.
EEcoMark v2
A given Controller system may be used with several UUT systems. However, the Controller can only be connected to and interact with one UUT at a time.
No. EEcoMark v2 can be run without a power meter by selecting the ‘null meter’ option when setting up the test parameters in the Controller GUI. However, when selecting the ‘null meter’ option, power data readings are simulated and will not reflect the actual energy consumption of the system.
Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).
BAPCo
