MobileMark 2014

Yes. Some applications packaged with the benchmark suite, such as Microsoft® Office® 2010 SP1, will expire 30 days after installation. Once the applications have expired, the disk containing the MobileMark® 2014 installation must be re-imaged with a new copy of the operating system, and a new instance of MobileMark® 2014 must be installed.

No. MobileMark® 2014  must be installed on and run from the C:\ drive and the user account installing the benchmark must have administrator rights on the target system. In addition, MobileMark® 2014 tests must be executed from the same account that was used to install the benchmark.

Test systems with MobileMark® 2014 installed should not be connected to the Internet. Some applications installed as part of MobileMark® 2014 may be deactivated and cause the benchmark to fail if an Internet connection is detected. These applications include:

• Adobe® Acrobat® Pro X
• Adobe® Photoshop® CS5 Extended
• Adobe® Premiere® Pro CS5

Yes. MobileMark® 2014 can be installed from external media such as USB disk or memory keys. Follow the steps below to install from external media. At least 20GB of free space is required.

1. Create a new folder on the target USB media. Example folder name “MM2014”
2. Create a folder for the contents of DVD1 inside the “MM2014” folder created in step 1. Example folder name “MM2014\Disc1”
3. Create a folder for the contents of DVD2 inside the “MM2014” folder created in step 1. Example folder name “MM2014\Disc2”
4. Copy the contents of DVD1 into “MM2014\Disc1” folder
5. Copy the contents of DVD2 into “MM2014\Disc2” folder
6. Copy the individual files Autorun.inf, BAPCo.ico, and MobileMark2014_Setup.exe from DVD1 into folder “MM2014\Disc1”
7. Copy files individual files Autorun.inf, BAPCo.ico, from DVD2 into folder “MM2014\Disc2”
8. Folder “MM2014\Disc1” should contain folders: Apps, Data, Help, and Setup, and individual files: Autorun.inf, BAPCo.ico, and MobileMark2012_Setup.exe
9. Folder “MM2014\Disc2” should contain folders: Apps2, Data2, and Setup2, and individual files: Autorun.inf, BAPCo.ico
10. Install the benchmark by launching MobileMark2014_Setup.exe from folder “MM2014\Disc1”

Microsoft Windows operating system attempts to boost performance by caching and pre-fetching data whenever it can. Scores may be lower on the first iteration as MobileMark® is running while Windows caching and pre-fetching is in progress.

The Conditioning Run provides the opportunity for the system to take advantage of built in OS performance optimizations that may help improve scores. If selected, the Conditioning Run iteration will be executed at the beginning of a project. Typically, the Conditioning Run will be executed on AC power. When one iteration of the selected scenario has been successfully completed, the MobileMark 2014 will prompt the user to unplug the system. Once the system is unplugged, MobileMark 2014 will continue to execute the selected scenario until the system battery is completely discharged. Results from the Conditioning Run are not included in the project performance or battery life scoring.

In cases where the Conditioning Run is executed on DC (battery power), the selected iteration will be run one time. Upon completion of the Conditioning Run iteration, MobileMark 2014 will pause the test to check if the system is plugged in or running on battery power. If the system is on battery power, MobileMark 2014 will continue to execute the chosen scenario until the system’s remaining battery charge is exhausted. However, the system will only report battery life and performance qualification scores if the remaining charge in the battery is sufficient to complete one iteration of the scenario. Results from the Conditioning Run will not be included in either the performance qualification or battery life scores.

MobileMark® 2014 supports installation on US English, Brazilian Portuguese, Chinese (Simplified), French, German, Japanese, Spanish, and Russian. The operating system’s Regional Language settings must be set to US English. Additional languages may be supported in future updates. Check the MobileMark® 2014 FAQ online for the latest information.

Installation time for MobileMark® 2014 takes approximately 1 hour. Installation time may vary based on the target system configuration.

MobileMark® 2014 run time will vary according to factors such as battery design capacity, battery charge level at the start of the test, test system configuration, and the selected scenario.

Be sure that the system under test is set to the correct date and time to avoid the ‘Clock error detected’ message.

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).

This issue typically manifests itself on certain machines with special drive hidden partitions installed by OEMs on their branded machines. One can work around this issue by deleting the special hidden partition installed on the drive(s) and re-running MobileMark® 2014.

MobileMark 2014 will support Windows 7 ‘N’ versions provided that the test image has Windows Media Player version 12 installed.

Internet Explorer 9 may crash when playing Flash content on systems equipped with NVIDIA Optimus graphics. Workaround this issue by going to the NVIDIA graphics control panel and set “Preferred graphics processor” to “Integrated graphics” for IE9.

Windows 8/8.1 is designed to prompt the user for activation every 3 hours. The activation prompt may interfere with MobileMark 2014 tests. There are three ways to prevent this interference:

• Activate the Windows 8 installation using a retail license key.
• Activate the Windows 8 installation using a Key Management Server. Note, this option is only available for Windows 8 Enterprise edition
• Enable Windows 8 Test Mode
  • Launch the “regedit” application
  • Navigate to the key “HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control.”
  • Create a new key with name “7503491f-4a39-4f84-b231-8aca3e203b94”

MobileMark 2014 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.

MobileMark 2014 documentation is located on the MobileMark 2014 product page here.

Please note: The below “Error 1010” Hotfix does not apply to versions 1.5.x.x, as this fix has already be integrated into the code.

Download Hotfix for error 1010

Instructions:

1) MobileMark 2014 patch 2 or SYSmark 2014 patch 2 must be installed to use this hotfix.

2) Download and extract the above zip file to the test system where error 1010 occurred.

3) If any SYSmark 2014 or MobileMark 2014 windows remain open, close them before attempting to apply the hotfix.

4) Right click the ‘Hotfix_for_Error_1010.exe’ file that you extracted from the zip and choose ‘Run as Administrator’.

5) The package will launch a command prompt window.

6) Follow the prompts to apply the hotfix.

7) Upon successful completion, press any key to close the command window. You may now attempt to run SM14 or MM14, and should no longer see error 1010.

Note: This fix applies only SM14 and MM14 patch 2. If the hotfix package cannot detect the SM14 or MM14 installation, it will exit.

This update is now included as part of MobileMark 2014 v1.5 HotFix 3. Please see the MobileMark 2014 v1.5 FAQ entry for HotFix 3

Note: BAPCo has issued a HotFix which automates this workaround. Please see this FAQ entry for more information.

When testing Redstone 3 (build 1709) with MobileMark 2014 v1.5, some users may experience a smart screen warning that blocks the test from completing and reporting a result. This issue is due to changes that Microsoft has made in the way Redstone 3 warns users when the remaining battery charge is low. This warning cannot be disabled as per Microsoft design.

BAPCo continues to work with Microsoft to resolve this issue. In the meantime, if you experience this issue when testing on Redstone 3, please refer to the workaround detailed in this document MM14.smart.screen.workaround.for.RS3

The following HotFix has been issued to correct issues when testing on Redstone 3 . HotFix 3 is a cumulative update.

Download MobileMark 2014 v1.5 patch 1 hotfix 3

Instructions:

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of MobileMark 2014 v1.5 patch 1 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

MobileMark 2014 patch 1 must be installed to apply this hot fix. The update will not apply to older versions of MobileMark 2014.

After the hotfix is applied, launch MobileMark 2014. The new version should be reported as 1.5.1.63.

On some systems, MobileMark 2014 installation hangs when attempting to enable the direct play service and becomes unresponsive, even though the benchmark installation has completed. User experiencing this issue may work around the problem by rebooting the system to clear the installation hang. When the desktop appears, launch MobileMark 2014 and start a test.

BAPCo MobileMark 2014 patch 3 v1.5.3.72 is no longer available.

BAPCo has discovered an issue in MM14 patch 3 which may cause issues with system idle on systems that support Modern Standby (Connected Standby). If the issue is encountered, systems under test may not report correct results.  Customers who have downloaded patch 3 should revert back to patch 2 for testing until BAPCo is able to issue an updated fix. Patch 2 is available for download on the MobileMark 2014 product page.

In addition, BAPCo will no longer accept results submissions for MobileMark 2014 v1.5.3.72.

Contact [email protected] with any questions.