Skip to content

Windows 10 start menu: Search suggestions are not announced automatically #5049

@nvaccessAuto

Description

@nvaccessAuto

Reported by nvdakor on 2015-04-23 05:22
Hi,
Hopefully this would be first of a series of proposals on supporting Windows 10. This is spin-off from a ticket on supporting search results in Windows 8.1 start screen:
If you search for items in Windows 10 Start Menu, NVDA does not announce search results automatically.

STR:

  1. Try using Windows 10 Tech Preview build 10041 or later with latest NVDA snapshots installed (I don't recommend using official NvDA releases in Windows 10 yet).
  2. From Start Menu, try searching for something (such as Project Spartan).
    Expected: NvDA announces search results as they come in or with some delay.
    Actual: Results are not announced.

Technical:

  • We need a new app module (searchui.py) to handle the new search routine in Windows 10. This could also provide basis for working on code to let NVDA cooperate with Cortana.
  • The search results are presented as edit fields when they may not be what they claim to be. Dev info shows the following:
name: u'Search box'
role: ROLE_EDITABLETEXT
states: STATE_FOCUSABLE, STATE_FOCUSED
isFocusable: True
hasFocus: 1
Python object: <NVDAObjects.Dynamic_EditableTextWithoutAutoSelectDetectionUIA object at 0x04E62ED0>
Python class mro: (<class 'NVDAObjects.Dynamic_EditableTextWithoutAutoSelectDetectionUIA'>, <class 'NVDAObjects.behaviors.EditableTextWithoutAutoSelectDetection'>, <class 'editableText.EditableTextWithoutAutoSelectDetection'>, <class 'NVDAObjects.behaviors.EditableText'>, <class 'editableText.EditableText'>, <class 'NVDAObjects.UIA.UIA'>, <class 'NVDAObjects.window.Window'>, <class 'NVDAObjects.NVDAObject'>, <class 'baseObject.ScriptableObject'>, <class 'baseObject.AutoPropertyObject'>, <type 'object'>)
description: u''
location: (48, 728, 320, 40)
value: u'project Spartan'
appModule: <'appModuleHandler' (appName u'searchui', process ID 4060) at address 4cf9330>
appModule.productName: exception: No version information
appModule.productVersion: exception: No version information
TextInfo: <class 'NVDAObjects.UIA.UIATextInfo'>
windowHandle: 66106
windowClassName: u'Windows.UI.Core.CoreWindow'
windowControlID: 0
windowStyle: -1811939328
windowThreadID: 4488
windowText: u'Search'
displayText: u''
UIAElement: <POINTER(IUIAutomationElement) ptr=0x6312f68 at 4cfbc60>
UIA automationID: SearchTextBox
UIA frameworkID: XAML
UIA runtimeID: (42, 66106, 2, 1)
UIA providerDescription: [Main(parent link):Unidentified Provider (unmanaged:Windows.UI.Xaml.dll)](pid:4060,hwnd:0x0)
UIA className: TextBox

Tested on Windows 10 Tech Preview build 10061 running as a VM guest in VMWare.

  • As the user searches for items, this field is updated, firing value change events. The issue is that this event is fired more than once by the search result object when new results are available. Thankfully, search results are stored as value for this object, so it might be possible to catch this. This is reproducible when using accevent.exe from Windows 8.1 SDK installed in Windows 10.
  • Ideally, we should try to provide similar user experience as that of Windows 8.1: when new results come in, there should be a delay of about half a second before announcing results.

Thanks.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions