Navigating by line in Microsoft Edge is now up to 3x faster in the Windows 10 Creaters Update by michaelDCurran · Pull Request #6994 · nvaccess/nvda

michaelDCurran · 2017-03-21T03:40:12Z

Speed improvements gained by making use of UI Automation cache requests when using UIA NVDAObjects to generate controlFields, by making use of the new IUIAutomationTextRange3 caching APIs, and by leveraging the fact that Edge now better conforms to a standard UI Automation text implementation thus the inefficient Edge-specific content fetching algorithm is no longer needed.

…w for instantiating a UIA NVDAObject with a UIAElement containing prefetched UI Automation property values via a UI Automation CacheRequest, available for the remainder of the core cycle the NVDAObject was instantiated in. This is useful when instantiating an NVDAObject purely to generate a control field, where the caller knows what properties are needed. All code within UIA NVDAObject and its subclasses should use the new _getUIACacheablePropertyValue method to fetch UI Automation properties as this will check the cache first. Make use of the new Win 10 RS2 bulk-fetch UIA APIs available on IUIAutomationTextRange3 such as getChildrenBuildCache, getEnclosingElementBuildCache and getAttributeValues. When not available, compatibility code falls back to the older APIs, providing the same cached results, but over multiple calls. UIATextInfo._getTextWithFieldsForUIARange and related content fetching code has been updated to use cacheRequests where possible. E.g. getChildrenBuildCache, getEnclosingElementBuildCache etc.

…use it in Windows builds less 15048. Windows builds above this now can use the generic UI Automation textWithFields code. Along with the added caching, these changes provide up to a 3x speed-up in reading lines in Microsoft Edge.

jcsteh · 2017-03-21T03:59:13Z

 		@type recurseChildren: bool
-		@param _rootElementRange: Optimization argument: the actual text range for the root element, as it is usually already known when making recursive calls.
-		@type rootElementRange: L{UIAHandler.IUIAutomationTextRange} 
+		@param _rootElementClipped: Indicates of textRange represents all of the given rootElement, or is clipped at the start or end.


"Indicates of"? Do you mean "Indicates if"?

jcsteh · 2017-03-21T04:28:43Z

 class UIA(Window):

+	def _get__coreCycleUIAPropertyCacheElementCache(self):
+		"""A dictionary per core cycle that is ready to map UIA property IDs to UIAElements with that property already cached."""


Can you add a brief explanation of why there might be multiple cache elements; e.g. the initial cache for ControlFields and the cache used to fetch states efficiently?

jcsteh · 2017-03-21T04:29:40Z

+
+	def _getUIACacheablePropertyValue(self,ID,ignoreDefault=False,onlyCached=False):
+		"""
+		Fetches the value for a UI Automation property from an element cache available in this core cycle. If not cached and L{onlyCache} is False then a new value will be fetched.


typo: onlyCache should be onlyCached.

jcsteh · 2017-03-21T04:29:53Z

+		Fetches the value for a UI Automation property from an element cache available in this core cycle. If not cached and L{onlyCache} is False then a new value will be fetched.
+		"""
+		elementCache=self._coreCycleUIAPropertyCacheElementCache
+		# If we have a UIAElement who's own cache contains the property, fetch the value from there


who's -> whose

jcsteh · 2017-03-21T04:32:39Z

+		else:
+			raise ValueError("UIA property value not cached")
+		# cache and return the value
+		#valueCache[key]=value


Looks like you had a value cache at some point. This commented line needs to be removed and the comment above it adjusted.

jcsteh · 2017-03-21T04:37:15Z

+		# Same case as access key.
+		if acceleratorKey:
+			shortcuts.append(acceleratorKey)
 			pass


Not necessary any more.

jcsteh · 2017-03-21T04:41:54Z

 		return not bool(self.text)

-	def getTextWithFields(self,formatConfig=None):
+	def old_getTextWithFields(self,formatConfig=None):


Is this no longer needed? If not, it should be removed.

jcsteh · 2017-03-21T04:43:50Z


 from comtypes.gen.UIAutomationClient import *

+


Extraneous blank line.

jcsteh · 2017-03-21T05:27:19Z

 		tempRange.MoveEndpointByRange(UIAHandler.TextPatternRangeEndpoint_End,rangeObj,UIAHandler.TextPatternRangeEndpoint_End)
 		yield tempRange.clone()
+
+def getEnclosingElementWithCacheFromUIATextRange(textRange,cacheRequest):


I think a docstring would be good here. Only has to point out that it uses getEnclosingElementBuildCache or falls back to getting the element and then building the cache if getEnclosingElementBuildCache is not supported.

jcsteh · 2017-03-21T05:27:38Z

+			e=e.buildUpdatedCache(self._cacheRequest)
+		return e
+
+def getChildrenWithCacheFromUIATextRange(textRange,cacheRequest):


Docstring as above.

…ields.

josephsl · 2017-03-22T19:09:58Z

Hi,

Possibly related to this PR: when attempting to retrieve obj.location in places such as Skype Preview's Download file button (when someone sends a file) and reported by folks using Audio Themes 3D add-on, obj.location traceback says:

Traceback (most recent call last):
File "", line 1, in
File "baseObject.pyc", line 34, in get
File "baseObject.pyc", line 110, in getPropertyViaCache
File "NVDAObjects\UIA_init.pyc", line 1147, in _get_location
AttributeError: 'tuple' object has no attribute 'left'

Thanks.

michaelDCurran · 2017-03-22T22:07:47Z

Thanks for reporting. Fixed now in 7c61bef. This was also breaking the Focus highlight add-on. Mick

…

On 23/03/2017 5:10 AM, Joseph Lee wrote: Hi, Possibly related to this PR: when attempting to retrieve obj.location in places such as Skype Preview's Download file button (when someone sends a file) and reported by folks using Audio Themes 3D add-on, obj.location traceback says: Traceback (most recent call last): File "", line 1, in File "baseObject.pyc", line 34, in *get* File "baseObject.pyc", line 110, in /getPropertyViaCache File "NVDAObjects\UIA_/init//.pyc", line 1147, in _get_location AttributeError: 'tuple' object has no attribute 'left' Thanks. — You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <#6994 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ANf5nXcMRYXPLR4G9a1IvzOivOSAYmqbks5roXIIgaJpZM4MjS-S>.

-- -- Michael Curran Executive Director, NV Access Limited PH: +61 7 3149 3306 www: http://www.nvaccess.org/ Twitter: @nvaccess Facebook: http://www.facebook.com/NVAccess

…than currentBoundingRectangle returns a tuple of left,top,width,height, rather than a specific rectangle object with members of left,top,right and bottom.

michaelDCurran · 2017-03-22T22:12:42Z

Actually, its commit 46cd6e6. There was a typo in the last commit message.

…

On 23/03/2017 5:10 AM, Joseph Lee wrote: Hi, Possibly related to this PR: when attempting to retrieve obj.location in places such as Skype Preview's Download file button (when someone sends a file) and reported by folks using Audio Themes 3D add-on, obj.location traceback says: Traceback (most recent call last): File "", line 1, in File "baseObject.pyc", line 34, in *get* File "baseObject.pyc", line 110, in /getPropertyViaCache File "NVDAObjects\UIA_/init//.pyc", line 1147, in _get_location AttributeError: 'tuple' object has no attribute 'left' Thanks. — You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <#6994 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ANf5nXcMRYXPLR4G9a1IvzOivOSAYmqbks5roXIIgaJpZM4MjS-S>.

-- -- Michael Curran Executive Director, NV Access Limited PH: +61 7 3149 3306 www: http://www.nvaccess.org/ Twitter: @nvaccess Facebook: http://www.facebook.com/NVAccess

jcsteh · 2017-03-23T11:13:06Z

As reported in this nvda-devel thread, this breaks if UIA is disabled. You can easily test this by setting config.conf["UIA"]["enabled"] = False, saving config and restarting.

Brian1Gaff · 2017-03-23T16:03:18Z

It certainly does, like on xp for example grin. Brian bglists@blueyonder.co.uk Sent via blueyonder. Please address personal email to:- briang1@blueyonder.co.uk, putting 'Brian Gaff' in the display name field. ----- Original Message ----- From: "James Teh" <notifications@github.com> To: "nvaccess/nvda" <nvda@noreply.github.com> Cc: "Subscribed" <subscribed@noreply.github.com> Sent: Thursday, March 23, 2017 11:13 AM Subject: Re: [nvaccess/nvda] Navigating by line in Microsoft Edge is now up to 3x faster in the Windows 10 Creaters Update (#6994)

…

As reported in [this nvda-devel thread](http://nabble.nvda-project.org/Last-two-snaps-will-not-install-on-windows-XP-tp41750.html), this breaks if UIA is disabled. You can easily test this by setting `config.conf["UIA"]["enabled"] = False`, saving config and restarting. -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: #6994 (comment)

…oat.

… support is enabled.

…ure version of Windows, either in cache requests, or provide defaults for them. Therefore: catch COMError when trhing to add properties to a controlFieldCacheRequest (E.g. sizeInSet on Windows 7), and also reintroduce try blocks around some of the property fetches in UIA NVDAObject's states property, much resembling what it used to be, though still using _getUIACacheablePropertyValue. Fixes #7013

michaelDCurran · 2017-03-27T05:49:06Z

@jcsteh: another review please. Fixes #7013

jcsteh

I follow the motivation behind a30c217, but I'm a bit confused about some of the changes. Why remove onlyCached from all of these property queries? Doesn't that mean we will try to make queries for them all? I guess those queries will fail at the client library before they even get executed? If so, is there any case where onlyCached is useful any more? If not, perhaps it should be removed to avoid confusion.

jcsteh

As discussed via voice, approving with the removal of the onlyCached argument to _getUIACacheablePropertyValue.

…d' parameter as it is really not needed.

michaelDCurran added 3 commits March 21, 2017 13:32

Manually include precompiled UI Automation com interfaces.

f66ce5d

michaelDCurran requested a review from jcsteh March 21, 2017 03:42

jcsteh approved these changes Mar 21, 2017

View reviewed changes

michaelDCurran added 2 commits March 22, 2017 06:56

UIA caching: make sure to cache UIA_IsEnabledPropertyId for control f…

f55b431

…ields.

Address review actions.

bb400d0

michaelDCurran added a commit that referenced this pull request Mar 21, 2017

Incubates #6994

3c28c06

nvaccessAuto added the incubating label Mar 21, 2017

nvaccessAuto assigned michaelDCurran Mar 21, 2017

michaelDCurran added a commit that referenced this pull request Mar 22, 2017

Incubates #6994

e4317aa

UIA: fetching boundingRectangle via getCurrentPropertyValueEx rather …

46cd6e6

…than currentBoundingRectangle returns a tuple of left,top,width,height, rather than a specific rectangle object with members of left,top,right and bottom.

michaelDCurran force-pushed the edgeSpeedup branch from 7c61bef to 46cd6e6 Compare March 22, 2017 22:09

michaelDCurran added a commit that referenced this pull request Mar 22, 2017

Incubates #6994

8cd1222

michaelDCurran added 2 commits March 24, 2017 09:13

UIA NVDAObject: location property must return int coordinates, not fl…

996ddb5

…oat.

UIA NVDAObject: don't use any UIA constants at class level unless UIA…

41c1473

… support is enabled.

michaelDCurran requested a review from jcsteh March 23, 2017 23:39

michaelDCurran mentioned this pull request Mar 24, 2017

performance issues in edge #6973

Closed

michaelDCurran added a commit that referenced this pull request Mar 24, 2017

Incubates #6994

38d8ee7

jcsteh mentioned this pull request Mar 26, 2017

Nvda does not read the suggested options in the start menu in windows 7 #7013

Closed

jcsteh reviewed Mar 27, 2017

View reviewed changes

jcsteh approved these changes Mar 27, 2017

View reviewed changes

UIA NVDAObject's _getUIACacheablePropertyValue: remove the 'onlyCache…

0357e92

…d' parameter as it is really not needed.

michaelDCurran added a commit that referenced this pull request Mar 27, 2017

Incubates #6994

b9c7808

jcsteh mentioned this pull request Mar 27, 2017

'Can not edit cells in excel. #7015

Closed

michaelDCurran merged commit c1799ee into master Apr 12, 2017

nvaccessAuto removed the incubating label Apr 12, 2017

nvaccessAuto added this to the 2017.2 milestone Apr 12, 2017

Uh oh!

Conversation

michaelDCurran commented Mar 21, 2017

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

josephsl commented Mar 22, 2017

Uh oh!

michaelDCurran commented Mar 22, 2017 via email

Uh oh!

michaelDCurran commented Mar 22, 2017 via email

Uh oh!

jcsteh commented Mar 23, 2017

Uh oh!

Brian1Gaff commented Mar 23, 2017 via email

Uh oh!

michaelDCurran commented Mar 27, 2017

Uh oh!

jcsteh left a comment

Choose a reason for hiding this comment

Uh oh!

jcsteh left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants